2020-04-02T22:44:02.123 INFO:root:teuthology version: 1.0.0-8191bbb 2020-04-02T22:44:02.124 DEBUG:teuthology.run:Teuthology command: teuthology /tmp/teuthology-worker.9N7a4K.tmp -- --verbose --lock --description fs/traceless/{begin.yaml clusters/fixed-2-ucephfs.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{centos_8.yaml} tasks/cfuse_workunit_suites_dbench.yaml traceless/50pc.yaml} --name gregf-2020-04-02_17:05:44-fs-wip-greg-testing-42-distro-basic-smithi --block --owner scheduled_gregf@teuthology --archive /home/teuthworker/archive/gregf-2020-04-02_17:05:44-fs-wip-greg-testing-42-distro-basic-smithi/4919105 2020-04-02T22:44:02.160 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-04-02T22:44:02.212 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/gregf-2020-04-02_17:05:44-fs-wip-greg-testing-42-distro-basic-smithi/4919105 branch: wip-greg-testing-42 description: fs/traceless/{begin.yaml clusters/fixed-2-ucephfs.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{centos_8.yaml} tasks/cfuse_workunit_suites_dbench.yaml traceless/50pc.yaml} email: gfarnum@redhat.com first_in_suite: false job_id: '4919105' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: gregf-2020-04-02_17:05:44-fs-wip-greg-testing-42-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 30 - machine: disk: 200 os_type: centos os_version: '8.1' overrides: admin_socket: branch: wip-greg-testing-42 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 mds: debug mds: 20 debug ms: 1 mds bal frag: true mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds inject traceless reply probability: 0.5 mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: debug filestore: 20 debug journal: 20 debug ms: 1 debug osd: 25 osd objectstore: filestore osd op complaint time: 180 osd sloppy crc: true fs: xfs log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: cbb84f71d70460f911296715ab61ac09c6962b17 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: osd objectstore: filestore osd sloppy crc: true filestore: true fs: xfs install: ceph: sha1: cbb84f71d70460f911296715ab61ac09c6962b17 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 workunit: branch: wip-greg-testing-42 sha1: cbb84f71d70460f911296715ab61ac09c6962b17 owner: scheduled_gregf@teuthology priority: 101 repo: git://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 sha1: cbb84f71d70460f911296715ab61ac09c6962b17 suite: fs suite_branch: wip-greg-testing-42 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_wip-greg-testing-42/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: cbb84f71d70460f911296715ab61ac09c6962b17 tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell rpm: - python3-cephfs extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - dump - indent rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - ceph: null - ceph-fuse: null - workunit: clients: all: - suites/dbench.sh teuthology_branch: master tube: smithi verbose: false worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.2737 2020-04-02T22:44:02.213 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_wip-greg-testing-42/qa; will attempt to use it 2020-04-02T22:44:02.213 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_wip-greg-testing-42/qa/tasks 2020-04-02T22:44:02.213 INFO:teuthology.run_tasks:Running task internal.check_packages... 2020-04-02T22:44:02.215 INFO:teuthology.task.internal:Checking packages... 2020-04-02T22:44:02.228 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'basic' and ceph hash 'cbb84f71d70460f911296715ab61ac09c6962b17' 2020-04-02T22:44:02.228 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2020-04-02T22:44:02.228 INFO:teuthology.packaging:ref: None 2020-04-02T22:44:02.228 INFO:teuthology.packaging:tag: None 2020-04-02T22:44:02.228 INFO:teuthology.packaging:branch: wip-greg-testing-42 2020-04-02T22:44:02.229 INFO:teuthology.packaging:sha1: cbb84f71d70460f911296715ab61ac09c6962b17 2020-04-02T22:44:02.229 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-greg-testing-42 2020-04-02T22:44:02.480 INFO:teuthology.task.internal:Found packages for ceph version 16.0.0-316.gcbb84f7 2020-04-02T22:44:02.480 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2020-04-02T22:44:02.489 INFO:teuthology.task.internal:no buildpackages task found 2020-04-02T22:44:02.489 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2020-04-02T22:44:02.505 INFO:teuthology.task.internal.lock_machines:Locking machines... 2020-04-02T22:44:02.505 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-04-02T22:44:02.550 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:44:12.568 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:44:22.584 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:44:32.601 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:44:42.618 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:44:52.632 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:45:02.645 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:45:12.659 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:45:22.675 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:45:32.692 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:45:42.708 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:45:52.724 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:46:02.736 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:46:12.752 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:46:22.769 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:46:32.777 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:46:42.794 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:46:52.807 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:47:02.820 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:47:12.837 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:47:22.853 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:47:32.870 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:47:42.886 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:47:52.900 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:48:02.920 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:48:12.931 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:48:22.948 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:48:32.964 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:48:42.978 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:48:52.991 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:49:03.004 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:49:13.020 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:49:23.036 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:49:33.051 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:49:43.065 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:49:53.079 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:50:03.096 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:50:13.111 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:50:23.134 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:50:33.148 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:50:43.159 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:50:53.172 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:51:03.189 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:51:13.209 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:51:23.226 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:51:33.243 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:51:43.260 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:51:53.275 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:52:03.296 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:52:13.314 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:52:23.331 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:52:33.344 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:52:43.360 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:52:53.374 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:53:03.391 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:53:13.404 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:53:23.422 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:53:33.438 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:53:43.452 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:53:53.469 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:54:03.484 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:54:13.501 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:54:23.516 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:54:33.531 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:54:43.547 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:54:53.563 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:55:03.580 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:55:13.597 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T22:55:23.616 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T22:55:33.645 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T22:55:43.662 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T22:55:53.678 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T22:56:03.693 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T22:56:13.708 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T22:56:23.726 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T22:56:33.742 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T22:56:43.753 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T22:56:53.769 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T22:57:03.786 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T22:57:13.800 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T22:57:23.817 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T22:57:33.834 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T22:57:43.850 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T22:57:53.868 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T22:58:03.885 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T22:58:13.902 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T22:58:23.917 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T22:58:33.935 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T22:58:43.948 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T22:58:53.965 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T22:59:03.985 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T22:59:14.002 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T22:59:24.016 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T22:59:34.029 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T22:59:44.045 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T22:59:54.062 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:00:04.078 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:00:14.095 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:00:24.113 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:00:34.134 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:00:44.152 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:00:54.168 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:01:04.184 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:01:14.200 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:01:24.219 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:01:34.233 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:01:44.249 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:01:54.265 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:02:04.275 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:02:14.289 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:02:24.304 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:02:34.321 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:02:44.336 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:02:54.353 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:03:04.369 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:03:14.385 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:03:24.400 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:03:34.416 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:03:44.433 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:03:54.448 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:04:04.464 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:04:14.480 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:04:24.496 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:04:34.512 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:04:44.529 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:04:54.545 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:05:04.561 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:05:14.575 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:05:24.592 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:05:34.608 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:05:44.626 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:05:54.641 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:06:04.657 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:06:14.673 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:06:24.697 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:06:34.714 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:06:44.722 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:06:54.737 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:07:04.754 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:07:14.768 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:07:24.784 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:07:34.802 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:07:44.819 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:07:54.834 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:08:04.848 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:08:14.865 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:08:24.880 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:08:34.888 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:08:44.904 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:08:54.913 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:09:04.929 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:09:14.940 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:09:24.951 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:09:34.969 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:09:44.984 DEBUG:teuthology.lock.ops:lock_many request: {'count': 2, 'locked_by': 'scheduled_gregf@teuthology', 'description': '/home/teuthworker/archive/gregf-2020-04-02_17:05:44-fs-wip-greg-testing-42-distro-basic-smithi/4919105', 'machine_type': 'smithi'} 2020-04-02T23:09:45.000 DEBUG:teuthology.lock.ops:locked ubuntu@smithi174.front.sepia.ceph.com, ubuntu@smithi196.front.sepia.ceph.com 2020-04-02T23:09:45.060 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2020-04-02T23:09:45.245 INFO:teuthology.provision.fog.smithi196:Scheduling deploy of centos 8.1 2020-04-02T23:09:45.249 INFO:teuthology.provision.fog.smithi174:Scheduling deploy of centos 8.1 2020-04-02T23:09:45.554 INFO:teuthology.orchestra.console:Power off smithi174 2020-04-02T23:09:45.554 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-04-02T23:09:45.571 INFO:teuthology.orchestra.console:Power off smithi196 2020-04-02T23:09:45.571 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-04-02T23:09:45.582 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-02T23:09:45.592 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-02T23:09:49.603 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-02T23:09:49.620 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-02T23:09:53.721 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-02T23:09:53.731 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-02T23:09:53.940 INFO:teuthology.orchestra.console:Power off for smithi196 completed 2020-04-02T23:09:54.041 INFO:teuthology.orchestra.console:Power on smithi196 2020-04-02T23:09:54.041 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-04-02T23:09:54.063 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-02T23:09:57.832 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-02T23:09:58.042 INFO:teuthology.orchestra.console:Power off for smithi174 completed 2020-04-02T23:09:58.085 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-02T23:09:58.143 INFO:teuthology.orchestra.console:Power on smithi174 2020-04-02T23:09:58.144 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-04-02T23:09:58.164 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-02T23:10:02.185 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-02T23:10:02.195 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-02T23:10:02.395 INFO:teuthology.orchestra.console:Power on for smithi174 completed 2020-04-02T23:10:02.412 INFO:teuthology.orchestra.console:Power on for smithi196 completed 2020-04-02T23:10:02.497 INFO:teuthology.provision.fog.smithi174:Waiting for deploy to finish 2020-04-02T23:10:02.513 INFO:teuthology.provision.fog.smithi196:Waiting for deploy to finish 2020-04-02T23:12:33.650 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi196.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:12:33.667 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi174.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:12:42.730 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi196.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:12:42.732 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi174.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:12:51.790 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi196.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:12:51.792 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi174.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:13:00.873 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi196.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:13:00.874 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi174.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:13:09.934 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi196.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:13:09.943 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi174.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:13:19.017 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi196.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:13:19.018 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi174.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:13:28.074 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi196.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:13:28.075 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi174.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:13:37.129 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi196.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:14:08.977 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:14:09.358 INFO:teuthology.orchestra.run.smithi196:> hostname 2020-04-02T23:14:09.374 INFO:teuthology.orchestra.run.smithi196.stdout:smithi040 2020-04-02T23:14:09.374 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:14:09.428 INFO:teuthology.orchestra.run.smithi196:> grep smithi040 /etc/hosts 2020-04-02T23:14:09.482 INFO:teuthology.orchestra.run.smithi196.stdout:172.21.15.40 smithi040.front.sepia.ceph.com smithi040 2020-04-02T23:14:09.483 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:14:09.536 INFO:teuthology.orchestra.run.smithi196:> sudo hostname smithi196 2020-04-02T23:14:09.664 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:14:09.677 INFO:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/smithi040/smithi196/g' /etc/hosts 2020-04-02T23:14:09.756 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:14:09.809 INFO:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/172.21.15.40/172.21.15.196/g' /etc/hosts 2020-04-02T23:14:09.879 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:14:09.933 INFO:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/smithi040/smithi196/g' /etc/hostname 2020-04-02T23:14:10.002 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:14:10.056 INFO:teuthology.orchestra.run.smithi196:> sudo hostname smithi196 2020-04-02T23:14:10.123 INFO:teuthology.provision.fog.smithi196:Deploy complete! 2020-04-02T23:14:10.125 DEBUG:teuthology.parallel:result is None 2020-04-02T23:14:34.095 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi174.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:14:34.421 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:14:34.733 INFO:teuthology.orchestra.run.smithi174:> hostname 2020-04-02T23:14:34.747 INFO:teuthology.orchestra.run.smithi174.stdout:smithi174.front.sepia.ceph.com 2020-04-02T23:14:34.747 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:14:34.802 INFO:teuthology.orchestra.run.smithi174:> grep smithi174.front.sepia.ceph.com /etc/hosts 2020-04-02T23:14:34.856 INFO:teuthology.orchestra.run.smithi174.stdout:172.21.15.174 smithi174.front.sepia.ceph.com smithi174 2020-04-02T23:14:34.857 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:14:34.910 INFO:teuthology.orchestra.run.smithi174:> sudo hostname smithi174 2020-04-02T23:14:35.016 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:14:35.030 INFO:teuthology.orchestra.run.smithi174:> sudo sed -i -e 's/smithi174.front.sepia.ceph.com/smithi174/g' /etc/hosts 2020-04-02T23:14:35.097 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:14:35.151 INFO:teuthology.orchestra.run.smithi174:> sudo sed -i -e 's/172.21.15.174/172.21.15.174/g' /etc/hosts 2020-04-02T23:14:35.219 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:14:35.272 INFO:teuthology.orchestra.run.smithi174:> sudo sed -i -e 's/smithi174.front.sepia.ceph.com/smithi174/g' /etc/hostname 2020-04-02T23:14:35.339 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:14:35.393 INFO:teuthology.orchestra.run.smithi174:> sudo hostname smithi174 2020-04-02T23:14:35.467 INFO:teuthology.provision.fog.smithi174:Deploy complete! 2020-04-02T23:14:35.468 DEBUG:teuthology.parallel:result is None 2020-04-02T23:14:35.604 INFO:teuthology.lock.ops:Checking smithi196.front.sepia.ceph.com 2020-04-02T23:14:35.605 INFO:teuthology.lock.ops:New key found. Updating... 2020-04-02T23:14:35.622 INFO:teuthology.lock.ops:Checking smithi174.front.sepia.ceph.com 2020-04-02T23:14:35.622 INFO:teuthology.lock.ops:New key found. Updating... 2020-04-02T23:14:35.638 INFO:teuthology.lock.ops:Updating [smithi196.front.sepia.ceph.com]: set os type and version on server 2020-04-02T23:14:35.639 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi196.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:14:35.713 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:14:35.886 INFO:teuthology.orchestra.run.smithi196:> uname -m 2020-04-02T23:14:35.940 INFO:teuthology.orchestra.run.smithi196.stdout:x86_64 2020-04-02T23:14:35.940 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:14:35.994 INFO:teuthology.orchestra.run.smithi196:> cat /etc/os-release 2020-04-02T23:14:36.047 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="CentOS Linux" 2020-04-02T23:14:36.047 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="8 (Core)" 2020-04-02T23:14:36.048 INFO:teuthology.orchestra.run.smithi196.stdout:ID="centos" 2020-04-02T23:14:36.048 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE="rhel fedora" 2020-04-02T23:14:36.048 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="8" 2020-04-02T23:14:36.048 INFO:teuthology.orchestra.run.smithi196.stdout:PLATFORM_ID="platform:el8" 2020-04-02T23:14:36.048 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-04-02T23:14:36.048 INFO:teuthology.orchestra.run.smithi196.stdout:ANSI_COLOR="0;31" 2020-04-02T23:14:36.049 INFO:teuthology.orchestra.run.smithi196.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-04-02T23:14:36.049 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://www.centos.org/" 2020-04-02T23:14:36.049 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-04-02T23:14:36.049 INFO:teuthology.orchestra.run.smithi196.stdout: 2020-04-02T23:14:36.049 INFO:teuthology.orchestra.run.smithi196.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-04-02T23:14:36.049 INFO:teuthology.orchestra.run.smithi196.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-04-02T23:14:36.049 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-04-02T23:14:36.049 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-04-02T23:14:36.050 INFO:teuthology.orchestra.run.smithi196.stdout: 2020-04-02T23:14:36.050 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server 2020-04-02T23:14:36.064 INFO:teuthology.lock.ops:Updating [smithi174.front.sepia.ceph.com]: set os type and version on server 2020-04-02T23:14:36.065 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi174.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:14:36.129 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:14:36.290 INFO:teuthology.orchestra.run.smithi174:> uname -m 2020-04-02T23:14:36.344 INFO:teuthology.orchestra.run.smithi174.stdout:x86_64 2020-04-02T23:14:36.345 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:14:36.397 INFO:teuthology.orchestra.run.smithi174:> cat /etc/os-release 2020-04-02T23:14:36.451 INFO:teuthology.orchestra.run.smithi174.stdout:NAME="CentOS Linux" 2020-04-02T23:14:36.451 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION="8 (Core)" 2020-04-02T23:14:36.451 INFO:teuthology.orchestra.run.smithi174.stdout:ID="centos" 2020-04-02T23:14:36.451 INFO:teuthology.orchestra.run.smithi174.stdout:ID_LIKE="rhel fedora" 2020-04-02T23:14:36.451 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_ID="8" 2020-04-02T23:14:36.452 INFO:teuthology.orchestra.run.smithi174.stdout:PLATFORM_ID="platform:el8" 2020-04-02T23:14:36.452 INFO:teuthology.orchestra.run.smithi174.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-04-02T23:14:36.452 INFO:teuthology.orchestra.run.smithi174.stdout:ANSI_COLOR="0;31" 2020-04-02T23:14:36.452 INFO:teuthology.orchestra.run.smithi174.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-04-02T23:14:36.452 INFO:teuthology.orchestra.run.smithi174.stdout:HOME_URL="https://www.centos.org/" 2020-04-02T23:14:36.452 INFO:teuthology.orchestra.run.smithi174.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-04-02T23:14:36.452 INFO:teuthology.orchestra.run.smithi174.stdout: 2020-04-02T23:14:36.453 INFO:teuthology.orchestra.run.smithi174.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-04-02T23:14:36.453 INFO:teuthology.orchestra.run.smithi174.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-04-02T23:14:36.453 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-04-02T23:14:36.453 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-04-02T23:14:36.453 INFO:teuthology.orchestra.run.smithi174.stdout: 2020-04-02T23:14:36.454 INFO:teuthology.lock.ops:Updating smithi174.front.sepia.ceph.com on lock server 2020-04-02T23:14:36.470 INFO:teuthology.task.internal.lock_machines:2 smithi machines locked this try, 2/2 locked so far 2020-04-02T23:14:36.501 INFO:teuthology.task.internal.lock_machines:Locked targets: smithi174.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3gyiXBNua9BUaupXpimYbFZF1YsGffMnTNJ5pqivIgcUvIHBuCDfWhLnqqm32vIQGqMqC2T47cW/crbZPMIVlqqXSWpSes4M6mcpOQlKa2rq4JLSC4maNAv1Xr00wbjiDg79rL56GBYvkjc9QEv5UFzTlwpSOLNhxjybSr5S/3aQ3nJjAlhONrvYFveoV8L6HI1aIJLSxDf1JnLwY4syYDRbz9OJt2XXKppQlewOuHaDuidid2hTmyy1Wwsg0LvCU2RfQnlEUNwRzG+dNmXaMpBm32mt/K3K9+aVVkBxpuEfO6XTEzeclmrnMdDiSp31vX1EgaKlXoVX7tPwZ/FdL6KOlsmylQAeo3ijO/Q8s5S3ehuBlCJzp82vDDHTYTiBMLn0dg867rDUq8r0Yz7PO9CpEk1exys49LnBkIU8RUKthKS0BGF8Gws3xA1YiDDZ8sRKUBGYlR0w4JabWkPaHpY3KB6UfYAmk8phGkSpzFO6iskPtytaiPyLqWVLXGp0= smithi196.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDQ0fJavLFzLyzKQgESiHP74aFoU6LuuiVdZd45PJPAkxsgOoex2xWlxsJb13NgVOJmcae0VUsgQdSJCG7gz/IfhEP0gxDtxU2YXBI4IenAui6MTYpEszNOoVP/VIZvBdfLdisNDA8a/TiPQn3FgHtqYMUe1CtGBuZCBKQWZ3dHH4j42GKoGG1980m2RBAxyj0PUD4Nrwg9eXqFQBL8gq0WhqsXqZWeQJu0B9+ncIR23HLXrtLM407DdWeYiz8DsRkpo7IY2upM3jjXUg7Ou1+32bWVTl9Hooi3yDBimRHeXU0OQ+yqLOKYD+ceI1FvLXO+7NEWZ4Zk988Ur57r8zDGoQR+76ACcNb5aPJfolrAxMwPqIRty44ohmE8YYRUR2zRKS0hQ5ljCY3LnNkhX784vvGUt8WTOawcTaXLOpbparZ13h+k3/4LfmSYLzqONEaur0T5KYjY33xXNHIrr4IC9WB+q2KxLjZ6W4j/N1KAMmm1Ov1HoZ9xgf9TmwGVCYE= 2020-04-02T23:14:36.501 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-04-02T23:14:36.561 INFO:teuthology.run_tasks:Running task internal.save_config... 2020-04-02T23:14:36.569 INFO:teuthology.task.internal:Saving configuration 2020-04-02T23:14:36.586 INFO:teuthology.run_tasks:Running task internal.check_lock... 2020-04-02T23:14:36.596 INFO:teuthology.task.internal.check_lock:Checking locks... 2020-04-02T23:14:36.611 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2020-04-02 23:09:44.991226', u'locked_by': u'scheduled_gregf@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi174.front.sepia.ceph.com', u'os_version': u'8', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'centos', u'arch': u'x86_64', u'ssh_pub_key': u'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJIji23yY7/3pf5fdFM7J/6UbBs/5QkNwXD00HOEMvRw1WUxQfOFVH068jNwHq++vuH48UnkSYrtmiBQSYKInp0=', u'description': u'/home/teuthworker/archive/gregf-2020-04-02_17:05:44-fs-wip-greg-testing-42-distro-basic-smithi/4919105'} 2020-04-02T23:14:36.625 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2020-04-02 23:09:44.991207', u'locked_by': u'scheduled_gregf@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi196.front.sepia.ceph.com', u'os_version': u'8', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'centos', u'arch': u'x86_64', u'ssh_pub_key': u'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFgFa/uhX6VK0iS6oSU+fVdrb92NEierwLG3zQhXXRIpx1IM+gGOqmKKSlYF5r3QJYbuRjE11jF7Mp8/hao1fMg=', u'description': u'/home/teuthworker/archive/gregf-2020-04-02_17:05:44-fs-wip-greg-testing-42-distro-basic-smithi/4919105'} 2020-04-02T23:14:36.625 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2020-04-02T23:14:36.635 INFO:teuthology.task.internal:roles: ubuntu@smithi174.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2020-04-02T23:14:36.636 INFO:teuthology.task.internal:roles: ubuntu@smithi196.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2020-04-02T23:14:36.636 INFO:teuthology.run_tasks:Running task console_log... 2020-04-02T23:14:36.720 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2020-04-02T23:14:36.721 INFO:teuthology.run_tasks:Running task internal.connect... 2020-04-02T23:14:36.731 INFO:teuthology.task.internal:Opening connections... 2020-04-02T23:14:36.731 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi196.front.sepia.ceph.com 2020-04-02T23:14:36.732 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi196.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:14:36.803 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi174.front.sepia.ceph.com 2020-04-02T23:14:36.804 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi174.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:14:36.872 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2020-04-02T23:14:36.883 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:14:36.923 INFO:teuthology.orchestra.run.smithi196:> uname -m 2020-04-02T23:14:36.976 INFO:teuthology.orchestra.run.smithi196.stdout:x86_64 2020-04-02T23:14:36.977 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:14:37.033 INFO:teuthology.orchestra.run.smithi196:> cat /etc/os-release 2020-04-02T23:14:37.086 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="CentOS Linux" 2020-04-02T23:14:37.086 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="8 (Core)" 2020-04-02T23:14:37.087 INFO:teuthology.orchestra.run.smithi196.stdout:ID="centos" 2020-04-02T23:14:37.087 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE="rhel fedora" 2020-04-02T23:14:37.087 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="8" 2020-04-02T23:14:37.087 INFO:teuthology.orchestra.run.smithi196.stdout:PLATFORM_ID="platform:el8" 2020-04-02T23:14:37.087 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-04-02T23:14:37.087 INFO:teuthology.orchestra.run.smithi196.stdout:ANSI_COLOR="0;31" 2020-04-02T23:14:37.087 INFO:teuthology.orchestra.run.smithi196.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-04-02T23:14:37.088 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://www.centos.org/" 2020-04-02T23:14:37.088 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-04-02T23:14:37.088 INFO:teuthology.orchestra.run.smithi196.stdout: 2020-04-02T23:14:37.088 INFO:teuthology.orchestra.run.smithi196.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-04-02T23:14:37.088 INFO:teuthology.orchestra.run.smithi196.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-04-02T23:14:37.088 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-04-02T23:14:37.088 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-04-02T23:14:37.089 INFO:teuthology.orchestra.run.smithi196.stdout: 2020-04-02T23:14:37.089 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server 2020-04-02T23:14:37.103 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:14:37.118 INFO:teuthology.orchestra.run.smithi174:> uname -m 2020-04-02T23:14:37.173 INFO:teuthology.orchestra.run.smithi174.stdout:x86_64 2020-04-02T23:14:37.174 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:14:37.227 INFO:teuthology.orchestra.run.smithi174:> cat /etc/os-release 2020-04-02T23:14:37.280 INFO:teuthology.orchestra.run.smithi174.stdout:NAME="CentOS Linux" 2020-04-02T23:14:37.280 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION="8 (Core)" 2020-04-02T23:14:37.280 INFO:teuthology.orchestra.run.smithi174.stdout:ID="centos" 2020-04-02T23:14:37.280 INFO:teuthology.orchestra.run.smithi174.stdout:ID_LIKE="rhel fedora" 2020-04-02T23:14:37.281 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_ID="8" 2020-04-02T23:14:37.281 INFO:teuthology.orchestra.run.smithi174.stdout:PLATFORM_ID="platform:el8" 2020-04-02T23:14:37.281 INFO:teuthology.orchestra.run.smithi174.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-04-02T23:14:37.281 INFO:teuthology.orchestra.run.smithi174.stdout:ANSI_COLOR="0;31" 2020-04-02T23:14:37.281 INFO:teuthology.orchestra.run.smithi174.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-04-02T23:14:37.281 INFO:teuthology.orchestra.run.smithi174.stdout:HOME_URL="https://www.centos.org/" 2020-04-02T23:14:37.281 INFO:teuthology.orchestra.run.smithi174.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-04-02T23:14:37.282 INFO:teuthology.orchestra.run.smithi174.stdout: 2020-04-02T23:14:37.282 INFO:teuthology.orchestra.run.smithi174.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-04-02T23:14:37.282 INFO:teuthology.orchestra.run.smithi174.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-04-02T23:14:37.282 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-04-02T23:14:37.282 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-04-02T23:14:37.282 INFO:teuthology.orchestra.run.smithi174.stdout: 2020-04-02T23:14:37.283 INFO:teuthology.lock.ops:Updating smithi174.front.sepia.ceph.com on lock server 2020-04-02T23:14:37.293 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2020-04-02T23:14:37.330 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2020-04-02T23:14:37.340 INFO:teuthology.task.internal:Checking for old test directory... 2020-04-02T23:14:37.340 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:14:37.353 INFO:teuthology.orchestra.run.smithi174:> test '!' -e /home/ubuntu/cephtest 2020-04-02T23:14:37.396 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:14:37.410 INFO:teuthology.orchestra.run.smithi196:> test '!' -e /home/ubuntu/cephtest 2020-04-02T23:14:37.463 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2020-04-02T23:14:37.474 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2020-04-02T23:14:37.474 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:14:37.488 INFO:teuthology.orchestra.run.smithi174:> test -z $(ls -A /var/lib/ceph) 2020-04-02T23:14:37.530 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:14:37.543 INFO:teuthology.orchestra.run.smithi196:> test -z $(ls -A /var/lib/ceph) 2020-04-02T23:14:37.613 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2020-04-02T23:14:37.655 INFO:teuthology.run_tasks:Running task kernel... 2020-04-02T23:14:37.673 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'sha1': 'distro', 'kdb': True}, 'mon.c': {'sha1': 'distro', 'kdb': True}, 'mon.b': {'sha1': 'distro', 'kdb': True}, 'mds.a': {'sha1': 'distro', 'kdb': True}, 'mds.b': {'sha1': 'distro', 'kdb': True}, 'osd.1': {'sha1': 'distro', 'kdb': True}, 'osd.0': {'sha1': 'distro', 'kdb': True}, 'osd.3': {'sha1': 'distro', 'kdb': True}, 'osd.2': {'sha1': 'distro', 'kdb': True}, 'osd.5': {'sha1': 'distro', 'kdb': True}, 'osd.4': {'sha1': 'distro', 'kdb': True}, 'osd.7': {'sha1': 'distro', 'kdb': True}, 'osd.6': {'sha1': 'distro', 'kdb': True}, 'mgr.y': {'sha1': 'distro', 'kdb': True}, 'mgr.x': {'sha1': 'distro', 'kdb': True}, 'client.0': {'sha1': 'distro', 'kdb': True}} 2020-04-02T23:14:37.673 INFO:teuthology.task.kernel:config {'mon.a': {'sha1': 'distro', 'kdb': True}, 'mon.b': {'sha1': 'distro', 'kdb': True}}, timeout 300 2020-04-02T23:14:37.673 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:14:37.690 INFO:teuthology.orchestra.run.smithi174:> uname -r 2020-04-02T23:14:37.743 INFO:teuthology.orchestra.run.smithi174.stdout:4.18.0-147.5.1.el8_1.x86_64 2020-04-02T23:14:37.744 INFO:teuthology.task.kernel:Running kernel on smithi174: 4.18.0-147.5.1.el8_1.x86_64 2020-04-02T23:14:37.744 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:14:37.797 INFO:teuthology.orchestra.run.smithi174:> sudo yum install -y kernel 2020-04-02T23:14:40.092 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS-8 - AppStream 39 MB/s | 6.6 MB 00:00 2020-04-02T23:14:41.251 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS-8 - Base 41 MB/s | 5.0 MB 00:00 2020-04-02T23:14:42.036 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS-8 - Extras 70 kB/s | 4.4 kB 00:00 2020-04-02T23:14:42.191 INFO:teuthology.orchestra.run.smithi174.stdout:Copr repo for ceph-el8 owned by ktdreyer 422 kB/s | 47 kB 00:00 2020-04-02T23:14:42.621 INFO:teuthology.orchestra.run.smithi174.stdout:Extra Packages for Enterprise Linux 16 MB/s | 6.2 MB 00:00 2020-04-02T23:14:43.858 INFO:teuthology.orchestra.run.smithi174.stdout:lab-extras 5.7 MB/s | 30 kB 00:00 2020-04-02T23:14:44.747 INFO:teuthology.orchestra.run.smithi174.stdout:Package kernel-4.18.0-147.el8.x86_64 is already installed. 2020-04-02T23:14:44.747 INFO:teuthology.orchestra.run.smithi174.stdout:Package kernel-4.18.0-147.5.1.el8_1.x86_64 is already installed. 2020-04-02T23:14:44.911 INFO:teuthology.orchestra.run.smithi174.stdout:Dependencies resolved. 2020-04-02T23:14:44.912 INFO:teuthology.orchestra.run.smithi174.stdout:Nothing to do. 2020-04-02T23:14:44.913 INFO:teuthology.orchestra.run.smithi174.stdout:Complete! 2020-04-02T23:14:45.052 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:14:45.066 INFO:teuthology.orchestra.run.smithi174:> echo no | sudo yum reinstall kernel || true 2020-04-02T23:14:45.495 INFO:teuthology.orchestra.run.smithi174.stdout:Last metadata expiration check: 0:00:02 ago on Thu 02 Apr 2020 11:14:43 PM UTC. 2020-04-02T23:14:45.842 INFO:teuthology.orchestra.run.smithi174.stdout:Dependencies resolved. 2020-04-02T23:14:45.843 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2020-04-02T23:14:45.843 INFO:teuthology.orchestra.run.smithi174.stdout: Package Architecture Version Repository Size 2020-04-02T23:14:45.843 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2020-04-02T23:14:45.843 INFO:teuthology.orchestra.run.smithi174.stdout:Reinstalling: 2020-04-02T23:14:45.844 INFO:teuthology.orchestra.run.smithi174.stdout: kernel x86_64 4.18.0-147.5.1.el8_1 CentOS-Base 1.5 M 2020-04-02T23:14:45.844 INFO:teuthology.orchestra.run.smithi174.stdout: kernel x86_64 4.18.0-147.el8 CentOS-Base 1.5 M 2020-04-02T23:14:45.844 INFO:teuthology.orchestra.run.smithi174.stdout: 2020-04-02T23:14:45.844 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction Summary 2020-04-02T23:14:45.844 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2020-04-02T23:14:45.844 INFO:teuthology.orchestra.run.smithi174.stdout: 2020-04-02T23:14:45.845 INFO:teuthology.orchestra.run.smithi174.stdout:Total download size: 3.1 M 2020-04-02T23:14:45.845 INFO:teuthology.orchestra.run.smithi174.stdout:Installed size: 0 2020-04-02T23:14:45.845 INFO:teuthology.orchestra.run.smithi174.stderr:Operation aborted. 2020-04-02T23:14:45.960 INFO:teuthology.orchestra.run.smithi174.stdout:Is this ok [y/N]: 2020-04-02T23:14:45.960 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:14:45.975 INFO:teuthology.orchestra.run.smithi174:> sudo yum reinstall -y kernel || true 2020-04-02T23:14:46.407 INFO:teuthology.orchestra.run.smithi174.stdout:Last metadata expiration check: 0:00:03 ago on Thu 02 Apr 2020 11:14:43 PM UTC. 2020-04-02T23:14:46.781 INFO:teuthology.orchestra.run.smithi174.stdout:Dependencies resolved. 2020-04-02T23:14:46.782 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2020-04-02T23:14:46.782 INFO:teuthology.orchestra.run.smithi174.stdout: Package Architecture Version Repository Size 2020-04-02T23:14:46.782 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2020-04-02T23:14:46.783 INFO:teuthology.orchestra.run.smithi174.stdout:Reinstalling: 2020-04-02T23:14:46.783 INFO:teuthology.orchestra.run.smithi174.stdout: kernel x86_64 4.18.0-147.5.1.el8_1 CentOS-Base 1.5 M 2020-04-02T23:14:46.783 INFO:teuthology.orchestra.run.smithi174.stdout: kernel x86_64 4.18.0-147.el8 CentOS-Base 1.5 M 2020-04-02T23:14:46.783 INFO:teuthology.orchestra.run.smithi174.stdout: 2020-04-02T23:14:46.783 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction Summary 2020-04-02T23:14:46.783 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2020-04-02T23:14:46.783 INFO:teuthology.orchestra.run.smithi174.stdout: 2020-04-02T23:14:46.784 INFO:teuthology.orchestra.run.smithi174.stdout:Total download size: 3.1 M 2020-04-02T23:14:46.784 INFO:teuthology.orchestra.run.smithi174.stdout:Installed size: 0 2020-04-02T23:14:46.784 INFO:teuthology.orchestra.run.smithi174.stdout:Downloading Packages: 2020-04-02T23:14:46.838 INFO:teuthology.orchestra.run.smithi174.stdout:(1/2): kernel-4.18.0-147.5.1.el8_1.x86_64.rpm 28 MB/s | 1.5 MB 00:00 2020-04-02T23:14:46.853 INFO:teuthology.orchestra.run.smithi174.stdout:(2/2): kernel-4.18.0-147.el8.x86_64.rpm 23 MB/s | 1.5 MB 00:00 2020-04-02T23:14:46.853 INFO:teuthology.orchestra.run.smithi174.stdout:-------------------------------------------------------------------------------- 2020-04-02T23:14:46.853 INFO:teuthology.orchestra.run.smithi174.stdout:Total 45 MB/s | 3.1 MB 00:00 2020-04-02T23:14:46.874 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction check 2020-04-02T23:14:47.060 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction check succeeded. 2020-04-02T23:14:47.061 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction test 2020-04-02T23:14:47.120 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction test succeeded. 2020-04-02T23:14:47.121 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction 2020-04-02T23:14:47.273 INFO:teuthology.orchestra.run.smithi174.stdout: Preparing : 1/1 2020-04-02T23:14:47.405 INFO:teuthology.orchestra.run.smithi174.stdout: Reinstalling : kernel-4.18.0-147.el8.x86_64 1/4 2020-04-02T23:14:47.548 INFO:teuthology.orchestra.run.smithi174.stdout: Reinstalling : kernel-4.18.0-147.5.1.el8_1.x86_64 2/4 2020-04-02T23:14:47.549 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : kernel-4.18.0-147.el8.x86_64 3/4 2020-04-02T23:14:47.639 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: kernel-4.18.0-147.el8.x86_64 3/4 2020-04-02T23:14:47.640 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : kernel-4.18.0-147.5.1.el8_1.x86_64 4/4 2020-04-02T23:14:47.881 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: kernel-4.18.0-147.5.1.el8_1.x86_64 4/4 2020-04-02T23:14:47.881 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : kernel-4.18.0-147.5.1.el8_1.x86_64 1/4 2020-04-02T23:14:47.881 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : kernel-4.18.0-147.5.1.el8_1.x86_64 2/4 2020-04-02T23:14:47.881 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : kernel-4.18.0-147.el8.x86_64 3/4 2020-04-02T23:14:48.265 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : kernel-4.18.0-147.el8.x86_64 4/4 2020-04-02T23:14:48.265 INFO:teuthology.orchestra.run.smithi174.stdout: 2020-04-02T23:14:48.265 INFO:teuthology.orchestra.run.smithi174.stdout:Reinstalled: 2020-04-02T23:14:48.265 INFO:teuthology.orchestra.run.smithi174.stdout: kernel-4.18.0-147.5.1.el8_1.x86_64 kernel-4.18.0-147.el8.x86_64 2020-04-02T23:14:48.265 INFO:teuthology.orchestra.run.smithi174.stdout: 2020-04-02T23:14:48.266 INFO:teuthology.orchestra.run.smithi174.stdout:Complete! 2020-04-02T23:14:48.359 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:14:48.413 INFO:teuthology.orchestra.run.smithi174:> rpm -q kernel --last | head -n 1 2020-04-02T23:14:48.511 INFO:teuthology.orchestra.run.smithi174.stdout:kernel-4.18.0-147.el8.x86_64 Thu 02 Apr 2020 11:14:47 PM UTC 2020-04-02T23:14:48.513 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-147.el8.x86_64 2020-04-02T23:14:48.513 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-147.5.1.el8_1.x86_64 Expected: 4.18.0-147.el8.x86_64 2020-04-02T23:14:48.513 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:14:48.530 INFO:teuthology.orchestra.run.smithi196:> uname -r 2020-04-02T23:14:48.586 INFO:teuthology.orchestra.run.smithi196.stdout:4.18.0-147.5.1.el8_1.x86_64 2020-04-02T23:14:48.586 INFO:teuthology.task.kernel:Running kernel on smithi196: 4.18.0-147.5.1.el8_1.x86_64 2020-04-02T23:14:48.586 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:14:48.642 INFO:teuthology.orchestra.run.smithi196:> sudo yum install -y kernel 2020-04-02T23:14:51.192 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS-8 - AppStream 42 MB/s | 6.6 MB 00:00 2020-04-02T23:14:52.345 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS-8 - Base 43 MB/s | 5.0 MB 00:00 2020-04-02T23:14:53.139 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS-8 - Extras 67 kB/s | 4.4 kB 00:00 2020-04-02T23:14:53.298 INFO:teuthology.orchestra.run.smithi196.stdout:Copr repo for ceph-el8 owned by ktdreyer 414 kB/s | 47 kB 00:00 2020-04-02T23:14:53.704 INFO:teuthology.orchestra.run.smithi196.stdout:Extra Packages for Enterprise Linux 17 MB/s | 6.2 MB 00:00 2020-04-02T23:14:54.945 INFO:teuthology.orchestra.run.smithi196.stdout:lab-extras 5.5 MB/s | 30 kB 00:00 2020-04-02T23:14:55.831 INFO:teuthology.orchestra.run.smithi196.stdout:Package kernel-4.18.0-147.el8.x86_64 is already installed. 2020-04-02T23:14:55.831 INFO:teuthology.orchestra.run.smithi196.stdout:Package kernel-4.18.0-147.5.1.el8_1.x86_64 is already installed. 2020-04-02T23:14:55.997 INFO:teuthology.orchestra.run.smithi196.stdout:Dependencies resolved. 2020-04-02T23:14:55.998 INFO:teuthology.orchestra.run.smithi196.stdout:Nothing to do. 2020-04-02T23:14:55.998 INFO:teuthology.orchestra.run.smithi196.stdout:Complete! 2020-04-02T23:14:56.123 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:14:56.136 INFO:teuthology.orchestra.run.smithi196:> echo no | sudo yum reinstall kernel || true 2020-04-02T23:14:56.569 INFO:teuthology.orchestra.run.smithi196.stdout:Last metadata expiration check: 0:00:02 ago on Thu 02 Apr 2020 11:14:54 PM UTC. 2020-04-02T23:14:56.921 INFO:teuthology.orchestra.run.smithi196.stdout:Dependencies resolved. 2020-04-02T23:14:56.921 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2020-04-02T23:14:56.921 INFO:teuthology.orchestra.run.smithi196.stdout: Package Architecture Version Repository Size 2020-04-02T23:14:56.921 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2020-04-02T23:14:56.921 INFO:teuthology.orchestra.run.smithi196.stdout:Reinstalling: 2020-04-02T23:14:56.921 INFO:teuthology.orchestra.run.smithi196.stdout: kernel x86_64 4.18.0-147.5.1.el8_1 CentOS-Base 1.5 M 2020-04-02T23:14:56.922 INFO:teuthology.orchestra.run.smithi196.stdout: kernel x86_64 4.18.0-147.el8 CentOS-Base 1.5 M 2020-04-02T23:14:56.922 INFO:teuthology.orchestra.run.smithi196.stdout: 2020-04-02T23:14:56.922 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction Summary 2020-04-02T23:14:56.922 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2020-04-02T23:14:56.922 INFO:teuthology.orchestra.run.smithi196.stdout: 2020-04-02T23:14:56.922 INFO:teuthology.orchestra.run.smithi196.stdout:Total download size: 3.1 M 2020-04-02T23:14:56.922 INFO:teuthology.orchestra.run.smithi196.stdout:Installed size: 0 2020-04-02T23:14:56.923 INFO:teuthology.orchestra.run.smithi196.stderr:Operation aborted. 2020-04-02T23:14:57.022 INFO:teuthology.orchestra.run.smithi196.stdout:Is this ok [y/N]: 2020-04-02T23:14:57.023 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:14:57.035 INFO:teuthology.orchestra.run.smithi196:> sudo yum reinstall -y kernel || true 2020-04-02T23:14:57.462 INFO:teuthology.orchestra.run.smithi196.stdout:Last metadata expiration check: 0:00:03 ago on Thu 02 Apr 2020 11:14:54 PM UTC. 2020-04-02T23:14:57.814 INFO:teuthology.orchestra.run.smithi196.stdout:Dependencies resolved. 2020-04-02T23:14:57.814 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2020-04-02T23:14:57.815 INFO:teuthology.orchestra.run.smithi196.stdout: Package Architecture Version Repository Size 2020-04-02T23:14:57.815 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2020-04-02T23:14:57.815 INFO:teuthology.orchestra.run.smithi196.stdout:Reinstalling: 2020-04-02T23:14:57.815 INFO:teuthology.orchestra.run.smithi196.stdout: kernel x86_64 4.18.0-147.5.1.el8_1 CentOS-Base 1.5 M 2020-04-02T23:14:57.815 INFO:teuthology.orchestra.run.smithi196.stdout: kernel x86_64 4.18.0-147.el8 CentOS-Base 1.5 M 2020-04-02T23:14:57.815 INFO:teuthology.orchestra.run.smithi196.stdout: 2020-04-02T23:14:57.815 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction Summary 2020-04-02T23:14:57.816 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2020-04-02T23:14:57.816 INFO:teuthology.orchestra.run.smithi196.stdout: 2020-04-02T23:14:57.816 INFO:teuthology.orchestra.run.smithi196.stdout:Total download size: 3.1 M 2020-04-02T23:14:57.817 INFO:teuthology.orchestra.run.smithi196.stdout:Installed size: 0 2020-04-02T23:14:57.817 INFO:teuthology.orchestra.run.smithi196.stdout:Downloading Packages: 2020-04-02T23:14:57.881 INFO:teuthology.orchestra.run.smithi196.stdout:(1/2): kernel-4.18.0-147.5.1.el8_1.x86_64.rpm 27 MB/s | 1.5 MB 00:00 2020-04-02T23:14:57.882 INFO:teuthology.orchestra.run.smithi196.stdout:(2/2): kernel-4.18.0-147.el8.x86_64.rpm 23 MB/s | 1.5 MB 00:00 2020-04-02T23:14:57.899 INFO:teuthology.orchestra.run.smithi196.stdout:-------------------------------------------------------------------------------- 2020-04-02T23:14:57.899 INFO:teuthology.orchestra.run.smithi196.stdout:Total 45 MB/s | 3.1 MB 00:00 2020-04-02T23:14:57.908 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction check 2020-04-02T23:14:58.092 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction check succeeded. 2020-04-02T23:14:58.092 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction test 2020-04-02T23:14:58.159 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction test succeeded. 2020-04-02T23:14:58.160 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction 2020-04-02T23:14:58.299 INFO:teuthology.orchestra.run.smithi196.stdout: Preparing : 1/1 2020-04-02T23:14:58.464 INFO:teuthology.orchestra.run.smithi196.stdout: Reinstalling : kernel-4.18.0-147.el8.x86_64 1/4 2020-04-02T23:14:58.603 INFO:teuthology.orchestra.run.smithi196.stdout: Reinstalling : kernel-4.18.0-147.5.1.el8_1.x86_64 2/4 2020-04-02T23:14:58.604 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : kernel-4.18.0-147.el8.x86_64 3/4 2020-04-02T23:14:58.696 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: kernel-4.18.0-147.el8.x86_64 3/4 2020-04-02T23:14:58.696 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : kernel-4.18.0-147.5.1.el8_1.x86_64 4/4 2020-04-02T23:14:58.930 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: kernel-4.18.0-147.5.1.el8_1.x86_64 4/4 2020-04-02T23:14:58.930 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : kernel-4.18.0-147.5.1.el8_1.x86_64 1/4 2020-04-02T23:14:58.930 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : kernel-4.18.0-147.5.1.el8_1.x86_64 2/4 2020-04-02T23:14:58.931 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : kernel-4.18.0-147.el8.x86_64 3/4 2020-04-02T23:14:59.341 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : kernel-4.18.0-147.el8.x86_64 4/4 2020-04-02T23:14:59.341 INFO:teuthology.orchestra.run.smithi196.stdout: 2020-04-02T23:14:59.341 INFO:teuthology.orchestra.run.smithi196.stdout:Reinstalled: 2020-04-02T23:14:59.341 INFO:teuthology.orchestra.run.smithi196.stdout: kernel-4.18.0-147.5.1.el8_1.x86_64 kernel-4.18.0-147.el8.x86_64 2020-04-02T23:14:59.341 INFO:teuthology.orchestra.run.smithi196.stdout: 2020-04-02T23:14:59.341 INFO:teuthology.orchestra.run.smithi196.stdout:Complete! 2020-04-02T23:14:59.453 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:14:59.506 INFO:teuthology.orchestra.run.smithi196:> rpm -q kernel --last | head -n 1 2020-04-02T23:14:59.607 INFO:teuthology.orchestra.run.smithi196.stdout:kernel-4.18.0-147.el8.x86_64 Thu 02 Apr 2020 11:14:58 PM UTC 2020-04-02T23:14:59.609 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-147.el8.x86_64 2020-04-02T23:14:59.609 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-147.5.1.el8_1.x86_64 Expected: 4.18.0-147.el8.x86_64 2020-04-02T23:14:59.609 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2020-04-02T23:14:59.609 DEBUG:teuthology.task.kernel:src is distro, skipping download 2020-04-02T23:14:59.610 DEBUG:teuthology.task.kernel:src is distro, skipping download 2020-04-02T23:14:59.610 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2020-04-02T23:14:59.610 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi174.front.sepia.ceph.com, path=None, version=distro) 2020-04-02T23:14:59.610 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:14:59.627 INFO:teuthology.orchestra.run.smithi174:> rpm -q kernel --last | head -n 1 2020-04-02T23:14:59.715 INFO:teuthology.orchestra.run.smithi174.stdout:kernel-4.18.0-147.el8.x86_64 Thu 02 Apr 2020 11:14:47 PM UTC 2020-04-02T23:14:59.716 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-147.el8.x86_64 2020-04-02T23:14:59.716 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:14:59.730 INFO:teuthology.orchestra.run.smithi174:> sudo rpm -qi grub2-tools 2020-04-02T23:14:59.804 INFO:teuthology.orchestra.run.smithi174.stdout:Name : grub2-tools 2020-04-02T23:14:59.805 INFO:teuthology.orchestra.run.smithi174.stdout:Epoch : 1 2020-04-02T23:14:59.805 INFO:teuthology.orchestra.run.smithi174.stdout:Version : 2.02 2020-04-02T23:14:59.805 INFO:teuthology.orchestra.run.smithi174.stdout:Release : 78.el8 2020-04-02T23:14:59.805 INFO:teuthology.orchestra.run.smithi174.stdout:Architecture: x86_64 2020-04-02T23:14:59.805 INFO:teuthology.orchestra.run.smithi174.stdout:Install Date: Mon 30 Mar 2020 07:18:38 PM UTC 2020-04-02T23:14:59.805 INFO:teuthology.orchestra.run.smithi174.stdout:Group : System Environment/Base 2020-04-02T23:14:59.806 INFO:teuthology.orchestra.run.smithi174.stdout:Size : 9192691 2020-04-02T23:14:59.806 INFO:teuthology.orchestra.run.smithi174.stdout:License : GPLv3+ 2020-04-02T23:14:59.806 INFO:teuthology.orchestra.run.smithi174.stdout:Signature : RSA/SHA256, Wed 04 Dec 2019 11:50:58 PM UTC, Key ID 05b555b38483c65d 2020-04-02T23:14:59.806 INFO:teuthology.orchestra.run.smithi174.stdout:Source RPM : grub2-2.02-78.el8.src.rpm 2020-04-02T23:14:59.806 INFO:teuthology.orchestra.run.smithi174.stdout:Build Date : Mon 25 Nov 2019 04:08:30 PM UTC 2020-04-02T23:14:59.806 INFO:teuthology.orchestra.run.smithi174.stdout:Build Host : kbuilder.bsys.centos.org 2020-04-02T23:14:59.807 INFO:teuthology.orchestra.run.smithi174.stdout:Relocations : (not relocatable) 2020-04-02T23:14:59.807 INFO:teuthology.orchestra.run.smithi174.stdout:Packager : CentOS BuildSystem 2020-04-02T23:14:59.807 INFO:teuthology.orchestra.run.smithi174.stdout:Vendor : CentOS 2020-04-02T23:14:59.807 INFO:teuthology.orchestra.run.smithi174.stdout:URL : http://www.gnu.org/software/grub/ 2020-04-02T23:14:59.807 INFO:teuthology.orchestra.run.smithi174.stdout:Summary : Support tools for GRUB. 2020-04-02T23:14:59.807 INFO:teuthology.orchestra.run.smithi174.stdout:Description : 2020-04-02T23:14:59.808 INFO:teuthology.orchestra.run.smithi174.stdout: 2020-04-02T23:14:59.808 INFO:teuthology.orchestra.run.smithi174.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2020-04-02T23:14:59.808 INFO:teuthology.orchestra.run.smithi174.stdout:customizable bootloader with modular architecture. It supports a rich 2020-04-02T23:14:59.808 INFO:teuthology.orchestra.run.smithi174.stdout:variety of kernel formats, file systems, computer architectures and 2020-04-02T23:14:59.808 INFO:teuthology.orchestra.run.smithi174.stdout:hardware devices. 2020-04-02T23:14:59.808 INFO:teuthology.orchestra.run.smithi174.stdout: 2020-04-02T23:14:59.809 INFO:teuthology.orchestra.run.smithi174.stdout:This subpackage provides tools for support of all platforms. 2020-04-02T23:14:59.810 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2020-04-02T23:14:59.810 INFO:teuthology.task.kernel:Updating grub on smithi174 to boot 4.18.0-147.el8.x86_64 2020-04-02T23:14:59.811 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:14:59.863 INFO:teuthology.orchestra.run.smithi174:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2020-04-02T23:15:01.093 INFO:teuthology.orchestra.run.smithi174.stderr:Generating grub configuration file ... 2020-04-02T23:15:03.542 INFO:teuthology.orchestra.run.smithi174.stderr:done 2020-04-02T23:15:03.544 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:15:03.557 INFO:teuthology.orchestra.run.smithi174:> mktemp 2020-04-02T23:15:03.611 INFO:teuthology.orchestra.run.smithi174.stdout:/tmp/tmp.G05WX4paJ0 2020-04-02T23:15:03.611 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:15:03.663 INFO:teuthology.orchestra.run.smithi174:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.G05WX4paJ0 2020-04-02T23:15:03.737 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:15:03.791 INFO:teuthology.orchestra.run.smithi174:> sudo chmod 0666 /tmp/tmp.G05WX4paJ0 2020-04-02T23:15:03.948 DEBUG:teuthology.orchestra.remote:smithi174:/tmp/tmp.G05WX4paJ0 is 4KB 2020-04-02T23:15:03.996 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:15:04.009 INFO:teuthology.orchestra.run.smithi174:> rm -fr /tmp/tmp.G05WX4paJ0 2020-04-02T23:15:04.063 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:15:04.117 INFO:teuthology.orchestra.run.smithi174:> sudo /bin/ls /boot/loader/entries || true 2020-04-02T23:15:04.219 INFO:teuthology.orchestra.run.smithi174.stdout:ac76e1f739a34903a61708b8315bf038-0-rescue.conf 2020-04-02T23:15:04.219 INFO:teuthology.orchestra.run.smithi174.stdout:ac76e1f739a34903a61708b8315bf038-4.18.0-147.5.1.el8_1.x86_64.conf 2020-04-02T23:15:04.219 INFO:teuthology.orchestra.run.smithi174.stdout:ac76e1f739a34903a61708b8315bf038-4.18.0-147.el8.x86_64.conf 2020-04-02T23:15:04.220 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:15:04.233 INFO:teuthology.orchestra.run.smithi174:> sudo grub2-set-default ac76e1f739a34903a61708b8315bf038-4.18.0-147.el8.x86_64 2020-04-02T23:15:04.427 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:15:04.440 INFO:teuthology.orchestra.run.smithi174:> sudo shutdown -r now 2020-04-02T23:15:04.482 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2020-04-02T23:15:04.483 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi196.front.sepia.ceph.com, path=None, version=distro) 2020-04-02T23:15:04.483 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:15:04.499 INFO:teuthology.orchestra.run.smithi196:> rpm -q kernel --last | head -n 1 2020-04-02T23:15:04.586 INFO:teuthology.orchestra.run.smithi196.stdout:kernel-4.18.0-147.el8.x86_64 Thu 02 Apr 2020 11:14:58 PM UTC 2020-04-02T23:15:04.588 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-147.el8.x86_64 2020-04-02T23:15:04.588 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:15:04.603 INFO:teuthology.orchestra.run.smithi196:> sudo rpm -qi grub2-tools 2020-04-02T23:15:04.676 INFO:teuthology.orchestra.run.smithi196.stdout:Name : grub2-tools 2020-04-02T23:15:04.676 INFO:teuthology.orchestra.run.smithi196.stdout:Epoch : 1 2020-04-02T23:15:04.677 INFO:teuthology.orchestra.run.smithi196.stdout:Version : 2.02 2020-04-02T23:15:04.677 INFO:teuthology.orchestra.run.smithi196.stdout:Release : 78.el8 2020-04-02T23:15:04.677 INFO:teuthology.orchestra.run.smithi196.stdout:Architecture: x86_64 2020-04-02T23:15:04.677 INFO:teuthology.orchestra.run.smithi196.stdout:Install Date: Mon 30 Mar 2020 07:18:38 PM UTC 2020-04-02T23:15:04.677 INFO:teuthology.orchestra.run.smithi196.stdout:Group : System Environment/Base 2020-04-02T23:15:04.677 INFO:teuthology.orchestra.run.smithi196.stdout:Size : 9192691 2020-04-02T23:15:04.677 INFO:teuthology.orchestra.run.smithi196.stdout:License : GPLv3+ 2020-04-02T23:15:04.678 INFO:teuthology.orchestra.run.smithi196.stdout:Signature : RSA/SHA256, Wed 04 Dec 2019 11:50:58 PM UTC, Key ID 05b555b38483c65d 2020-04-02T23:15:04.678 INFO:teuthology.orchestra.run.smithi196.stdout:Source RPM : grub2-2.02-78.el8.src.rpm 2020-04-02T23:15:04.678 INFO:teuthology.orchestra.run.smithi196.stdout:Build Date : Mon 25 Nov 2019 04:08:30 PM UTC 2020-04-02T23:15:04.678 INFO:teuthology.orchestra.run.smithi196.stdout:Build Host : kbuilder.bsys.centos.org 2020-04-02T23:15:04.678 INFO:teuthology.orchestra.run.smithi196.stdout:Relocations : (not relocatable) 2020-04-02T23:15:04.678 INFO:teuthology.orchestra.run.smithi196.stdout:Packager : CentOS BuildSystem 2020-04-02T23:15:04.678 INFO:teuthology.orchestra.run.smithi196.stdout:Vendor : CentOS 2020-04-02T23:15:04.678 INFO:teuthology.orchestra.run.smithi196.stdout:URL : http://www.gnu.org/software/grub/ 2020-04-02T23:15:04.679 INFO:teuthology.orchestra.run.smithi196.stdout:Summary : Support tools for GRUB. 2020-04-02T23:15:04.679 INFO:teuthology.orchestra.run.smithi196.stdout:Description : 2020-04-02T23:15:04.679 INFO:teuthology.orchestra.run.smithi196.stdout: 2020-04-02T23:15:04.679 INFO:teuthology.orchestra.run.smithi196.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2020-04-02T23:15:04.679 INFO:teuthology.orchestra.run.smithi196.stdout:customizable bootloader with modular architecture. It supports a rich 2020-04-02T23:15:04.679 INFO:teuthology.orchestra.run.smithi196.stdout:variety of kernel formats, file systems, computer architectures and 2020-04-02T23:15:04.679 INFO:teuthology.orchestra.run.smithi196.stdout:hardware devices. 2020-04-02T23:15:04.679 INFO:teuthology.orchestra.run.smithi196.stdout: 2020-04-02T23:15:04.680 INFO:teuthology.orchestra.run.smithi196.stdout:This subpackage provides tools for support of all platforms. 2020-04-02T23:15:04.680 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2020-04-02T23:15:04.681 INFO:teuthology.task.kernel:Updating grub on smithi196 to boot 4.18.0-147.el8.x86_64 2020-04-02T23:15:04.681 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:15:04.735 INFO:teuthology.orchestra.run.smithi196:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2020-04-02T23:15:05.812 INFO:teuthology.orchestra.run.smithi196.stderr:Generating grub configuration file ... 2020-04-02T23:15:08.088 INFO:teuthology.orchestra.run.smithi196.stderr:done 2020-04-02T23:15:08.093 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:15:08.115 INFO:teuthology.orchestra.run.smithi196:> mktemp 2020-04-02T23:15:08.169 INFO:teuthology.orchestra.run.smithi196.stdout:/tmp/tmp.DfhrZUsZnt 2020-04-02T23:15:08.170 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:15:08.223 INFO:teuthology.orchestra.run.smithi196:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.DfhrZUsZnt 2020-04-02T23:15:08.297 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:15:08.353 INFO:teuthology.orchestra.run.smithi196:> sudo chmod 0666 /tmp/tmp.DfhrZUsZnt 2020-04-02T23:15:08.487 DEBUG:teuthology.orchestra.remote:smithi196:/tmp/tmp.DfhrZUsZnt is 4KB 2020-04-02T23:15:08.536 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:15:08.549 INFO:teuthology.orchestra.run.smithi196:> rm -fr /tmp/tmp.DfhrZUsZnt 2020-04-02T23:15:08.602 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:15:08.656 INFO:teuthology.orchestra.run.smithi196:> sudo /bin/ls /boot/loader/entries || true 2020-04-02T23:15:08.760 INFO:teuthology.orchestra.run.smithi196.stdout:ac76e1f739a34903a61708b8315bf038-0-rescue.conf 2020-04-02T23:15:08.760 INFO:teuthology.orchestra.run.smithi196.stdout:ac76e1f739a34903a61708b8315bf038-4.18.0-147.5.1.el8_1.x86_64.conf 2020-04-02T23:15:08.761 INFO:teuthology.orchestra.run.smithi196.stdout:ac76e1f739a34903a61708b8315bf038-4.18.0-147.el8.x86_64.conf 2020-04-02T23:15:08.761 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:15:08.774 INFO:teuthology.orchestra.run.smithi196:> sudo grub2-set-default ac76e1f739a34903a61708b8315bf038-4.18.0-147.el8.x86_64 2020-04-02T23:15:08.935 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:15:08.948 INFO:teuthology.orchestra.run.smithi196:> sudo shutdown -r now 2020-04-02T23:15:39.006 INFO:teuthology.misc:Re-opening connections... 2020-04-02T23:15:39.007 INFO:teuthology.misc:trying to connect to ubuntu@smithi196.front.sepia.ceph.com 2020-04-02T23:15:39.007 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-04-02T23:15:39.007 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi196.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:16:39.009 DEBUG:teuthology.orchestra.remote:timed out 2020-04-02T23:16:39.009 INFO:teuthology.misc:trying to connect to ubuntu@smithi174.front.sepia.ceph.com 2020-04-02T23:16:39.009 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-04-02T23:16:39.011 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi174.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:16:39.327 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:16:39.666 DEBUG:teuthology.misc:waited 60.659001112 2020-04-02T23:16:40.666 INFO:teuthology.misc:trying to connect to ubuntu@smithi196.front.sepia.ceph.com 2020-04-02T23:16:40.667 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-04-02T23:16:40.667 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi196.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:16:48.363 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:16:48.757 DEBUG:teuthology.misc:waited 69.750647068 2020-04-02T23:16:49.758 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2020-04-02T23:16:49.758 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.18.0-147.el8.x86_64"... 2020-04-02T23:16:49.759 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:16:49.779 INFO:teuthology.orchestra.run.smithi174:> uname -r 2020-04-02T23:16:49.834 INFO:teuthology.orchestra.run.smithi174.stdout:4.18.0-147.el8.x86_64 2020-04-02T23:16:49.834 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-147.el8.x86_64 vs 4.18.0-147.el8.x86_64 2020-04-02T23:16:49.834 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2020-04-02T23:16:49.834 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2020-04-02T23:16:49.835 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "4.18.0-147.el8.x86_64"... 2020-04-02T23:16:49.835 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:16:49.850 INFO:teuthology.orchestra.run.smithi196:> uname -r 2020-04-02T23:16:49.908 INFO:teuthology.orchestra.run.smithi196.stdout:4.18.0-147.el8.x86_64 2020-04-02T23:16:49.909 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-147.el8.x86_64 vs 4.18.0-147.el8.x86_64 2020-04-02T23:16:49.909 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2020-04-02T23:16:50.910 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2020-04-02T23:16:50.910 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:16:50.925 INFO:teuthology.orchestra.run.smithi174:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2020-04-02T23:16:51.075 INFO:teuthology.orchestra.run.smithi174.stdout:ttyS1 2020-04-02T23:16:51.087 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2020-04-02T23:16:51.087 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:16:51.100 INFO:teuthology.orchestra.run.smithi196:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2020-04-02T23:16:51.245 INFO:teuthology.orchestra.run.smithi196.stdout:ttyS1 2020-04-02T23:16:51.260 INFO:teuthology.run_tasks:Running task internal.base... 2020-04-02T23:16:51.267 INFO:teuthology.task.internal:Creating test directory... 2020-04-02T23:16:51.268 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:16:51.283 INFO:teuthology.orchestra.run.smithi174:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-04-02T23:16:51.326 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:16:51.354 INFO:teuthology.orchestra.run.smithi196:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-04-02T23:16:51.404 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2020-04-02T23:16:51.412 INFO:teuthology.run_tasks:Running task internal.archive... 2020-04-02T23:16:51.423 INFO:teuthology.task.internal:Creating archive directory... 2020-04-02T23:16:51.423 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:16:51.437 INFO:teuthology.orchestra.run.smithi174:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-04-02T23:16:51.479 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:16:51.495 INFO:teuthology.orchestra.run.smithi196:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-04-02T23:16:51.551 INFO:teuthology.run_tasks:Running task internal.coredump... 2020-04-02T23:16:51.558 INFO:teuthology.task.internal:Enabling coredump saving... 2020-04-02T23:16:51.559 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:16:51.572 INFO:teuthology.orchestra.run.smithi174:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-04-02T23:16:51.614 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:16:51.627 INFO:teuthology.orchestra.run.smithi196:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-04-02T23:16:51.653 INFO:teuthology.orchestra.run.smithi174.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-04-02T23:16:51.667 INFO:teuthology.orchestra.run.smithi174.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-04-02T23:16:51.711 INFO:teuthology.orchestra.run.smithi196.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-04-02T23:16:51.725 INFO:teuthology.orchestra.run.smithi196.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-04-02T23:16:51.727 INFO:teuthology.run_tasks:Running task internal.sudo... 2020-04-02T23:16:51.735 INFO:teuthology.task.internal:Configuring sudo... 2020-04-02T23:16:51.735 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:16:51.749 INFO:teuthology.orchestra.run.smithi174:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-04-02T23:16:51.796 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:16:51.809 INFO:teuthology.orchestra.run.smithi196:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-04-02T23:16:51.874 INFO:teuthology.run_tasks:Running task internal.syslog... 2020-04-02T23:16:51.885 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2020-04-02T23:16:51.886 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:16:51.899 INFO:teuthology.orchestra.run.smithi174:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-04-02T23:16:51.941 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:16:51.959 INFO:teuthology.orchestra.run.smithi196:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-04-02T23:16:52.010 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:16:52.060 INFO:teuthology.orchestra.run.smithi196:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-04-02T23:16:52.129 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:16:52.164 INFO:teuthology.orchestra.run.smithi196:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2020-04-02T23:16:52.231 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:16:52.282 INFO:teuthology.orchestra.run.smithi196:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-04-02T23:16:52.351 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:16:52.386 INFO:teuthology.orchestra.run.smithi196:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2020-04-02T23:16:52.451 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:16:52.502 INFO:teuthology.orchestra.run.smithi196:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2020-04-02T23:16:52.582 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:16:52.596 INFO:teuthology.orchestra.run.smithi174:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-04-02T23:16:52.670 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:16:52.707 INFO:teuthology.orchestra.run.smithi174:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2020-04-02T23:16:52.789 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:16:52.843 INFO:teuthology.orchestra.run.smithi174:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-04-02T23:16:52.914 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:16:52.953 INFO:teuthology.orchestra.run.smithi174:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2020-04-02T23:16:53.021 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:16:53.074 INFO:teuthology.orchestra.run.smithi174:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2020-04-02T23:16:53.158 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:16:53.211 INFO:teuthology.orchestra.run.smithi174:> sudo service rsyslog restart 2020-04-02T23:16:53.253 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:16:53.267 INFO:teuthology.orchestra.run.smithi196:> sudo service rsyslog restart 2020-04-02T23:16:53.327 INFO:teuthology.orchestra.run.smithi174.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2020-04-02T23:16:53.380 INFO:teuthology.orchestra.run.smithi196.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2020-04-02T23:16:53.586 INFO:teuthology.run_tasks:Running task internal.timer... 2020-04-02T23:16:53.594 INFO:teuthology.task.internal:Starting timer... 2020-04-02T23:16:53.594 INFO:teuthology.run_tasks:Running task pcp... 2020-04-02T23:16:53.628 INFO:teuthology.run_tasks:Running task selinux... 2020-04-02T23:16:53.640 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2020-04-02T23:16:53.640 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:16:53.655 INFO:teuthology.orchestra.run.smithi174:> sudo service auditd rotate 2020-04-02T23:16:53.769 INFO:teuthology.orchestra.run.smithi174.stdout:Rotating logs: [ OK ] 2020-04-02T23:16:53.771 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:16:53.785 INFO:teuthology.orchestra.run.smithi196:> sudo service auditd rotate 2020-04-02T23:16:53.937 INFO:teuthology.orchestra.run.smithi196.stdout:Rotating logs: [ OK ] 2020-04-02T23:16:53.939 DEBUG:teuthology.task.selinux:Getting current SELinux state 2020-04-02T23:16:53.939 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:16:53.953 INFO:teuthology.orchestra.run.smithi196:> /usr/sbin/getenforce 2020-04-02T23:16:54.226 INFO:teuthology.orchestra.run.smithi196.stdout:Permissive 2020-04-02T23:16:54.226 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:16:54.240 INFO:teuthology.orchestra.run.smithi174:> /usr/sbin/getenforce 2020-04-02T23:16:54.304 INFO:teuthology.orchestra.run.smithi174.stdout:Permissive 2020-04-02T23:16:54.305 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi174.front.sepia.ceph.com': u'permissive', 'ubuntu@smithi196.front.sepia.ceph.com': u'permissive'} 2020-04-02T23:16:54.305 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:16:54.320 INFO:teuthology.orchestra.run.smithi196:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|scontext=system_u:system_r:logrotate_t:s0\)' 2020-04-02T23:16:54.401 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-04-02T23:16:54.401 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:16:54.415 INFO:teuthology.orchestra.run.smithi174:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|scontext=system_u:system_r:logrotate_t:s0\)' 2020-04-02T23:16:54.482 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-04-02T23:16:54.483 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2020-04-02T23:16:54.483 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:16:54.496 INFO:teuthology.orchestra.run.smithi196:> sudo /usr/sbin/setenforce permissive 2020-04-02T23:16:54.565 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:16:54.578 INFO:teuthology.orchestra.run.smithi174:> sudo /usr/sbin/setenforce permissive 2020-04-02T23:16:54.652 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2020-04-02T23:16:54.671 DEBUG:teuthology.repo_utils:Setting repo remote to git://git.ceph.com/git/ceph-cm-ansible.git 2020-04-02T23:16:54.678 INFO:teuthology.repo_utils:Fetching master from origin 2020-04-02T23:16:54.724 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to branch origin/master 2020-04-02T23:16:54.738 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2020-04-02T23:16:54.744 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi196.front.sepia.ceph.com,smithi174.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2020-04-02T23:16:55.071 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2020-04-02T23:16:56.161 INFO:teuthology.task.ansible.out: [WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2020-04-02T23:16:59.118 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2020-04-02T23:16:59.139 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:16:59 +0000 (0:00:00.060) 0:00:00.060 ******** 2020-04-02T23:16:59.151 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:16:59 +0000 (0:00:00.011) 0:00:00.072 ******** 2020-04-02T23:17:01.650 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi174.front.sepia.ceph.com] 2020-04-02T23:17:01.732 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:01 +0000 (0:00:02.580) 0:00:02.653 ******** 2020-04-02T23:17:02.040 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2020-04-02T23:17:02.041 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-04-02T23:17:02.079 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:02 +0000 (0:00:00.347) 0:00:03.000 ******** 2020-04-02T23:17:02.648 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2020-04-02T23:17:02.649 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-04-02T23:17:02.687 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:02 +0000 (0:00:00.607) 0:00:03.608 ******** 2020-04-02T23:17:02.707 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi196.front.sepia.ceph.com] 2020-04-02T23:17:02.715 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2020-04-02T23:17:02.716 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:02.753 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:02 +0000 (0:00:00.065) 0:00:03.674 ******** 2020-04-02T23:17:02.833 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:02 +0000 (0:00:00.080) 0:00:03.754 ******** 2020-04-02T23:17:03.034 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2020-04-02T23:17:03.036 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-04-02T23:17:03.084 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:03 +0000 (0:00:00.250) 0:00:04.005 ******** 2020-04-02T23:17:03.088 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2020-04-02T23:17:03.088 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-04-02T23:17:03.143 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:03 +0000 (0:00:00.059) 0:00:04.064 ******** 2020-04-02T23:17:03.330 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2020-04-02T23:17:03.331 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-04-02T23:17:03.370 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:03 +0000 (0:00:00.226) 0:00:04.291 ******** 2020-04-02T23:17:03.396 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2020-04-02T23:17:03.398 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:03.433 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:03 +0000 (0:00:00.062) 0:00:04.354 ******** 2020-04-02T23:17:03.623 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2020-04-02T23:17:03.624 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-04-02T23:17:03.664 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:03 +0000 (0:00:00.231) 0:00:04.585 ******** 2020-04-02T23:17:04.095 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2020-04-02T23:17:04.095 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1585869423.16-237844673857560/source", "state": "file", "uid": 0} 2020-04-02T23:17:04.131 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:04 +0000 (0:00:00.467) 0:00:05.052 ******** 2020-04-02T23:17:04.245 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1585869423.68-195281505321538/source", "state": "file", "uid": 0} 2020-04-02T23:17:04.284 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:04 +0000 (0:00:00.152) 0:00:05.204 ******** 2020-04-02T23:17:04.685 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2020-04-02T23:17:04.686 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2020-04-02T23:17:04.688 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-04-02T23:17:04.724 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlC 2020-04-02T23:17:04.725 INFO:teuthology.task.ansible.out:yoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, 2020-04-02T23:17:04.727 INFO:teuthology.task.ansible.out:"state": "present", "user": "cm", "validate_certs": true} 2020-04-02T23:17:04.848 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2020-04-02T23:17:04.855 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2020-04-02T23:17:05.050 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:05 +0000 (0:00:00.767) 0:00:05.971 ******** 2020-04-02T23:17:05.083 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:05 +0000 (0:00:00.032) 0:00:06.004 ******** 2020-04-02T23:17:05.698 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2020-04-02T23:17:05.699 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] 2020-04-02T23:17:05.745 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] 2020-04-02T23:17:05.789 INFO:teuthology.task.ansible.out: [WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2020-04-02T23:17:05.790 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:05 +0000 (0:00:00.706) 0:00:06.710 ******** 2020-04-02T23:17:05.859 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:05 +0000 (0:00:00.069) 0:00:06.780 ******** 2020-04-02T23:17:06.418 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2020-04-02T23:17:06.419 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.238502", "end": "2020-04-02 23:17:06.394089", "rc": 0, "start": "2020-04-02 23:17:06.155587", "stderr": "", "stderr_lines": [], "stdout": "02eae6d5814ccf641ed00343442d83bf2a286582", "stdout_lines": ["02eae6d5814ccf641ed00343442d83bf2a286582"]} changed: [smithi174.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.234523", "end": "2020-04-02 23:17:06.397905", "rc": 0, "start": "2020-04-02 23:17:06.163382", "stderr": "", "stderr_lines": [], "stdout": "02eae6d5814ccf641ed00343442d83bf2a286582", "stdout_lines": ["02eae6d5814ccf641ed00343442d83bf2a286582"]} 2020-04-02T23:17:06.455 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:06 +0000 (0:00:00.596) 0:00:07.376 ******** 2020-04-02T23:17:06.485 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:06 +0000 (0:00:00.029) 0:00:07.406 ******** 2020-04-02T23:17:06.674 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2020-04-02T23:17:06.674 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.022902", "end": "2020-04-02 23:17:06.651885", "failed_when_result": false, "rc": 0, "start": "2020-04-02 23:17:06.628983", "stderr": "", "stderr_lines": [], "stdout": "02eae6d5814ccf641ed00343442d83bf2a286582", "stdout_lines": ["02eae6d5814ccf641ed00343442d83bf2a286582"]} 2020-04-02T23:17:06.710 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:06 +0000 (0:00:00.225) 0:00:07.631 ******** 2020-04-02T23:17:06.716 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.012057", "end": "2020-04-02 23:17:06.664944", "failed_when_result": false, "rc": 0, "start": "2020-04-02 23:17:06.652887", "stderr": "", "stderr_lines": [], "stdout": "02eae6d5814ccf641ed00343442d83bf2a286582", "stdout_lines": ["02eae6d5814ccf641ed00343442d83bf2a286582"]} 2020-04-02T23:17:06.752 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:06 +0000 (0:00:00.041) 0:00:07.673 ******** 2020-04-02T23:17:06.757 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2020-04-02T23:17:06.757 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"ansible_facts": {"perform_users_role": false}, "changed": false} 2020-04-02T23:17:06.794 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:06 +0000 (0:00:00.042) 0:00:07.715 ******** 2020-04-02T23:17:06.801 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"ansible_facts": {"perform_users_role": false}, "changed": false} 2020-04-02T23:17:06.838 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:06 +0000 (0:00:00.044) 0:00:07.759 ******** 2020-04-02T23:17:06.843 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2020-04-02T23:17:06.844 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:06.882 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:06 +0000 (0:00:00.044) 0:00:07.803 ******** 2020-04-02T23:17:06.888 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:06.926 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:06 +0000 (0:00:00.043) 0:00:07.847 ******** 2020-04-02T23:17:06.931 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2020-04-02T23:17:06.931 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:06.969 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:06 +0000 (0:00:00.042) 0:00:07.890 ******** 2020-04-02T23:17:06.973 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.010 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:07 +0000 (0:00:00.041) 0:00:07.931 ******** 2020-04-02T23:17:07.017 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2020-04-02T23:17:07.019 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.055 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:07 +0000 (0:00:00.044) 0:00:07.976 ******** 2020-04-02T23:17:07.061 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.099 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:07 +0000 (0:00:00.043) 0:00:08.020 ******** 2020-04-02T23:17:07.103 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2020-04-02T23:17:07.104 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.140 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:07 +0000 (0:00:00.041) 0:00:08.061 ******** 2020-04-02T23:17:07.144 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.181 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:07 +0000 (0:00:00.041) 0:00:08.102 ******** 2020-04-02T23:17:07.185 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2020-04-02T23:17:07.186 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.222 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:07 +0000 (0:00:00.040) 0:00:08.143 ******** 2020-04-02T23:17:07.226 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.265 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:07 +0000 (0:00:00.042) 0:00:08.186 ******** 2020-04-02T23:17:07.280 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-04-02T23:17:07.281 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.282 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.283 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.293 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.294 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.305 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.316 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.318 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9', u'name': u'jcaratzas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.318 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.320 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.330 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.332 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgR 2020-04-02T23:17:07.333 INFO:teuthology.task.ansible.out:HblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.342 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.343 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.344 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.346 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.355 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.356 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9', u'name': u'jcaratzas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.357 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.367 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.368 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.380 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.380 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.382 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sV 2020-04-02T23:17:07.383 INFO:teuthology.task.ansible.out:gRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed', u'name': u'cmeno'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional re 2020-04-02T23:17:07.384 INFO:teuthology.task.ansible.out:sult was False"} 2020-04-02T23:17:07.394 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.394 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.396 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.406 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.406 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.408 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.408 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654 2020-04-02T23:17:07.409 INFO:teuthology.task.ansible.out:\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.419 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.419 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.421 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.422 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.432 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed', u'name': u'cmeno'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.433 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.434 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.448 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.449 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.450 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.451 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.462 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.463 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.464 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.475 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.476 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.477 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.477 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.488 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.489 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.491 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.505 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.514 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.514 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.516 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.526 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.527 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.528 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.530 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.540 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.540 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.541 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.552 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.553 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.555 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.556 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.566 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.566 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.568 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.578 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.579 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.580 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.581 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.592 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.592 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.594 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.605 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.606 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.608 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.608 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.619 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.619 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.621 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.631 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.632 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.633 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.644 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.644 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.645 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.656 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.657 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.658 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.669 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.670 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.671 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.685 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.686 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.688 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.688 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.689 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.699 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.701 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.702 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.704 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.713 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.714 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.715 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.717 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.733 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.740 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.741 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.742 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.743 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.767 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.768 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.769 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.770 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.771 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.771 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.773 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.774 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.785 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.786 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.787 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.798 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.798 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.800 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.801 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.801 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.813 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.813 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.815 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.829 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.838 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.839 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.840 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.851 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.851 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.852 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.864 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.864 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.866 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.876 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.877 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.878 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.878 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.880 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.890 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.890 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.892 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.903 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.903 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.905 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.915 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.916 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.917 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.918 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.929 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.930 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.931 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.942 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'xiubli@fedora1 vosB15bA3uALkBrmjcKFUg 4ef5cb132c30563fd5fb9e4e9352786ad0d2258e41ed63f91c1f65f69b54d50d', u'name': u'xiubli'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "xiubli@fedora1 vosB15bA3uALkBrmjcKFUg 4ef5cb132c30563fd5fb9e4e9352786ad0d2258e41ed63f91c1f65f69b54d50d"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.942 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.944 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f', u'name': u'jafaj'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.944 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef', u'name': u'jschmid'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.945 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.956 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518', u'name': u'kachau'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.956 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.958 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034', u'name': u'khiremat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.968 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'kapandya@thinkpad Uw1JHj0kPIqSd9iOJ68TNg 46badc3b5cd150bfb74daf4300c8329491000521738ba70455631aa4a47e42c0', u'name': u'kapandya'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad Uw1JHj0kPIqSd9iOJ68TNg 46badc3b5cd150bfb74daf4300c8329491000521738ba70455631aa4a47e42c0"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.987 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.988 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'xiubli@fedora1 vosB15bA3uALkBrmjcKFUg 4ef5cb132c30563fd5fb9e4e9352786ad0d2258e41ed63f91c1f65f69b54d50d', u'name': u'xiubli'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "xiubli@fedora1 vosB15bA3uALkBrmjcKFUg 4ef5cb132c30563fd5fb9e4e9352786ad0d2258e41ed63f91c1f65f69b54d50d"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.989 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f', u'name': u'jafaj'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef', u'name': u'jschmid'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:07.990 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518', u'name': u'kachau'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:08.027 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:08 +0000 (0:00:00.762) 0:00:08.948 ******** 2020-04-02T23:17:08.033 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034', u'name': u'khiremat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:08.034 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'ovpn': u'kapandya@thinkpad Uw1JHj0kPIqSd9iOJ68TNg 46badc3b5cd150bfb74daf4300c8329491000521738ba70455631aa4a47e42c0', u'name': u'kapandya'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad Uw1JHj0kPIqSd9iOJ68TNg 46badc3b5cd150bfb74daf4300c8329491000521738ba70455631aa4a47e42c0"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:08.053 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2020-04-02T23:17:08.092 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:08 +0000 (0:00:00.065) 0:00:09.013 ******** 2020-04-02T23:17:08.126 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:08 +0000 (0:00:00.034) 0:00:09.047 ******** 2020-04-02T23:17:08.131 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2020-04-02T23:17:08.134 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:08.176 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:08 +0000 (0:00:00.050) 0:00:09.098 ******** 2020-04-02T23:17:08.181 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2020-04-02T23:17:08.219 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:08 +0000 (0:00:00.042) 0:00:09.140 ******** 2020-04-02T23:17:08.224 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2020-04-02T23:17:08.225 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:08.262 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:08 +0000 (0:00:00.042) 0:00:09.183 ******** 2020-04-02T23:17:08.269 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2020-04-02T23:17:08.270 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:08.310 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:08 +0000 (0:00:00.048) 0:00:09.231 ******** 2020-04-02T23:17:08.316 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-04-02T23:17:08.316 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:08.355 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:08 +0000 (0:00:00.044) 0:00:09.276 ******** 2020-04-02T23:17:08.360 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2020-04-02T23:17:08.361 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:08.398 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:08 +0000 (0:00:00.043) 0:00:09.319 ******** 2020-04-02T23:17:08.403 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-04-02T23:17:08.403 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:08.441 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:08 +0000 (0:00:00.042) 0:00:09.362 ******** 2020-04-02T23:17:08.446 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-04-02T23:17:08.447 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:08.486 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:08 +0000 (0:00:00.045) 0:00:09.407 ******** 2020-04-02T23:17:08.491 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2020-04-02T23:17:08.493 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:08.529 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:08 +0000 (0:00:00.042) 0:00:09.450 ******** 2020-04-02T23:17:08.533 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-04-02T23:17:08.535 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:08.578 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:08 +0000 (0:00:00.049) 0:00:09.499 ******** 2020-04-02T23:17:08.589 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi174.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "skip_reason": "Conditional result was False"} 2020-04-02T23:17:08.599 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "skip_reason": "Conditional result was False"} 2020-04-02T23:17:08.599 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:08.600 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi174.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "skip_reason": "Conditional result was False"} 2020-04-02T23:17:08.636 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:08 +0000 (0:00:00.058) 0:00:09.557 ******** 2020-04-02T23:17:08.647 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "skip_reason": "Conditional result was False"} 2020-04-02T23:17:08.649 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "skip_reason": "Conditional result was False"} 2020-04-02T23:17:08.649 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "skip_reason": "Conditional result was False"} 2020-04-02T23:17:08.650 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "skip_reason": "Conditional result was False"} 2020-04-02T23:17:08.650 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "skip_reason": "Conditional result was False"} 2020-04-02T23:17:08.652 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "skip_reason": "Conditional result was False"} 2020-04-02T23:17:08.662 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "skip_reason": "Conditional result was False"} 2020-04-02T23:17:08.662 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "skip_reason": "Conditional result was False"} 2020-04-02T23:17:08.673 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "skip_reason": "Conditional result was False"} 2020-04-02T23:17:08.674 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "skip_reason": "Conditional result was False"} 2020-04-02T23:17:08.675 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "skip_reason": "Conditional result was False"} 2020-04-02T23:17:08.686 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "skip_reason": "Conditional result was False"} 2020-04-02T23:17:08.686 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "skip_reason": "Conditional result was False"} 2020-04-02T23:17:08.688 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "skip_reason": "Conditional result was False"} 2020-04-02T23:17:08.698 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "skip_reason": "Conditional result was False"} 2020-04-02T23:17:08.699 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "skip_reason": "Conditional result was False"} 2020-04-02T23:17:08.700 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "skip_reason": "Conditional result was False"} 2020-04-02T23:17:08.700 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "skip_reason": "Conditional result was False"} 2020-04-02T23:17:08.702 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "skip_reason": "Conditional result was False"} 2020-04-02T23:17:08.711 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "skip_reason": "Conditional result was False"} 2020-04-02T23:17:08.722 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "skip_reason": "Conditional result was False"} 2020-04-02T23:17:08.723 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "skip_reason": "Conditional result was False"} 2020-04-02T23:17:08.725 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "skip_reason": "Conditional result was False"} 2020-04-02T23:17:08.726 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "skip_reason": "Conditional result was False"} 2020-04-02T23:17:08.736 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "skip_reason": "Conditional result was False"} 2020-04-02T23:17:08.737 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "skip_reason": "Conditional result was False"} 2020-04-02T23:17:08.738 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "skip_reason": "Conditional result was False"} 2020-04-02T23:17:08.749 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "skip_reason": "Conditional result was False"} 2020-04-02T23:17:08.749 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "skip_reason": "Conditional result was False"} 2020-04-02T23:17:08.751 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "skip_reason": "Conditional result was False"} 2020-04-02T23:17:08.761 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "skip_reason": "Conditional result was False"} 2020-04-02T23:17:08.762 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "skip_reason": "Conditional result was False"} 2020-04-02T23:17:08.763 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "skip_reason": "Conditional result was False"} 2020-04-02T23:17:08.774 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "skip_reason": "Conditional result was False"} 2020-04-02T23:17:08.775 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "skip_reason": "Conditional result was False"} 2020-04-02T23:17:08.795 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "skip_reason": "Conditional result was False"} 2020-04-02T23:17:08.795 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "skip_reason": "Conditional result was False"} 2020-04-02T23:17:08.796 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "skip_reason": "Conditional result was False"} 2020-04-02T23:17:08.798 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "skip_reason": "Conditional result was False"} 2020-04-02T23:17:08.799 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "skip_reason": "Conditional result was False"} 2020-04-02T23:17:08.810 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "skip_reason": "Conditional result was False"} 2020-04-02T23:17:08.816 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "skip_reason": "Conditional result was False"} 2020-04-02T23:17:08.872 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:08 +0000 (0:00:00.235) 0:00:09.793 ******** 2020-04-02T23:17:08.881 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "skip_reason": "Conditional result was False"} 2020-04-02T23:17:08.883 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "skip_reason": "Conditional result was False"} 2020-04-02T23:17:08.884 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "skip_reason": "Conditional result was False"} 2020-04-02T23:17:08.886 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "skip_reason": "Conditional result was False"} 2020-04-02T23:17:08.887 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "skip_reason": "Conditional result was False"} 2020-04-02T23:17:08.889 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "skip_reason": "Conditional result was False"} 2020-04-02T23:17:08.889 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "skip_reason": "Conditional result was False"} 2020-04-02T23:17:08.890 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "skip_reason": "Conditional result was False"} 2020-04-02T23:17:08.942 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:08 +0000 (0:00:00.070) 0:00:09.863 ******** 2020-04-02T23:17:09.612 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2020-04-02T23:17:09.613 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "checksum": "1292e3b894a02d49ff85362f40c4ffb36408b41f", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/keys-repo-sha1", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "state": "file", "uid": 0} 2020-04-02T23:17:09.614 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "checksum": "1292e3b894a02d49ff85362f40c4ffb36408b41f", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/keys-repo-sha1", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "state": "file", "uid": 0} 2020-04-02T23:17:09.651 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:09 +0000 (0:00:00.708) 0:00:10.572 ******** 2020-04-02T23:17:09.687 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:09 +0000 (0:00:00.035) 0:00:10.608 ******** 2020-04-02T23:17:09.690 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2020-04-02T23:17:09.691 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => { "msg": "Host smithi174.front.sepia.ceph.com is running CentOS 8.1 (Core)" } 2020-04-02T23:17:09.731 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:09 +0000 (0:00:00.043) 0:00:10.652 ******** 2020-04-02T23:17:09.750 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => { "msg": "Host smithi196.front.sepia.ceph.com is running CentOS 8.1 (Core)" } 2020-04-02T23:17:09.783 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:09 +0000 (0:00:00.051) 0:00:10.704 ******** 2020-04-02T23:17:09.788 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2020-04-02T23:17:09.789 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml) => {"ansible_facts": {"nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"} 2020-04-02T23:17:09.832 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:09 +0000 (0:00:00.048) 0:00:10.753 ******** 2020-04-02T23:17:09.836 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml) => {"ansible_facts": {"nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"} 2020-04-02T23:17:09.875 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:09 +0000 (0:00:00.043) 0:00:10.796 ******** 2020-04-02T23:17:09.880 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2020-04-02T23:17:09.882 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:09.920 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:09 +0000 (0:00:00.044) 0:00:10.841 ******** 2020-04-02T23:17:09.925 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:09.962 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:09 +0000 (0:00:00.042) 0:00:10.883 ******** 2020-04-02T23:17:10.185 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2020-04-02T23:17:10.186 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.069839", "end": "2020-04-02 23:17:10.160899", "rc": 0, "start": "2020-04-02 23:17:10.091060", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2020-04-02T23:17:10.221 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:10 +0000 (0:00:00.258) 0:00:11.142 ******** 2020-04-02T23:17:10.248 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.083646", "end": "2020-04-02 23:17:10.221660", "rc": 0, "start": "2020-04-02 23:17:10.138014", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2020-04-02T23:17:10.249 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:10.284 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:10 +0000 (0:00:00.063) 0:00:11.205 ******** 2020-04-02T23:17:10.322 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:10 +0000 (0:00:00.037) 0:00:11.243 ******** 2020-04-02T23:17:10.328 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2020-04-02T23:17:10.330 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:10.367 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:10 +0000 (0:00:00.044) 0:00:11.288 ******** 2020-04-02T23:17:10.372 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2020-04-02T23:17:10.373 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:10.410 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:10 +0000 (0:00:00.042) 0:00:11.331 ******** 2020-04-02T23:17:10.417 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2020-04-02T23:17:10.419 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:10.455 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:10 +0000 (0:00:00.045) 0:00:11.376 ******** 2020-04-02T23:17:10.461 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2020-04-02T23:17:10.462 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:10.500 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:10 +0000 (0:00:00.044) 0:00:11.421 ******** 2020-04-02T23:17:10.508 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:10.548 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:10 +0000 (0:00:00.047) 0:00:11.468 ******** 2020-04-02T23:17:10.553 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2020-04-02T23:17:10.553 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:10.591 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:10 +0000 (0:00:00.043) 0:00:11.512 ******** 2020-04-02T23:17:10.595 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2020-04-02T23:17:10.597 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:10.640 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:10 +0000 (0:00:00.049) 0:00:11.561 ******** 2020-04-02T23:17:10.648 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2020-04-02T23:17:10.648 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:10.684 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:10 +0000 (0:00:00.044) 0:00:11.605 ******** 2020-04-02T23:17:10.690 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2020-04-02T23:17:10.691 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:10.730 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:10 +0000 (0:00:00.045) 0:00:11.651 ******** 2020-04-02T23:17:10.736 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2020-04-02T23:17:10.736 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:10.779 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:10 +0000 (0:00:00.048) 0:00:11.700 ******** 2020-04-02T23:17:10.784 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2020-04-02T23:17:10.785 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-02T23:17:10.787 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-02T23:17:10.825 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:10 +0000 (0:00:00.046) 0:00:11.746 ******** 2020-04-02T23:17:10.830 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2020-04-02T23:17:10.830 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:10.868 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:10 +0000 (0:00:00.043) 0:00:11.789 ******** 2020-04-02T23:17:10.873 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2020-04-02T23:17:10.876 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:10.916 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:10 +0000 (0:00:00.047) 0:00:11.837 ******** 2020-04-02T23:17:10.922 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2020-04-02T23:17:10.923 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-02T23:17:10.925 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-02T23:17:10.964 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:10 +0000 (0:00:00.048) 0:00:11.885 ******** 2020-04-02T23:17:10.969 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2020-04-02T23:17:10.970 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:11.009 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:11 +0000 (0:00:00.044) 0:00:11.930 ******** 2020-04-02T23:17:11.015 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2020-04-02T23:17:11.016 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:11.054 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:11 +0000 (0:00:00.044) 0:00:11.975 ******** 2020-04-02T23:17:11.059 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2020-04-02T23:17:11.059 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-02T23:17:11.099 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:11 +0000 (0:00:00.044) 0:00:12.020 ******** 2020-04-02T23:17:11.106 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2020-04-02T23:17:11.107 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:11.145 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:11 +0000 (0:00:00.046) 0:00:12.066 ******** 2020-04-02T23:17:11.150 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2020-04-02T23:17:11.151 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:11.190 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:11 +0000 (0:00:00.044) 0:00:12.111 ******** 2020-04-02T23:17:11.196 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2020-04-02T23:17:11.196 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-02T23:17:11.238 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:11 +0000 (0:00:00.046) 0:00:12.158 ******** 2020-04-02T23:17:11.242 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2020-04-02T23:17:11.242 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-02T23:17:11.279 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:11 +0000 (0:00:00.042) 0:00:12.200 ******** 2020-04-02T23:17:11.285 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2020-04-02T23:17:11.288 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:11.324 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:11 +0000 (0:00:00.044) 0:00:12.245 ******** 2020-04-02T23:17:11.331 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2020-04-02T23:17:11.332 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:11.367 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:11 +0000 (0:00:00.043) 0:00:12.288 ******** 2020-04-02T23:17:11.372 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2020-04-02T23:17:11.373 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-02T23:17:11.410 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:11 +0000 (0:00:00.042) 0:00:12.331 ******** 2020-04-02T23:17:11.414 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2020-04-02T23:17:11.414 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:11.452 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:11 +0000 (0:00:00.042) 0:00:12.373 ******** 2020-04-02T23:17:11.457 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2020-04-02T23:17:11.457 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:11.496 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:11 +0000 (0:00:00.044) 0:00:12.417 ******** 2020-04-02T23:17:11.501 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2020-04-02T23:17:11.502 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:11.542 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:11 +0000 (0:00:00.045) 0:00:12.463 ******** 2020-04-02T23:17:11.550 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2020-04-02T23:17:11.551 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:11.598 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:11 +0000 (0:00:00.056) 0:00:12.519 ******** 2020-04-02T23:17:11.603 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2020-04-02T23:17:11.605 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:11.641 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:11 +0000 (0:00:00.042) 0:00:12.562 ******** 2020-04-02T23:17:11.645 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2020-04-02T23:17:11.646 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:11.684 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:11 +0000 (0:00:00.043) 0:00:12.605 ******** 2020-04-02T23:17:11.689 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2020-04-02T23:17:11.690 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-02T23:17:11.730 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:11 +0000 (0:00:00.045) 0:00:12.651 ******** 2020-04-02T23:17:11.734 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2020-04-02T23:17:11.735 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:11.771 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:11 +0000 (0:00:00.041) 0:00:12.692 ******** 2020-04-02T23:17:11.775 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-04-02T23:17:11.777 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:11.813 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:11 +0000 (0:00:00.041) 0:00:12.734 ******** 2020-04-02T23:17:11.818 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2020-04-02T23:17:11.820 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-02T23:17:11.855 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:11 +0000 (0:00:00.042) 0:00:12.776 ******** 2020-04-02T23:17:11.860 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2020-04-02T23:17:11.861 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:11.903 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:11 +0000 (0:00:00.047) 0:00:12.824 ******** 2020-04-02T23:17:11.908 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-04-02T23:17:11.909 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:11.946 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:11 +0000 (0:00:00.043) 0:00:12.867 ******** 2020-04-02T23:17:11.951 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2020-04-02T23:17:11.952 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:11.988 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:11 +0000 (0:00:00.041) 0:00:12.909 ******** 2020-04-02T23:17:11.994 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2020-04-02T23:17:11.995 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:12.029 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:12 +0000 (0:00:00.041) 0:00:12.950 ******** 2020-04-02T23:17:12.033 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2020-04-02T23:17:12.033 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:12.069 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:12 +0000 (0:00:00.039) 0:00:12.990 ******** 2020-04-02T23:17:12.073 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2020-04-02T23:17:12.073 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:12.115 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:12 +0000 (0:00:00.046) 0:00:13.036 ******** 2020-04-02T23:17:12.121 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2020-04-02T23:17:12.122 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:12.161 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:12 +0000 (0:00:00.045) 0:00:13.082 ******** 2020-04-02T23:17:12.166 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2020-04-02T23:17:12.167 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:12.204 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:12 +0000 (0:00:00.043) 0:00:13.125 ******** 2020-04-02T23:17:12.315 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2020-04-02T23:17:12.409 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:12.442 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:12 +0000 (0:00:00.237) 0:00:13.363 ******** 2020-04-02T23:17:12.448 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2020-04-02T23:17:12.449 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:12.491 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:12 +0000 (0:00:00.049) 0:00:13.412 ******** 2020-04-02T23:17:12.495 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2020-04-02T23:17:12.496 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-02T23:17:12.533 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:12 +0000 (0:00:00.042) 0:00:13.454 ******** 2020-04-02T23:17:12.538 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2020-04-02T23:17:12.539 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:12.574 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:12 +0000 (0:00:00.040) 0:00:13.495 ******** 2020-04-02T23:17:12.577 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2020-04-02T23:17:12.614 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:12 +0000 (0:00:00.040) 0:00:13.535 ******** 2020-04-02T23:17:12.618 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2020-04-02T23:17:12.621 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-02T23:17:12.656 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:12 +0000 (0:00:00.041) 0:00:13.577 ******** 2020-04-02T23:17:12.660 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2020-04-02T23:17:12.661 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:12.697 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:12 +0000 (0:00:00.040) 0:00:13.618 ******** 2020-04-02T23:17:12.701 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2020-04-02T23:17:12.738 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:12 +0000 (0:00:00.041) 0:00:13.659 ******** 2020-04-02T23:17:12.764 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2020-04-02T23:17:12.765 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:12.799 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:12 +0000 (0:00:00.060) 0:00:13.720 ******** 2020-04-02T23:17:12.928 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2020-04-02T23:17:12.929 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-04-02T23:17:12.967 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:12 +0000 (0:00:00.167) 0:00:13.888 ******** 2020-04-02T23:17:13.025 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-04-02T23:17:13.063 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:13 +0000 (0:00:00.095) 0:00:13.984 ******** 2020-04-02T23:17:13.464 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2020-04-02T23:17:13.465 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'enabled': u'1', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2020-04-02T23:17:13.539 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'enabled': u'1', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2020-04-02T23:17:13.915 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'enabled': 0, u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2020-04-02T23:17:13.959 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:13 +0000 (0:00:00.892) 0:00:14.876 ******** 2020-04-02T23:17:13.993 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'enabled': 0, u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2020-04-02T23:17:14.035 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:14 +0000 (0:00:00.079) 0:00:14.956 ******** 2020-04-02T23:17:14.423 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2020-04-02T23:17:14.424 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2020-04-02T23:17:14.530 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2020-04-02T23:17:14.873 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2020-04-02T23:17:14.912 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:14 +0000 (0:00:00.877) 0:00:15.833 ******** 2020-04-02T23:17:14.949 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-04-02T23:17:14.949 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:15.001 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:14 +0000 (0:00:00.088) 0:00:15.922 ******** 2020-04-02T23:17:15.006 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2020-04-02T23:17:15.007 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2020-04-02T23:17:15.049 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:15 +0000 (0:00:00.048) 0:00:15.970 ******** 2020-04-02T23:17:15.055 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-04-02T23:17:15.056 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:15.094 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:15 +0000 (0:00:00.045) 0:00:16.015 ******** 2020-04-02T23:17:15.100 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-04-02T23:17:15.100 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:15.139 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:15 +0000 (0:00:00.044) 0:00:16.060 ******** 2020-04-02T23:17:15.145 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2020-04-02T23:17:15.146 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:15.184 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:15 +0000 (0:00:00.045) 0:00:16.105 ******** 2020-04-02T23:17:15.191 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-04-02T23:17:15.192 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:15.231 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:15 +0000 (0:00:00.046) 0:00:16.152 ******** 2020-04-02T23:17:15.235 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2020-04-02T23:17:15.237 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:15.273 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:15 +0000 (0:00:00.042) 0:00:16.194 ******** 2020-04-02T23:17:15.278 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2020-04-02T23:17:15.279 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:15.316 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:15 +0000 (0:00:00.042) 0:00:16.237 ******** 2020-04-02T23:17:15.321 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-04-02T23:17:15.321 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:15.360 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:15 +0000 (0:00:00.044) 0:00:16.281 ******** 2020-04-02T23:17:15.365 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2020-04-02T23:17:15.366 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:15.403 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:15 +0000 (0:00:00.043) 0:00:16.325 ******** 2020-04-02T23:17:15.408 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2020-04-02T23:17:15.408 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:15.446 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:15 +0000 (0:00:00.042) 0:00:16.367 ******** 2020-04-02T23:17:15.455 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-04-02T23:17:15.456 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:15.494 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:15 +0000 (0:00:00.047) 0:00:16.415 ******** 2020-04-02T23:17:15.500 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2020-04-02T23:17:15.501 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:15.539 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:15 +0000 (0:00:00.044) 0:00:16.460 ******** 2020-04-02T23:17:15.544 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2020-04-02T23:17:15.545 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:15.587 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:15 +0000 (0:00:00.048) 0:00:16.508 ******** 2020-04-02T23:17:15.592 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2020-04-02T23:17:15.592 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:15.631 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:15 +0000 (0:00:00.044) 0:00:16.552 ******** 2020-04-02T23:17:15.636 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2020-04-02T23:17:15.636 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:15.673 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:15 +0000 (0:00:00.041) 0:00:16.594 ******** 2020-04-02T23:17:15.680 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2020-04-02T23:17:15.681 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:15.715 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:15 +0000 (0:00:00.042) 0:00:16.636 ******** 2020-04-02T23:17:15.720 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2020-04-02T23:17:15.721 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:15.759 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:15 +0000 (0:00:00.043) 0:00:16.680 ******** 2020-04-02T23:17:15.784 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2020-04-02T23:17:15.784 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:15.824 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:15 +0000 (0:00:00.065) 0:00:16.745 ******** 2020-04-02T23:17:16.518 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2020-04-02T23:17:16.519 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.503080", "end": "2020-04-02 23:17:16.500315", "rc": 0, "start": "2020-04-02 23:17:15.997235", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:17:16.556 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:16 +0000 (0:00:00.731) 0:00:17.477 ******** 2020-04-02T23:17:16.561 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.616810", "end": "2020-04-02 23:17:16.500354", "rc": 0, "start": "2020-04-02 23:17:15.883544", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:17:16.599 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:16 +0000 (0:00:00.042) 0:00:17.520 ******** 2020-04-02T23:17:19.509 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2020-04-02T23:17:19.510 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: krb5-workstation"]} 2020-04-02T23:17:19.550 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:19 +0000 (0:00:02.950) 0:00:20.471 ******** 2020-04-02T23:17:19.577 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: krb5-workstation"]} 2020-04-02T23:17:19.578 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:19.615 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:19 +0000 (0:00:00.065) 0:00:20.536 ******** 2020-04-02T23:17:19.652 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:19 +0000 (0:00:00.036) 0:00:20.573 ******** 2020-04-02T23:17:19.658 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2020-04-02T23:17:19.658 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:19.697 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:19 +0000 (0:00:00.044) 0:00:20.617 ******** 2020-04-02T23:17:19.702 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2020-04-02T23:17:19.703 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:19.742 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:19 +0000 (0:00:00.045) 0:00:20.663 ******** 2020-04-02T23:17:19.750 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:19.787 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:19 +0000 (0:00:00.045) 0:00:20.708 ******** 2020-04-02T23:17:19.793 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2020-04-02T23:17:19.794 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:19.831 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:19 +0000 (0:00:00.043) 0:00:20.752 ******** 2020-04-02T23:17:19.835 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2020-04-02T23:17:19.836 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:19.875 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:19 +0000 (0:00:00.043) 0:00:20.796 ******** 2020-04-02T23:17:19.882 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2020-04-02T23:17:19.883 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:19.922 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:19 +0000 (0:00:00.047) 0:00:20.843 ******** 2020-04-02T23:17:19.959 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2020-04-02T23:17:19.960 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:19.997 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:19 +0000 (0:00:00.074) 0:00:20.918 ******** 2020-04-02T23:17:20.337 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2020-04-02T23:17:20.338 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2020-04-02T23:17:20.378 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:20 +0000 (0:00:00.381) 0:00:21.299 ******** 2020-04-02T23:17:20.460 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2020-04-02T23:17:20.499 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:20 +0000 (0:00:00.120) 0:00:21.420 ******** 2020-04-02T23:17:21.279 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: smartmontools"]} 2020-04-02T23:17:21.324 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:21 +0000 (0:00:00.825) 0:00:22.245 ******** 2020-04-02T23:17:21.397 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: smartmontools"]} 2020-04-02T23:17:21.437 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:21 +0000 (0:00:00.112) 0:00:22.358 ******** 2020-04-02T23:17:21.834 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-04-02T23:17:21.834 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2020-04-02T23:17:21.920 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2020-04-02T23:17:22.292 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2020-04-02T23:17:22.376 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2020-04-02T23:17:22.730 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2020-04-02T23:17:22.771 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:22 +0000 (0:00:01.333) 0:00:23.692 ******** 2020-04-02T23:17:22.831 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2020-04-02T23:17:22.871 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:22 +0000 (0:00:00.099) 0:00:23.792 ******** 2020-04-02T23:17:22.971 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2020-04-02T23:17:22.971 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-04-02T23:17:23.014 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:23 +0000 (0:00:00.143) 0:00:23.935 ******** 2020-04-02T23:17:23.062 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-04-02T23:17:23.104 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:23 +0000 (0:00:00.090) 0:00:24.025 ******** 2020-04-02T23:17:23.475 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-04-02T23:17:23.476 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2020-04-02T23:17:23.587 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2020-04-02T23:17:23.900 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2020-04-02T23:17:24.027 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2020-04-02T23:17:24.339 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2020-04-02T23:17:24.385 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:24 +0000 (0:00:01.280) 0:00:25.306 ******** 2020-04-02T23:17:24.413 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2020-04-02T23:17:24.415 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:24.458 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:24 +0000 (0:00:00.073) 0:00:25.379 ******** 2020-04-02T23:17:24.464 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-04-02T23:17:24.465 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2020-04-02T23:17:24.508 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:24 +0000 (0:00:00.049) 0:00:25.429 ******** 2020-04-02T23:17:24.513 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2020-04-02T23:17:24.514 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2020-04-02T23:17:24.514 INFO:teuthology.task.ansible.out: 2020-04-02T23:17:24.553 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:24 +0000 (0:00:00.044) 0:00:25.474 ******** 2020-04-02T23:17:24.558 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2020-04-02T23:17:24.560 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:24.604 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:24 +0000 (0:00:00.051) 0:00:25.525 ******** 2020-04-02T23:17:24.640 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2020-04-02T23:17:24.642 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2020-04-02T23:17:24.679 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:24 +0000 (0:00:00.075) 0:00:25.600 ******** 2020-04-02T23:17:24.874 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2020-04-02T23:17:24.876 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-04-02T23:17:24.915 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:24 +0000 (0:00:00.235) 0:00:25.836 ******** 2020-04-02T23:17:24.953 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2020-04-02T23:17:24.954 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-04-02T23:17:24.965 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-04-02T23:17:24.976 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-04-02T23:17:24.987 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-04-02T23:17:25.027 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:25 +0000 (0:00:00.112) 0:00:25.948 ******** 2020-04-02T23:17:25.771 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2020-04-02T23:17:25.773 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-04-02T23:17:25.818 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:25 +0000 (0:00:00.790) 0:00:26.738 ******** 2020-04-02T23:17:25.866 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2020-04-02T23:17:25.868 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-04-02T23:17:25.869 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-04-02T23:17:25.880 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-04-02T23:17:25.892 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-04-02T23:17:25.935 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:25 +0000 (0:00:00.117) 0:00:26.856 ******** 2020-04-02T23:17:25.966 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2020-04-02T23:17:25.967 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: nagios-common", "Installed: nrpe", "Installed: nagios-plugins", "Installed: nagios-plugins-load"]} 2020-04-02T23:17:26.012 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:26 +0000 (0:00:00.076) 0:00:26.933 ******** 2020-04-02T23:17:26.038 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2020-04-02T23:17:26.040 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:26.078 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:26 +0000 (0:00:00.065) 0:00:26.998 ******** 2020-04-02T23:17:26.564 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2020-04-02T23:17:26.598 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:26 +0000 (0:00:00.521) 0:00:27.519 ******** 2020-04-02T23:17:26.873 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: nagios-common", "Installed: nrpe", "Installed: nagios-plugins", "Installed: nagios-plugins-load"]} 2020-04-02T23:17:26.913 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:26 +0000 (0:00:00.314) 0:00:27.834 ******** 2020-04-02T23:17:26.941 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2020-04-02T23:17:26.941 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:26.979 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:26 +0000 (0:00:00.065) 0:00:27.900 ******** 2020-04-02T23:17:27.069 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2020-04-02T23:17:27.070 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2020-04-02T23:17:27.115 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:27 +0000 (0:00:00.136) 0:00:28.037 ******** 2020-04-02T23:17:27.143 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2020-04-02T23:17:27.144 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:27.183 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:27 +0000 (0:00:00.067) 0:00:28.104 ******** 2020-04-02T23:17:27.399 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2020-04-02T23:17:27.399 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-04-02T23:17:27.448 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:27 +0000 (0:00:00.265) 0:00:28.369 ******** 2020-04-02T23:17:27.454 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2020-04-02T23:17:27.455 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2020-04-02T23:17:27.498 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:27 +0000 (0:00:00.050) 0:00:28.419 ******** 2020-04-02T23:17:27.706 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2020-04-02T23:17:27.708 INFO:teuthology.task.ansible.out:fatal: [smithi196.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2020-04-02T23:17:27.767 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:27 +0000 (0:00:00.268) 0:00:28.688 ******** 2020-04-02T23:17:27.793 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2020-04-02T23:17:27.795 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:27.839 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:27 +0000 (0:00:00.072) 0:00:28.760 ******** 2020-04-02T23:17:27.975 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2020-04-02T23:17:27.976 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2020-04-02T23:17:28.024 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:28 +0000 (0:00:00.184) 0:00:28.945 ******** 2020-04-02T23:17:28.050 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2020-04-02T23:17:28.052 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:28.102 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:28 +0000 (0:00:00.078) 0:00:29.023 ******** 2020-04-02T23:17:28.316 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2020-04-02T23:17:28.317 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "checksum": "333141ba5e85aea94f51511a52d9b115d2e0112f", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1174, "state": "file", "uid": 0} 2020-04-02T23:17:28.319 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2020-04-02T23:17:28.320 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-04-02T23:17:28.357 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:28 +0000 (0:00:00.254) 0:00:29.278 ******** 2020-04-02T23:17:28.396 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:28 +0000 (0:00:00.038) 0:00:29.317 ******** 2020-04-02T23:17:28.599 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2020-04-02T23:17:28.600 INFO:teuthology.task.ansible.out:fatal: [smithi174.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2020-04-02T23:17:28.635 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:28 +0000 (0:00:00.239) 0:00:29.556 ******** 2020-04-02T23:17:28.661 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2020-04-02T23:17:28.663 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:17:28.697 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:28 +0000 (0:00:00.062) 0:00:29.618 ******** 2020-04-02T23:17:29.131 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2020-04-02T23:17:29.133 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Thu 2020-04-02 23:16:40 UTC", "ActiveEnterTimestampMonotonic": "12080928", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "system.slice sysinit.target network.target -.mount systemd-tmpfiles-setup.service systemd-journald.socket var-run.mount tmp.mount local-fs.target basic.target nss-lookup.target time-sync.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2020-04-02 23:16:40 UTC", "AssertTimestampMonotonic": "12077395", "Before": "plymouth-quit.service xdm.service getty@tty1.service shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2020-04-02 23:16:40 UTC", "ConditionTimestampMonotonic": "12077394", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "D 2020-04-02T23:17:29.134 INFO:teuthology.task.ansible.out:efaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2387", "ExecMainStartTimestamp": "Thu 2020-04-02 23:16:40 UTC", "ExecMainStartTimestampMonotonic": "12080899", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f ; ignore_errors=no ; start_time=[Thu 2020-04-02 23:16:40 UTC] ; stop_time=[n/a] ; pid=2387 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "GID": "986", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2020-04-02 23:16:40 UTC", "InactiveExitTimestampMonotonic": "12080928", "InvocationID": "da423aafe5d841eb93a25e4f5f73522a", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "Limi 2020-04-02T23:17:29.136 INFO:teuthology.task.ansible.out:tDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127436", "LimitNPROCSoft": "127436", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127436", "LimitSIGPENDINGSoft": "127436", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2387", "MemoryAccounting": "yes", "MemoryCurrent": "1630208", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "RequiresMountsFor": "/var/tmp /run/nrpe", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "n 2020-04-02T23:17:29.137 INFO:teuthology.task.ansible.out:rpe", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2020-04-02 23:16:40 UTC", "StateChangeTimestampMonotonic": "12080928", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "990", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Thu 2020-04-02 23:16:40 UTC", "WatchdogTimestampMonotonic": "12080927", "WatchdogUSec": "0"}} 2020-04-02T23:17:29.171 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:29 +0000 (0:00:00.473) 0:00:30.092 ******** 2020-04-02T23:17:29.177 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2020-04-02T23:17:29.177 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "checksum": "333141ba5e85aea94f51511a52d9b115d2e0112f", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1174, "state": "file", "uid": 0} 2020-04-02T23:17:29.216 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:29 +0000 (0:00:00.044) 0:00:30.136 ******** 2020-04-02T23:17:29.415 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2020-04-02T23:17:29.416 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001654", "end": "2020-04-02 23:17:29.374636", "rc": 0, "start": "2020-04-02 23:17:29.372982", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2020-04-02T23:17:29.453 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:29 +0000 (0:00:00.236) 0:00:30.373 ******** 2020-04-02T23:17:29.542 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2020-04-02T23:17:29.543 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Thu 2020-04-02 23:16:34 UTC", "ActiveEnterTimestampMonotonic": "11891666", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "system.slice systemd-journald.socket sysinit.target network.target -.mount basic.target var-run.mount tmp.mount local-fs.target systemd-tmpfiles-setup.service nss-lookup.target time-sync.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2020-04-02 23:16:34 UTC", "AssertTimestampMonotonic": "11890812", "Before": "xdm.service shutdown.target multi-user.target getty@tty1.service plymouth-quit.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2020-04-02 23:16:34 UTC", "ConditionTimestampMonotonic": "11890812", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "D 2020-04-02T23:17:29.545 INFO:teuthology.task.ansible.out:efaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2395", "ExecMainStartTimestamp": "Thu 2020-04-02 23:16:34 UTC", "ExecMainStartTimestampMonotonic": "11891636", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f ; ignore_errors=no ; start_time=[Thu 2020-04-02 23:16:34 UTC] ; stop_time=[n/a] ; pid=2395 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "GID": "986", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2020-04-02 23:16:34 UTC", "InactiveExitTimestampMonotonic": "11891666", "InvocationID": "7f804c10c6bc44f18b6a6ca039361eb4", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "Limi 2020-04-02T23:17:29.546 INFO:teuthology.task.ansible.out:tDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127436", "LimitNPROCSoft": "127436", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127436", "LimitSIGPENDINGSoft": "127436", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2395", "MemoryAccounting": "yes", "MemoryCurrent": "1568768", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount system.slice sysinit.target", "RequiresMountsFor": "/var/tmp /run/nrpe", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "n 2020-04-02T23:17:29.548 INFO:teuthology.task.ansible.out:rpe", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2020-04-02 23:16:34 UTC", "StateChangeTimestampMonotonic": "11891666", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTY 2020-04-02T23:17:29.548 INFO:teuthology.task.ansible.out:VHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "990", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Thu 2020-04-02 23:16:34 UTC", "WatchdogTimestampMonotonic": "11891665", "WatchdogUSec": "0"}} 2020-04-02T23:17:29.585 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:29 +0000 (0:00:00.132) 0:00:30.506 ******** 2020-04-02T23:17:29.778 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2020-04-02T23:17:29.780 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001643", "end": "2020-04-02 23:17:29.759456", "rc": 0, "start": "2020-04-02 23:17:29.757813", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2020-04-02T23:17:29.819 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:29 +0000 (0:00:00.234) 0:00:30.740 ******** 2020-04-02T23:17:30.363 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2020-04-02T23:17:30.366 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: python3-libsemanage", "Installed: python3-policycoreutils"]} 2020-04-02T23:17:30.405 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:30 +0000 (0:00:00.585) 0:00:31.326 ******** 2020-04-02T23:17:30.716 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: python3-libsemanage", "Installed: python3-policycoreutils"]} 2020-04-02T23:17:30.755 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:30 +0000 (0:00:00.350) 0:00:31.676 ******** 2020-04-02T23:17:31.310 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2020-04-02T23:17:31.311 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: selinux-policy-targeted"]} 2020-04-02T23:17:31.350 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:31 +0000 (0:00:00.595) 0:00:32.271 ******** 2020-04-02T23:17:31.661 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: selinux-policy-targeted"]} 2020-04-02T23:17:31.709 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:31 +0000 (0:00:00.354) 0:00:32.626 ******** 2020-04-02T23:17:32.684 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2020-04-02T23:17:32.686 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2020-04-02T23:17:32.730 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:32 +0000 (0:00:01.019) 0:00:33.645 ******** 2020-04-02T23:17:32.837 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2020-04-02T23:17:32.879 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:32 +0000 (0:00:00.154) 0:00:33.800 ******** 2020-04-02T23:17:49.131 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2020-04-02T23:17:49.132 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:16.208946", "end": "2020-04-02 23:17:49.108529", "failed_when_result": false, "rc": 0, "start": "2020-04-02 23:17:32.899583", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2020-04-02T23:17:49.169 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:49 +0000 (0:00:16.289) 0:00:50.090 ******** 2020-04-02T23:17:49.289 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:16.204180", "end": "2020-04-02 23:17:49.263723", "failed_when_result": false, "rc": 0, "start": "2020-04-02 23:17:33.059543", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2020-04-02T23:17:49.329 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:49 +0000 (0:00:00.159) 0:00:50.250 ******** 2020-04-02T23:17:49.659 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2020-04-02T23:17:49.659 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2020-04-02T23:17:49.700 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:49 +0000 (0:00:00.371) 0:00:50.621 ******** 2020-04-02T23:17:49.813 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2020-04-02T23:17:49.871 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:49 +0000 (0:00:00.170) 0:00:50.792 ******** 2020-04-02T23:17:49.919 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2020-04-02T23:17:49.919 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.022943", "end": "2020-04-02 23:17:49.900694", "rc": 0, "start": "2020-04-02 23:17:49.877751", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:17:49.958 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:49 +0000 (0:00:00.087) 0:00:50.879 ******** 2020-04-02T23:17:50.100 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.024795", "end": "2020-04-02 23:17:50.068087", "rc": 0, "start": "2020-04-02 23:17:50.043292", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:17:50.131 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:50 +0000 (0:00:00.173) 0:00:51.052 ******** 2020-04-02T23:17:50.153 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** changed: [smithi196.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.001971", "end": "2020-04-02 23:17:50.131568", "rc": 0, "start": "2020-04-02 23:17:50.129597", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:17:50.204 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:50 +0000 (0:00:00.071) 0:00:51.124 ******** 2020-04-02T23:17:50.334 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.002486", "end": "2020-04-02 23:17:50.307284", "rc": 0, "start": "2020-04-02 23:17:50.304798", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:17:50.378 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:17:50 +0000 (0:00:00.175) 0:00:51.299 ******** 2020-04-02T23:18:06.586 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2020-04-02T23:18:06.587 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:16.183888", "end": "2020-04-02 23:18:06.564096", "rc": 0, "start": "2020-04-02 23:17:50.380208", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:18:06.649 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:06 +0000 (0:00:16.269) 0:01:07.569 ******** 2020-04-02T23:18:06.717 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:16.144248", "end": "2020-04-02 23:18:06.696664", "rc": 0, "start": "2020-04-02 23:17:50.552416", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:18:06.759 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:06 +0000 (0:00:00.107) 0:01:07.676 ******** 2020-04-02T23:18:06.873 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2020-04-02T23:18:06.922 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:06 +0000 (0:00:00.166) 0:01:07.843 ******** 2020-04-02T23:18:06.952 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2020-04-02T23:18:06.953 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi", "iozone"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2020-04-02T23:18:06.991 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:06 +0000 (0:00:00.068) 0:01:07.912 ******** 2020-04-02T23:18:07.000 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2020-04-02T23:18:07.042 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:07 +0000 (0:00:00.047) 0:01:07.959 ******** 2020-04-02T23:18:07.044 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2020-04-02T23:18:07.045 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-04-02T23:18:07.089 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:07 +0000 (0:00:00.050) 0:01:08.010 ******** 2020-04-02T23:18:07.095 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2020-04-02T23:18:07.096 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi", "iozone"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2020-04-02T23:18:07.136 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:07 +0000 (0:00:00.045) 0:01:08.056 ******** 2020-04-02T23:18:07.141 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2020-04-02T23:18:07.142 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "copr_repos": ["ktdreyer/ceph-el8"], "epel_packages": [], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["@core", "@base", "dnf-utils", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "podman", "podman-docker", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "dbench", "autoconf", "gdb"], "yum_mirrorlists": ["CentOS-AppStream-mirrorlist", "CentOS-Base-mirrorlist", "CentOS-Extras-mirrorlist"], "yum_repos": {"CentOS-AppStream": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}, "CentOS-Base": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}, "CentOS-Extras": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"} 2020-04-02T23:18:07.193 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:07 +0000 (0:00:00.051) 0:01:08.107 ******** TASK [testnode : Including distro specific variables.] ************************* ok: [smithi174.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-04-02T23:18:07.242 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:07 +0000 (0:00:00.055) 0:01:08.163 ******** 2020-04-02T23:18:07.249 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2020-04-02T23:18:07.250 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-04-02T23:18:07.299 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:07 +0000 (0:00:00.054) 0:01:08.218 ******** 2020-04-02T23:18:07.303 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2020-04-02T23:18:07.305 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "copr_repos": ["ktdreyer/ceph-el8"], "epel_packages": [], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["@core", "@base", "dnf-utils", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "podman", "podman-docker", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "dbench", "autoconf", "gdb"], "yum_mirrorlists": ["CentOS-AppStream-mirrorlist", "CentOS-Base-mirrorlist", "CentOS-Extras-mirrorlist"], "yum_repos": {"CentOS-AppStream": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}, "CentOS-Base": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}, "CentOS-Extras": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"} 2020-04-02T23:18:07.352 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:07 +0000 (0:00:00.055) 0:01:08.273 ******** 2020-04-02T23:18:07.399 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2020-04-02T23:18:07.401 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-04-02T23:18:07.451 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:07 +0000 (0:00:00.096) 0:01:08.369 ******** 2020-04-02T23:18:07.497 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2020-04-02T23:18:07.499 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-04-02T23:18:07.543 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:07 +0000 (0:00:00.094) 0:01:08.464 ******** 2020-04-02T23:18:07.653 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-04-02T23:18:07.689 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:07 +0000 (0:00:00.146) 0:01:08.610 ******** 2020-04-02T23:18:07.754 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2020-04-02T23:18:07.755 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "gid": 1212, "name": "ubuntu", "state": "present", "system": false} 2020-04-02T23:18:07.794 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:07 +0000 (0:00:00.104) 0:01:08.715 ******** 2020-04-02T23:18:07.837 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2020-04-02T23:18:07.839 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:07.885 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:07 +0000 (0:00:00.091) 0:01:08.806 ******** 2020-04-02T23:18:07.890 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2020-04-02T23:18:07.891 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "gid": 1212, "name": "ubuntu", "state": "present", "system": false} 2020-04-02T23:18:07.939 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:07 +0000 (0:00:00.053) 0:01:08.860 ******** 2020-04-02T23:18:07.945 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2020-04-02T23:18:07.947 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:07.984 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:07 +0000 (0:00:00.045) 0:01:08.905 ******** 2020-04-02T23:18:07.989 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2020-04-02T23:18:07.990 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:08.031 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:08 +0000 (0:00:00.046) 0:01:08.952 ******** 2020-04-02T23:18:08.067 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2020-04-02T23:18:08.069 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:08.107 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:08 +0000 (0:00:00.074) 0:01:09.027 ******** 2020-04-02T23:18:08.194 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2020-04-02T23:18:08.195 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2020-04-02T23:18:08.235 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:08 +0000 (0:00:00.129) 0:01:09.156 ******** 2020-04-02T23:18:08.324 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2020-04-02T23:18:08.363 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:08 +0000 (0:00:00.127) 0:01:09.284 ******** 2020-04-02T23:18:08.801 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2020-04-02T23:18:08.840 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:08 +0000 (0:00:00.476) 0:01:09.761 ******** 2020-04-02T23:18:08.876 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2020-04-02T23:18:08.878 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi196"}, "changed": false} 2020-04-02T23:18:08.917 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:08 +0000 (0:00:00.075) 0:01:09.836 ******** 2020-04-02T23:18:08.931 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2020-04-02T23:18:08.932 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2020-04-02T23:18:08.970 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:08 +0000 (0:00:00.055) 0:01:09.891 ******** 2020-04-02T23:18:09.009 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2020-04-02T23:18:09.010 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi174"}, "changed": false} 2020-04-02T23:18:09.050 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:09 +0000 (0:00:00.079) 0:01:09.971 ******** 2020-04-02T23:18:09.987 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2020-04-02T23:18:09.989 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi196.front.sepia.ceph.com", "ansible_hostname": "smithi196", "ansible_nodename": "smithi196"}, "changed": true, "name": "smithi196"} changed: [smithi174.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi174.front.sepia.ceph.com", "ansible_hostname": "smithi174", "ansible_nodename": "smithi174"}, "changed": true, "name": "smithi174"} 2020-04-02T23:18:10.029 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:10 +0000 (0:00:00.979) 0:01:10.950 ******** 2020-04-02T23:18:10.065 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:10 +0000 (0:00:00.035) 0:01:10.986 ******** 2020-04-02T23:18:10.493 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2020-04-02T23:18:10.494 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2020-04-02T23:18:10.532 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:10 +0000 (0:00:00.466) 0:01:11.453 ******** 2020-04-02T23:18:10.538 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2020-04-02T23:18:10.578 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:10 +0000 (0:00:00.045) 0:01:11.499 ******** 2020-04-02T23:18:10.996 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2020-04-02T23:18:11.033 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:11 +0000 (0:00:00.454) 0:01:11.954 ******** 2020-04-02T23:18:11.060 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2020-04-02T23:18:11.100 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:11 +0000 (0:00:00.066) 0:01:12.020 ******** 2020-04-02T23:18:11.618 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** ok: [smithi174.front.sepia.ceph.com] => {"attempts": 1, "changed": false, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-04-02T23:18:11.656 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:11 +0000 (0:00:00.556) 0:01:12.577 ******** 2020-04-02T23:18:11.683 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"attempts": 1, "changed": false, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-04-02T23:18:11.722 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:11 +0000 (0:00:00.065) 0:01:12.643 ******** 2020-04-02T23:18:12.157 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2020-04-02T23:18:12.158 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2020-04-02T23:18:12.221 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:12 +0000 (0:00:00.499) 0:01:13.142 ******** 2020-04-02T23:18:12.227 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2020-04-02T23:18:12.266 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:12 +0000 (0:00:00.044) 0:01:13.187 ******** 2020-04-02T23:18:12.428 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-04-02T23:18:12.428 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2020-04-02T23:18:12.466 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:12 +0000 (0:00:00.200) 0:01:13.387 ******** 2020-04-02T23:18:12.473 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2020-04-02T23:18:12.520 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:12 +0000 (0:00:00.054) 0:01:13.441 ******** 2020-04-02T23:18:12.665 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-04-02T23:18:12.667 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2020-04-02T23:18:12.704 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:12 +0000 (0:00:00.183) 0:01:13.625 ******** 2020-04-02T23:18:12.721 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2020-04-02T23:18:12.762 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:12 +0000 (0:00:00.058) 0:01:13.683 ******** 2020-04-02T23:18:12.928 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-04-02T23:18:12.930 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1212, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-04-02T23:18:12.966 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:12 +0000 (0:00:00.203) 0:01:13.887 ******** 2020-04-02T23:18:12.983 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1212, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-04-02T23:18:13.023 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:13 +0000 (0:00:00.057) 0:01:13.944 ******** 2020-04-02T23:18:13.445 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2020-04-02T23:18:13.488 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:13 +0000 (0:00:00.461) 0:01:14.406 ******** 2020-04-02T23:18:13.523 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2020-04-02T23:18:13.569 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:13 +0000 (0:00:00.078) 0:01:14.484 ******** 2020-04-02T23:18:13.957 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-04-02T23:18:13.960 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2020-04-02T23:18:14.019 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:14 +0000 (0:00:00.455) 0:01:14.940 ******** 2020-04-02T23:18:14.067 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2020-04-02T23:18:14.109 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:14 +0000 (0:00:00.090) 0:01:15.030 ******** 2020-04-02T23:18:15.805 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-04-02T23:18:15.807 INFO:teuthology.task.ansible.out: [WARNING]: Consider using the yum, dnf or zypper module rather than running 'rpm'. If you need to use command because yum, dnf or zypper is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:01.584474", "end": "2020-04-02 23:18:15.773866", "rc": 0, "start": "2020-04-02 23:18:14.189392", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:18:15.874 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:15 +0000 (0:00:01.762) 0:01:16.793 ******** 2020-04-02T23:18:15.967 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:01.656264", "end": "2020-04-02 23:18:15.936641", "rc": 0, "start": "2020-04-02 23:18:14.280377", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:18:16.006 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:16 +0000 (0:00:00.134) 0:01:16.927 ******** 2020-04-02T23:18:16.430 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2020-04-02T23:18:16.431 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=CentOS-AppStream-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "53b24162baf9c2fcf22da2b5c2c258a91997ffad", "dest": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-AppStream-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 425, "state": "file", "uid": 0} 2020-04-02T23:18:16.515 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=CentOS-AppStream-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "53b24162baf9c2fcf22da2b5c2c258a91997ffad", "dest": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-AppStream-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 425, "state": "file", "uid": 0} 2020-04-02T23:18:16.895 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=CentOS-Base-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3e4763db3d6c8e2d723452e76e0b9ed9030ed28d", "dest": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Base-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 408, "state": "file", "uid": 0} 2020-04-02T23:18:16.958 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=CentOS-Base-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3e4763db3d6c8e2d723452e76e0b9ed9030ed28d", "dest": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Base-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 408, "state": "file", "uid": 0} 2020-04-02T23:18:17.358 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=CentOS-Extras-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "6d4b75787c58f146a27a5ee2b688dd525283abf1", "dest": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Extras-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 410, "state": "file", "uid": 0} 2020-04-02T23:18:17.398 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:17 +0000 (0:00:01.391) 0:01:18.319 ******** 2020-04-02T23:18:17.415 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=CentOS-Extras-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "6d4b75787c58f146a27a5ee2b688dd525283abf1", "dest": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Extras-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 410, "state": "file", "uid": 0} 2020-04-02T23:18:17.456 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:17 +0000 (0:00:00.058) 0:01:18.377 ******** 2020-04-02T23:18:17.884 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2020-04-02T23:18:17.886 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'lab-extras', u'baseurl': u'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/'}, 'key': u'lab-extras'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2020-04-02T23:18:17.924 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:17 +0000 (0:00:00.466) 0:01:18.844 ******** 2020-04-02T23:18:17.940 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'lab-extras', u'baseurl': u'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/'}, 'key': u'lab-extras'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2020-04-02T23:18:17.980 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:17 +0000 (0:00:00.057) 0:01:18.901 ******** 2020-04-02T23:18:18.448 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-04-02T23:18:18.449 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 1, u'gpgkey': u'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial', u'enabled': 1, u'mirrorlist': u'file:///etc/yum.repos.d/CentOS-Base-mirrorlist', u'name': u'CentOS-$releasever - Base'}, 'key': u'CentOS-Base'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "77e4590ed0ecec056fa44f4e65af60e110822b85", "dest": "/etc/yum.repos.d/CentOS-Base.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Base", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 274, "state": "file", "uid": 0} 2020-04-02T23:18:18.482 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 1, u'gpgkey': u'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial', u'enabled': 1, u'mirrorlist': u'file:///etc/yum.repos.d/CentOS-Base-mirrorlist', u'name': u'CentOS-$releasever - Base'}, 'key': u'CentOS-Base'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "77e4590ed0ecec056fa44f4e65af60e110822b85", "dest": "/etc/yum.repos.d/CentOS-Base.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Base", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 274, "state": "file", "uid": 0} 2020-04-02T23:18:18.901 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 1, u'gpgkey': u'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial', u'enabled': 1, u'mirrorlist': u'file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist', u'name': u'CentOS-$releasever - AppStream'}, 'key': u'CentOS-AppStream'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "9b147c879e95cd23f3bbde027da102febcaad1a8", "dest": "/etc/yum.repos.d/CentOS-AppStream.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-AppStream", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 289, "state": "file", "uid": 0} 2020-04-02T23:18:18.970 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 1, u'gpgkey': u'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial', u'enabled': 1, u'mirrorlist': u'file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist', u'name': u'CentOS-$releasever - AppStream'}, 'key': u'CentOS-AppStream'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "9b147c879e95cd23f3bbde027da102febcaad1a8", "dest": "/etc/yum.repos.d/CentOS-AppStream.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-AppStream", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 289, "state": "file", "uid": 0} 2020-04-02T23:18:19.363 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 1, u'gpgkey': u'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial', u'enabled': 1, u'mirrorlist': u'file:///etc/yum.repos.d/CentOS-Extras-mirrorlist', u'name': u'CentOS-$releasever - Extras'}, 'key': u'CentOS-Extras'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "2856826614c7f1cb9409228f6c41319a023ca754", "dest": "/etc/yum.repos.d/CentOS-Extras.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Extras", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 280, "state": "file", "uid": 0} 2020-04-02T23:18:19.417 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:19 +0000 (0:00:01.436) 0:01:20.338 ******** 2020-04-02T23:18:19.425 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 1, u'gpgkey': u'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial', u'enabled': 1, u'mirrorlist': u'file:///etc/yum.repos.d/CentOS-Extras-mirrorlist', u'name': u'CentOS-$releasever - Extras'}, 'key': u'CentOS-Extras'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "2856826614c7f1cb9409228f6c41319a023ca754", "dest": "/etc/yum.repos.d/CentOS-Extras.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Extras", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 280, "state": "file", "uid": 0} 2020-04-02T23:18:19.469 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:19 +0000 (0:00:00.052) 0:01:20.390 ******** 2020-04-02T23:18:19.972 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2020-04-02T23:18:19.973 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item=ktdreyer/ceph-el8) => {"ansible_loop_var": "item", "changed": true, "cmd": ["dnf", "-y", "copr", "enable", "ktdreyer/ceph-el8"], "delta": "0:00:00.327619", "end": "2020-04-02 23:18:19.935328", "item": "ktdreyer/ceph-el8", "rc": 0, "start": "2020-04-02 23:18:19.607709", "stderr": "", "stderr_lines": [], "stdout": "Repository successfully enabled.", "stdout_lines": ["Repository successfully enabled."], "warnings": ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."]} 2020-04-02T23:18:19.973 INFO:teuthology.task.ansible.out: [WARNING]: Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. 2020-04-02T23:18:20.015 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:20 +0000 (0:00:00.545) 0:01:20.936 ******** 2020-04-02T23:18:20.021 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => (item=ktdreyer/ceph-el8) => {"ansible_loop_var": "item", "changed": true, "cmd": ["dnf", "-y", "copr", "enable", "ktdreyer/ceph-el8"], "delta": "0:00:00.331787", "end": "2020-04-02 23:18:19.987742", "item": "ktdreyer/ceph-el8", "rc": 0, "start": "2020-04-02 23:18:19.655955", "stderr": "", "stderr_lines": [], "stdout": "Repository successfully enabled.", "stdout_lines": ["Repository successfully enabled."], "warnings": ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."]} 2020-04-02T23:18:20.064 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:20 +0000 (0:00:00.048) 0:01:20.985 ******** 2020-04-02T23:18:20.072 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:20.112 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:20 +0000 (0:00:00.048) 0:01:21.033 ******** 2020-04-02T23:18:20.120 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:20.161 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:20 +0000 (0:00:00.048) 0:01:21.082 ******** 2020-04-02T23:18:20.167 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2020-04-02T23:18:20.168 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-04-02T23:18:20.169 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-04-02T23:18:20.216 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:20 +0000 (0:00:00.055) 0:01:21.137 ******** 2020-04-02T23:18:20.222 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-04-02T23:18:20.223 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-04-02T23:18:20.268 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:20 +0000 (0:00:00.052) 0:01:21.189 ******** 2020-04-02T23:18:20.278 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2020-04-02T23:18:20.278 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:20.332 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:20 +0000 (0:00:00.063) 0:01:21.253 ******** 2020-04-02T23:18:20.338 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:20.376 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:20 +0000 (0:00:00.044) 0:01:21.297 ******** 2020-04-02T23:18:20.383 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-02T23:18:20.385 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2020-04-02T23:18:20.421 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:20 +0000 (0:00:00.043) 0:01:21.341 ******** 2020-04-02T23:18:20.426 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2020-04-02T23:18:20.464 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:20 +0000 (0:00:00.043) 0:01:21.384 ******** 2020-04-02T23:18:20.467 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2020-04-02T23:18:20.469 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:20.511 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:20 +0000 (0:00:00.047) 0:01:21.432 ******** 2020-04-02T23:18:20.516 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:20.555 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:20 +0000 (0:00:00.043) 0:01:21.476 ******** 2020-04-02T23:18:20.559 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2020-04-02T23:18:20.561 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:20.598 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:20 +0000 (0:00:00.042) 0:01:21.519 ******** 2020-04-02T23:18:20.606 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:20.644 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:20 +0000 (0:00:00.045) 0:01:21.564 ******** 2020-04-02T23:18:20.815 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2020-04-02T23:18:20.816 INFO:teuthology.task.ansible.out:fatal: [smithi174.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.006756", "end": "2020-04-02 23:18:20.796124", "msg": "non-zero return code", "rc": 1, "start": "2020-04-02 23:18:20.789368", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2020-04-02T23:18:20.854 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:20 +0000 (0:00:00.210) 0:01:21.775 ******** 2020-04-02T23:18:20.861 INFO:teuthology.task.ansible.out:fatal: [smithi196.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.006759", "end": "2020-04-02 23:18:20.825217", "msg": "non-zero return code", "rc": 1, "start": "2020-04-02 23:18:20.818458", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2020-04-02T23:18:20.899 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:20 +0000 (0:00:00.045) 0:01:21.820 ******** 2020-04-02T23:18:20.905 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2020-04-02T23:18:20.906 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:20.943 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:20 +0000 (0:00:00.044) 0:01:21.864 ******** 2020-04-02T23:18:20.949 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:20.987 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:20 +0000 (0:00:00.043) 0:01:21.908 ******** 2020-04-02T23:18:23.209 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-04-02T23:18:23.211 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+266+ba744077.2.x86_64", "Removed: librados2-1:12.2.7-9.el8.x86_64", "Removed: librbd1-1:12.2.7-9.el8.x86_64"]} 2020-04-02T23:18:23.253 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:23 +0000 (0:00:02.264) 0:01:24.172 ******** 2020-04-02T23:18:23.291 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+266+ba744077.2.x86_64", "Removed: librados2-1:12.2.7-9.el8.x86_64", "Removed: librbd1-1:12.2.7-9.el8.x86_64"]} 2020-04-02T23:18:23.335 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:23 +0000 (0:00:00.083) 0:01:24.255 ******** 2020-04-02T23:18:26.100 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-04-02T23:18:26.100 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-6.el8.x86_64", "Removed: boost-random-1.66.0-6.el8.x86_64", "Removed: hdparm-9.54-2.el8.x86_64", "Removed: tuned-2.12.0-3.el8_1.1.noarch"]} 2020-04-02T23:18:26.141 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:26 +0000 (0:00:02.806) 0:01:27.062 ******** 2020-04-02T23:18:26.399 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-6.el8.x86_64", "Removed: boost-random-1.66.0-6.el8.x86_64", "Removed: hdparm-9.54-2.el8.x86_64", "Removed: tuned-2.12.0-3.el8_1.1.noarch"]} 2020-04-02T23:18:26.439 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:26 +0000 (0:00:00.297) 0:01:27.359 ******** 2020-04-02T23:18:31.340 INFO:teuthology.task.ansible.out: TASK [testnode : Base group workaround for BZ1782899] ************************** 2020-04-02T23:18:31.341 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "cmd": "dnf -y groupinstall base --nobest && dnf -y group upgrade base", "delta": "0:00:04.976872", "end": "2020-04-02 23:18:31.309685", "rc": 0, "start": "2020-04-02 23:18:26.332813", "stderr": "No match for group package \"insights-client\"\nNo match for group package \"centos-release-eula\"\nNo match for group package \"insights-client\"\nNo match for group package \"centos-release-eula\"", "stderr_lines": ["No match for group package \"insights-client\"", "No match for group package \"centos-release-eula\"", "No match for group package \"insights-client\"", "No match for group package \"centos-release-eula\""], "stdout": "CentOS-8 - AppStream 33 kB/s | 4.3 kB 00:00 \nCentOS-8 - Base 127 kB/s | 3.8 kB 00:00 \nCentOS-8 - Extras 51 kB/s | 1.5 kB 00:00 \nCopr repo for ceph-el8 owned by ktdreyer 68 kB/s | 3.3 kB 00:00 \nExtra Packages for Enterprise Linux 122 kB/s | 4.7 kB 00:00 \nlab-extras 1.2 MB/s | 2.9 kB 00:00 \nDependencies resolved.\n================================================================================\n Package Architecture Version Repository Size\n================================================================================\nInstalling Groups:\n Base \n\nTransaction Summary\n================================================================================\n\nComplete!\nLast metadata expiration check: 0:00:02 ago on Thu 02 Apr 2020 11:18:27 PM UTC.\nDependencies resolved.\n================================================================================\n Package Architecture Version Repository Size\n============================================================= 2020-04-02T23:18:31.343 INFO:teuthology.task.ansible.out:===================\nUpgrading Groups:\n Base \n\nTransaction Summary\n================================================================================\n\nComplete!", "stdout_lines": ["CentOS-8 - AppStream 33 kB/s | 4.3 kB 00:00 ", "CentOS-8 - Base 127 kB/s | 3.8 kB 00:00 ", "CentOS-8 - Extras 51 kB/s | 1.5 kB 00:00 ", "Copr repo for ceph-el8 owned by ktdreyer 68 kB/s | 3.3 kB 00:00 ", "Extra Packages for Enterprise Linux 122 kB/s | 4.7 kB 00:00 ", "lab-extras 1.2 MB/s | 2.9 kB 00:00 ", "Dependencies resolved.", "================================================================================", " Package Architecture Version Repository Size", "================================================================================", "Installing Groups:", " Base ", "", "Transaction Summary", "================================================================================", "", "Complete!", "Last metadata expiration check: 0:00:02 ago on Thu 02 Apr 2020 11:18:27 PM UTC.", "Dependencies resolved.", "================================================================================", " Package Architecture Version Repository Size", "================================================================================", "Upgrading Groups:", " Base ", "", "Transaction Summary", "================================================================================", "", "Complete!"]} 2020-04-02T23:18:31.381 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:31 +0000 (0:00:04.941) 0:01:32.301 ******** 2020-04-02T23:18:31.514 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => {"changed": true, "cmd": "dnf -y groupinstall base --nobest && dnf -y group upgrade base", "delta": "0:00:04.844248", "end": "2020-04-02 23:18:31.486554", "rc": 0, "start": "2020-04-02 23:18:26.642306", "stderr": "No match for group package \"insights-client\"\nNo match for group package \"centos-release-eula\"\nNo match for group package \"insights-client\"\nNo match for group package \"centos-release-eula\"", "stderr_lines": ["No match for group package \"insights-client\"", "No match for group package \"centos-release-eula\"", "No match for group package \"insights-client\"", "No match for group package \"centos-release-eula\""], "stdout": "CentOS-8 - AppStream 142 kB/s | 4.3 kB 00:00 \nCentOS-8 - Base 132 kB/s | 3.8 kB 00:00 \nCentOS-8 - Extras 52 kB/s | 1.5 kB 00:00 \nCopr repo for ceph-el8 owned by ktdreyer 75 kB/s | 3.3 kB 00:00 \nExtra Packages for Enterprise Linux 80 kB/s | 4.7 kB 00:00 \nlab-extras 1.3 MB/s | 2.9 kB 00:00 \nDependencies resolved.\n================================================================================\n Package Architecture Version Repository Size\n================================================================================\nInstalling Groups:\n Base \n\nTransaction Summary\n================================================================================\n\nComplete!\nLast metadata expiration check: 0:00:02 ago on Thu 02 Apr 2020 11:18:27 PM UTC.\nDependencies resolved.\n================================================================================\n Package Architecture Version Repository Size\n============================================================= 2020-04-02T23:18:31.515 INFO:teuthology.task.ansible.out:===================\nUpgrading Groups:\n Base \n\nTransaction Summary\n================================================================================\n\nComplete!", "stdout_lines": ["CentOS-8 - AppStream 142 kB/s | 4.3 kB 00:00 ", "CentOS-8 - Base 132 kB/s | 3.8 kB 00:00 ", "CentOS-8 - Extras 52 kB/s | 1.5 kB 00:00 ", "Copr repo for ceph-el8 owned by ktdreyer 75 kB/s | 3.3 kB 00:00 ", "Extra Packages for Enterprise Linux 80 kB/s | 4.7 kB 00:00 ", "lab-extras 1.3 MB/s | 2.9 kB 00:00 ", "Dependencies resolved.", "================================================================================", " Package Architecture Version Repository Size", "================================================================================", "Installing Groups:", " Base ", "", "Transaction Summary", "================================================================================", "", "Complete!", "Last metadata expiration check: 0:00:02 ago on Thu 02 Apr 2020 11:18:27 PM UTC.", "Dependencies resolved.", "================================================================================", " Package Architecture Version Repository Size", "================================================================================", "Upgrading Groups:", " Base ", "", "Transaction Summary", "================================================================================", "", "Complete!"]} 2020-04-02T23:18:31.553 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:31 +0000 (0:00:00.172) 0:01:32.474 ******** 2020-04-02T23:18:38.523 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-04-02T23:18:38.523 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Group core installed.", "Group base installed.", "Installed: dnf-utils", "Installed: sysstat", "Installed: libedit", "Installed: boost-thread", "Installed: xfsprogs", "Installed: gdisk", "Installed: parted", "Installed: libgcrypt", "Installed: fuse-libs", "Installed: openssl", "Installed: libuuid", "Installed: podman", "Installed: podman-docker", "Installed: attr", "Installed: ant", "Installed: lsof", "Installed: gettext", "Installed: bc", "Installed: xfsdump", "Installed: blktrace", "Installed: usbredir", "Installed: libev-devel", "Installed: valgrind", "Installed: nfs-utils", "Installed: ncurses-devel", "Installed: gcc", "Installed: git", "Installed: python3-nose", "Installed: python3-virtualenv", "Installed: genisoimage", "Installed: qemu-img", "Installed: qemu-kvm-core", "Installed: qemu-kvm-block-rbd", "Installed: libacl-devel", "Installed: dbench", "Installed: autoconf", "Installed: gdb", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Installed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+266+ba744077.2.x86_64", "Installed: tuned-2.12.0-3.el8_1.1.noarch", "Installed: boost-program-options-1.66.0-6.el8.x86_64", "Installed: boost-random-1.66.0-6.el8.x86_64", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Installed: hdparm-9.54-2.el8.x86_64"]} 2020-04-02T23:18:38.571 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:38 +0000 (0:00:07.017) 0:01:39.492 ******** 2020-04-02T23:18:38.600 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2020-04-02T23:18:38.602 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:38.648 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:38 +0000 (0:00:00.077) 0:01:39.569 ******** 2020-04-02T23:18:39.100 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* changed: [smithi196.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Group core installed.", "Group base installed.", "Installed: dnf-utils", "Installed: sysstat", "Installed: libedit", "Installed: boost-thread", "Installed: xfsprogs", "Installed: gdisk", "Installed: parted", "Installed: libgcrypt", "Installed: fuse-libs", "Installed: openssl", "Installed: libuuid", "Installed: podman", "Installed: podman-docker", "Installed: attr", "Installed: ant", "Installed: lsof", "Installed: gettext", "Installed: bc", "Installed: xfsdump", "Installed: blktrace", "Installed: usbredir", "Installed: libev-devel", "Installed: valgrind", "Installed: nfs-utils", "Installed: ncurses-devel", "Installed: gcc", "Installed: git", "Installed: python3-nose", "Installed: python3-virtualenv", "Installed: genisoimage", "Installed: qemu-img", "Installed: qemu-kvm-core", "Installed: qemu-kvm-block-rbd", "Installed: libacl-devel", "Installed: dbench", "Installed: autoconf", "Installed: gdb", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Installed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+266+ba744077.2.x86_64", "Installed: tuned-2.12.0-3.el8_1.1.noarch", "Installed: boost-program-options-1.66.0-6.el8.x86_64", "Installed: boost-random-1.66.0-6.el8.x86_64", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Installed: hdparm-9.54-2.el8.x86_64"]} 2020-04-02T23:18:39.142 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:39 +0000 (0:00:00.493) 0:01:40.063 ******** 2020-04-02T23:18:39.180 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2020-04-02T23:18:39.182 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:39.230 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:39 +0000 (0:00:00.088) 0:01:40.151 ******** 2020-04-02T23:18:39.568 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-04-02T23:18:39.569 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2020-04-02T23:18:39.621 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:39 +0000 (0:00:00.390) 0:01:40.542 ******** 2020-04-02T23:18:39.670 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-04-02T23:18:39.672 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:39.715 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:39 +0000 (0:00:00.094) 0:01:40.636 ******** 2020-04-02T23:18:40.044 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2020-04-02T23:18:40.046 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "polkit.service basic.target system.slice dbus.socket dbus.service sysinit.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "network-pre.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "ip6tables.service ipset.service ebtables.service shutdown.target iptables.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTim 2020-04-02T23:18:40.048 INFO:teuthology.task.ansible.out:estampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127436", "LimitNPROCSoft": "127436", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127436", 2020-04-02T23:18:40.049 INFO:teuthology.task.ansible.out:"LimitSIGPENDINGSoft": "127436", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "dbus.socket system.slice sysinit.target", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestampMonotonic": "0", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3 2020-04-02T23:18:40.051 INFO:teuthology.task.ansible.out:", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2020-04-02T23:18:40.100 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:40 +0000 (0:00:00.385) 0:01:41.021 ******** 2020-04-02T23:18:40.158 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-04-02T23:18:40.159 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2020-04-02T23:18:40.197 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:40 +0000 (0:00:00.095) 0:01:41.118 ******** 2020-04-02T23:18:40.223 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-04-02T23:18:40.225 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:40.260 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:40 +0000 (0:00:00.063) 0:01:41.181 ******** 2020-04-02T23:18:40.405 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2020-04-02T23:18:40.406 INFO:teuthology.task.ansible.out:fatal: [smithi174.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2020-04-02T23:18:40.445 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:40 +0000 (0:00:00.184) 0:01:41.365 ******** 2020-04-02T23:18:40.578 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2020-04-02T23:18:40.580 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "system.slice dbus.socket polkit.service dbus.service sysinit.target basic.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "network-pre.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target iptables.service ebtables.service ip6tables.service ipset.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTim 2020-04-02T23:18:40.582 INFO:teuthology.task.ansible.out:estampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127436", "LimitNPROCSoft": "127436", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127436", 2020-04-02T23:18:40.583 INFO:teuthology.task.ansible.out:"LimitSIGPENDINGSoft": "127436", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "dbus.socket sysinit.target system.slice", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestampMonotonic": "0", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3 2020-04-02T23:18:40.585 INFO:teuthology.task.ansible.out:", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2020-04-02T23:18:40.622 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:40 +0000 (0:00:00.177) 0:01:41.543 ******** 2020-04-02T23:18:40.923 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2020-04-02T23:18:40.924 INFO:teuthology.task.ansible.out:fatal: [smithi196.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2020-04-02T23:18:40.962 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:40 +0000 (0:00:00.340) 0:01:41.883 ******** 2020-04-02T23:18:41.157 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2020-04-02T23:18:41.159 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2020-04-02T23:18:41.200 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:41 +0000 (0:00:00.238) 0:01:42.121 ******** 2020-04-02T23:18:41.227 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2020-04-02T23:18:41.228 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:41.265 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:41 +0000 (0:00:00.065) 0:01:42.186 ******** 2020-04-02T23:18:41.271 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2020-04-02T23:18:41.271 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2020-04-02T23:18:41.311 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:41 +0000 (0:00:00.045) 0:01:42.232 ******** 2020-04-02T23:18:41.318 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2020-04-02T23:18:41.359 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:41 +0000 (0:00:00.048) 0:01:42.280 ******** 2020-04-02T23:18:41.366 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:41.404 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:41 +0000 (0:00:00.044) 0:01:42.325 ******** 2020-04-02T23:18:41.411 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:41.457 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:41 +0000 (0:00:00.052) 0:01:42.378 ******** 2020-04-02T23:18:41.463 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2020-04-02T23:18:41.501 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:41 +0000 (0:00:00.044) 0:01:42.422 ******** 2020-04-02T23:18:41.506 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2020-04-02T23:18:41.509 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:41.548 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:41 +0000 (0:00:00.044) 0:01:42.467 ******** 2020-04-02T23:18:41.553 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2020-04-02T23:18:41.555 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:41.600 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:41 +0000 (0:00:00.054) 0:01:42.521 ******** 2020-04-02T23:18:41.605 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2020-04-02T23:18:41.605 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-04-02T23:18:41.607 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-04-02T23:18:41.646 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:41 +0000 (0:00:00.045) 0:01:42.567 ******** 2020-04-02T23:18:41.652 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2020-04-02T23:18:41.653 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:41.690 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:41 +0000 (0:00:00.044) 0:01:42.611 ******** 2020-04-02T23:18:41.695 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2020-04-02T23:18:41.696 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:41.736 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:41 +0000 (0:00:00.046) 0:01:42.657 ******** 2020-04-02T23:18:41.742 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2020-04-02T23:18:41.742 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-04-02T23:18:41.743 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-04-02T23:18:41.781 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:41 +0000 (0:00:00.044) 0:01:42.702 ******** 2020-04-02T23:18:41.786 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2020-04-02T23:18:41.824 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:41 +0000 (0:00:00.043) 0:01:42.745 ******** 2020-04-02T23:18:41.829 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2020-04-02T23:18:41.832 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:41.868 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:41 +0000 (0:00:00.043) 0:01:42.789 ******** 2020-04-02T23:18:41.874 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2020-04-02T23:18:41.875 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:41.913 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:41 +0000 (0:00:00.044) 0:01:42.834 ******** 2020-04-02T23:18:41.919 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2020-04-02T23:18:41.958 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:41 +0000 (0:00:00.044) 0:01:42.879 ******** 2020-04-02T23:18:41.963 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2020-04-02T23:18:41.964 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:42.003 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:41 +0000 (0:00:00.044) 0:01:42.924 ******** 2020-04-02T23:18:42.009 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2020-04-02T23:18:42.010 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:42.047 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:42 +0000 (0:00:00.043) 0:01:42.967 ******** 2020-04-02T23:18:42.054 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2020-04-02T23:18:42.056 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:42.091 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:42 +0000 (0:00:00.044) 0:01:43.012 ******** 2020-04-02T23:18:42.097 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2020-04-02T23:18:42.099 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:42.136 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:42 +0000 (0:00:00.044) 0:01:43.057 ******** 2020-04-02T23:18:42.141 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-04-02T23:18:42.142 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:42.180 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:42 +0000 (0:00:00.043) 0:01:43.100 ******** 2020-04-02T23:18:42.185 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2020-04-02T23:18:42.187 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:42.223 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:42 +0000 (0:00:00.043) 0:01:43.144 ******** 2020-04-02T23:18:42.238 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:42.266 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:42 +0000 (0:00:00.042) 0:01:43.187 ******** 2020-04-02T23:18:42.272 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-04-02T23:18:42.274 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:42.309 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:42 +0000 (0:00:00.043) 0:01:43.230 ******** 2020-04-02T23:18:42.314 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-04-02T23:18:42.316 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:42.357 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:42 +0000 (0:00:00.047) 0:01:43.278 ******** 2020-04-02T23:18:42.361 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2020-04-02T23:18:42.363 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:42.400 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:42 +0000 (0:00:00.043) 0:01:43.321 ******** 2020-04-02T23:18:42.406 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2020-04-02T23:18:42.408 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:42.458 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:42 +0000 (0:00:00.057) 0:01:43.378 ******** 2020-04-02T23:18:42.465 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-04-02T23:18:42.466 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:42.515 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:42 +0000 (0:00:00.057) 0:01:43.436 ******** 2020-04-02T23:18:42.532 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2020-04-02T23:18:42.533 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:42.580 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:42 +0000 (0:00:00.064) 0:01:43.501 ******** 2020-04-02T23:18:42.590 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:42.627 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:42 +0000 (0:00:00.046) 0:01:43.548 ******** 2020-04-02T23:18:42.632 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2020-04-02T23:18:42.632 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:42.672 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:42 +0000 (0:00:00.045) 0:01:43.593 ******** 2020-04-02T23:18:42.678 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2020-04-02T23:18:42.679 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:42.716 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:42 +0000 (0:00:00.043) 0:01:43.637 ******** 2020-04-02T23:18:42.721 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2020-04-02T23:18:42.722 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:42.763 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:42 +0000 (0:00:00.043) 0:01:43.681 ******** 2020-04-02T23:18:42.768 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2020-04-02T23:18:42.769 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:42.805 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:42 +0000 (0:00:00.045) 0:01:43.726 ******** 2020-04-02T23:18:42.810 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2020-04-02T23:18:42.811 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:42.850 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:42 +0000 (0:00:00.044) 0:01:43.770 ******** 2020-04-02T23:18:42.854 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2020-04-02T23:18:42.856 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:42.893 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:42 +0000 (0:00:00.043) 0:01:43.814 ******** 2020-04-02T23:18:42.898 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2020-04-02T23:18:42.899 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:42.937 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:42 +0000 (0:00:00.044) 0:01:43.858 ******** 2020-04-02T23:18:42.943 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2020-04-02T23:18:42.945 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:42.982 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:42 +0000 (0:00:00.044) 0:01:43.903 ******** 2020-04-02T23:18:42.988 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2020-04-02T23:18:42.990 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:43.027 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:43 +0000 (0:00:00.044) 0:01:43.948 ******** 2020-04-02T23:18:43.032 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2020-04-02T23:18:43.033 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:43.070 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:43 +0000 (0:00:00.042) 0:01:43.991 ******** 2020-04-02T23:18:43.075 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2020-04-02T23:18:43.077 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:43.114 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:43 +0000 (0:00:00.043) 0:01:44.034 ******** 2020-04-02T23:18:43.119 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2020-04-02T23:18:43.120 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:43.157 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:43 +0000 (0:00:00.043) 0:01:44.078 ******** 2020-04-02T23:18:43.162 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-04-02T23:18:43.162 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:43.202 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:43 +0000 (0:00:00.044) 0:01:44.123 ******** 2020-04-02T23:18:43.207 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2020-04-02T23:18:43.209 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:43.246 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:43 +0000 (0:00:00.044) 0:01:44.167 ******** 2020-04-02T23:18:43.251 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-04-02T23:18:43.252 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:43.295 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:43 +0000 (0:00:00.049) 0:01:44.216 ******** 2020-04-02T23:18:43.303 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-04-02T23:18:43.304 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:43.340 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:43 +0000 (0:00:00.044) 0:01:44.261 ******** 2020-04-02T23:18:43.345 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-04-02T23:18:43.346 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:43.384 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:43 +0000 (0:00:00.044) 0:01:44.305 ******** 2020-04-02T23:18:43.389 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-04-02T23:18:43.390 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:43.427 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:43 +0000 (0:00:00.043) 0:01:44.348 ******** 2020-04-02T23:18:43.432 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-04-02T23:18:43.433 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:43.471 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:43 +0000 (0:00:00.043) 0:01:44.392 ******** 2020-04-02T23:18:43.476 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:43.513 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:43 +0000 (0:00:00.042) 0:01:44.434 ******** 2020-04-02T23:18:43.520 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-04-02T23:18:43.522 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:43.556 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:43 +0000 (0:00:00.042) 0:01:44.477 ******** 2020-04-02T23:18:43.561 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-04-02T23:18:43.563 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:43.599 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:43 +0000 (0:00:00.042) 0:01:44.520 ******** 2020-04-02T23:18:43.603 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-04-02T23:18:43.604 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:43.642 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:43 +0000 (0:00:00.042) 0:01:44.563 ******** 2020-04-02T23:18:43.647 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-04-02T23:18:43.648 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:43.685 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:43 +0000 (0:00:00.042) 0:01:44.606 ******** 2020-04-02T23:18:43.689 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-04-02T23:18:43.690 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:43.728 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:43 +0000 (0:00:00.042) 0:01:44.648 ******** 2020-04-02T23:18:43.737 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:43.778 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:43 +0000 (0:00:00.044) 0:01:44.693 ******** TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:43.818 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:43 +0000 (0:00:00.045) 0:01:44.739 ******** 2020-04-02T23:18:43.823 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-04-02T23:18:43.825 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:43.867 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:43 +0000 (0:00:00.048) 0:01:44.787 ******** 2020-04-02T23:18:43.872 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-02T23:18:43.873 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:43.911 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:43 +0000 (0:00:00.044) 0:01:44.832 ******** 2020-04-02T23:18:43.915 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-04-02T23:18:43.918 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:43.954 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:43 +0000 (0:00:00.043) 0:01:44.875 ******** 2020-04-02T23:18:43.959 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-04-02T23:18:43.961 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:43.998 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:43 +0000 (0:00:00.043) 0:01:44.919 ******** 2020-04-02T23:18:44.003 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-02T23:18:44.006 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:44.041 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:44 +0000 (0:00:00.043) 0:01:44.962 ******** 2020-04-02T23:18:44.048 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-04-02T23:18:44.050 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:44.085 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:44 +0000 (0:00:00.044) 0:01:45.006 ******** 2020-04-02T23:18:44.090 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-04-02T23:18:44.092 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:44.128 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:44 +0000 (0:00:00.042) 0:01:45.049 ******** 2020-04-02T23:18:44.133 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-04-02T23:18:44.134 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:44.171 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:44 +0000 (0:00:00.042) 0:01:45.092 ******** 2020-04-02T23:18:44.176 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-04-02T23:18:44.178 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:44.216 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:44 +0000 (0:00:00.045) 0:01:45.137 ******** 2020-04-02T23:18:44.221 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-04-02T23:18:44.221 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:44.260 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:44 +0000 (0:00:00.043) 0:01:45.181 ******** 2020-04-02T23:18:44.267 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-04-02T23:18:44.269 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:44.304 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:44 +0000 (0:00:00.044) 0:01:45.225 ******** 2020-04-02T23:18:44.341 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-04-02T23:18:44.343 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:44.380 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:44 +0000 (0:00:00.073) 0:01:45.299 ******** 2020-04-02T23:18:44.476 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-04-02T23:18:44.477 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} 2020-04-02T23:18:44.516 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:44 +0000 (0:00:00.136) 0:01:45.436 ******** 2020-04-02T23:18:44.589 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} 2020-04-02T23:18:44.635 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:44 +0000 (0:00:00.114) 0:01:45.550 ******** 2020-04-02T23:18:44.728 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-04-02T23:18:44.728 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-04-02T23:18:44.772 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:44 +0000 (0:00:00.137) 0:01:45.688 ******** 2020-04-02T23:18:44.846 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-04-02T23:18:44.885 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:44 +0000 (0:00:00.117) 0:01:45.806 ******** 2020-04-02T23:18:44.975 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** [WARNING]: Cannot set fs attributes on a non-existent symlink target. follow should be set to False to avoid this. 2020-04-02T23:18:44.979 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2020-04-02T23:18:45.020 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:45 +0000 (0:00:00.135) 0:01:45.941 ******** 2020-04-02T23:18:45.047 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-04-02T23:18:45.049 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:45.090 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:45 +0000 (0:00:00.070) 0:01:46.011 ******** 2020-04-02T23:18:45.096 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-04-02T23:18:45.098 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2020-04-02T23:18:45.136 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:45 +0000 (0:00:00.045) 0:01:46.057 ******** 2020-04-02T23:18:45.142 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-04-02T23:18:45.142 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:45.181 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:45 +0000 (0:00:00.044) 0:01:46.102 ******** 2020-04-02T23:18:45.187 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-04-02T23:18:45.190 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:45.226 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:45 +0000 (0:00:00.044) 0:01:46.147 ******** 2020-04-02T23:18:45.232 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-04-02T23:18:45.234 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:45.272 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:45 +0000 (0:00:00.045) 0:01:46.193 ******** 2020-04-02T23:18:45.278 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-04-02T23:18:45.280 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:45.320 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:45 +0000 (0:00:00.048) 0:01:46.241 ******** 2020-04-02T23:18:45.328 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-04-02T23:18:45.329 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:45.368 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:45 +0000 (0:00:00.047) 0:01:46.288 ******** 2020-04-02T23:18:45.373 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-04-02T23:18:45.374 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:45.411 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:45 +0000 (0:00:00.043) 0:01:46.332 ******** 2020-04-02T23:18:45.416 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-04-02T23:18:45.418 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:45.456 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:45 +0000 (0:00:00.044) 0:01:46.377 ******** 2020-04-02T23:18:45.461 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-04-02T23:18:45.463 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:45.500 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:45 +0000 (0:00:00.043) 0:01:46.420 ******** 2020-04-02T23:18:45.505 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-04-02T23:18:45.505 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:45.544 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:45 +0000 (0:00:00.044) 0:01:46.465 ******** 2020-04-02T23:18:45.556 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-04-02T23:18:45.558 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:45.593 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:45 +0000 (0:00:00.048) 0:01:46.513 ******** 2020-04-02T23:18:45.597 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-04-02T23:18:45.599 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:45.636 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:45 +0000 (0:00:00.043) 0:01:46.557 ******** 2020-04-02T23:18:45.645 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-04-02T23:18:45.646 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:45.689 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:45 +0000 (0:00:00.053) 0:01:46.610 ******** 2020-04-02T23:18:45.695 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-04-02T23:18:45.704 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:45.737 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:45 +0000 (0:00:00.047) 0:01:46.658 ******** 2020-04-02T23:18:45.743 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:45.784 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:45 +0000 (0:00:00.047) 0:01:46.705 ******** 2020-04-02T23:18:45.791 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-04-02T23:18:45.791 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:45.837 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:45 +0000 (0:00:00.048) 0:01:46.754 ******** 2020-04-02T23:18:45.842 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:45.879 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:45 +0000 (0:00:00.046) 0:01:46.800 ******** 2020-04-02T23:18:45.887 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:45.924 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:45 +0000 (0:00:00.044) 0:01:46.845 ******** 2020-04-02T23:18:45.930 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-04-02T23:18:45.930 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:45.979 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:45 +0000 (0:00:00.053) 0:01:46.898 ******** 2020-04-02T23:18:45.985 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2020-04-02T23:18:45.986 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:46.028 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:46 +0000 (0:00:00.050) 0:01:46.949 ******** 2020-04-02T23:18:46.034 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2020-04-02T23:18:46.035 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:46.078 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:46 +0000 (0:00:00.049) 0:01:46.999 ******** 2020-04-02T23:18:46.083 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-04-02T23:18:46.085 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:46.137 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:46 +0000 (0:00:00.049) 0:01:47.048 ******** TASK [testnode : Remove /etc/ceph] ********************************************* skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:46.188 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:46 +0000 (0:00:00.060) 0:01:47.109 ******** 2020-04-02T23:18:46.193 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-04-02T23:18:46.195 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:46.239 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:46 +0000 (0:00:00.046) 0:01:47.155 ******** 2020-04-02T23:18:46.244 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:46.287 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:46 +0000 (0:00:00.052) 0:01:47.208 ******** 2020-04-02T23:18:46.292 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2020-04-02T23:18:46.294 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:46.334 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:46 +0000 (0:00:00.047) 0:01:47.255 ******** 2020-04-02T23:18:46.343 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-04-02T23:18:46.344 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:46.381 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:46 +0000 (0:00:00.046) 0:01:47.302 ******** 2020-04-02T23:18:46.387 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2020-04-02T23:18:46.387 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:46.426 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:46 +0000 (0:00:00.044) 0:01:47.347 ******** 2020-04-02T23:18:46.432 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2020-04-02T23:18:46.438 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:46.473 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:46 +0000 (0:00:00.047) 0:01:47.394 ******** 2020-04-02T23:18:46.479 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2020-04-02T23:18:46.481 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:46.519 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:46 +0000 (0:00:00.045) 0:01:47.440 ******** 2020-04-02T23:18:46.525 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2020-04-02T23:18:46.527 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:46.565 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:46 +0000 (0:00:00.045) 0:01:47.486 ******** 2020-04-02T23:18:46.570 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2020-04-02T23:18:46.571 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:46.610 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:46 +0000 (0:00:00.045) 0:01:47.531 ******** 2020-04-02T23:18:46.616 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2020-04-02T23:18:46.617 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:46.657 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:46 +0000 (0:00:00.044) 0:01:47.576 ******** 2020-04-02T23:18:46.662 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2020-04-02T23:18:46.663 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:46.709 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:46 +0000 (0:00:00.046) 0:01:47.623 ******** TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:46.751 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:46 +0000 (0:00:00.049) 0:01:47.672 ******** 2020-04-02T23:18:46.758 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2020-04-02T23:18:46.758 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:46.802 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:46 +0000 (0:00:00.050) 0:01:47.723 ******** 2020-04-02T23:18:46.813 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:46.849 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:46 +0000 (0:00:00.047) 0:01:47.770 ******** 2020-04-02T23:18:46.854 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2020-04-02T23:18:46.855 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:46.898 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:46 +0000 (0:00:00.048) 0:01:47.819 ******** 2020-04-02T23:18:46.912 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2020-04-02T23:18:46.913 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:46.951 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:46 +0000 (0:00:00.052) 0:01:47.872 ******** 2020-04-02T23:18:46.957 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:46.997 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:46 +0000 (0:00:00.045) 0:01:47.918 ******** 2020-04-02T23:18:47.003 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:47.043 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:47 +0000 (0:00:00.046) 0:01:47.964 ******** 2020-04-02T23:18:47.048 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2020-04-02T23:18:47.053 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:47.090 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:47 +0000 (0:00:00.047) 0:01:48.011 ******** 2020-04-02T23:18:47.098 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:47.138 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:47 +0000 (0:00:00.047) 0:01:48.059 ******** 2020-04-02T23:18:47.146 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-02T23:18:47.148 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-04-02T23:18:47.184 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:47 +0000 (0:00:00.045) 0:01:48.105 ******** 2020-04-02T23:18:47.190 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2020-04-02T23:18:47.192 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:47.232 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:47 +0000 (0:00:00.047) 0:01:48.153 ******** 2020-04-02T23:18:47.237 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2020-04-02T23:18:47.239 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} ok: [smithi174.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2020-04-02T23:18:47.250 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2020-04-02T23:18:47.261 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2020-04-02T23:18:47.262 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-02T23:18:47.262 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-04-02T23:18:47.264 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi174.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-04-02T23:18:47.307 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:47 +0000 (0:00:00.075) 0:01:48.228 ******** 2020-04-02T23:18:47.313 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2020-04-02T23:18:47.314 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2020-04-02T23:18:47.365 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:47 +0000 (0:00:00.054) 0:01:48.283 ******** 2020-04-02T23:18:47.369 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2020-04-02T23:18:47.372 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} skipping: [smithi196.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2020-04-02T23:18:47.382 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2020-04-02T23:18:47.393 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-04-02T23:18:47.393 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2020-04-02T23:18:47.405 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2020-04-02T23:18:47.447 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:47 +0000 (0:00:00.085) 0:01:48.368 ******** 2020-04-02T23:18:47.567 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2020-04-02T23:18:47.569 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003398", "end": "2020-04-02 23:18:47.544748", "rc": 0, "start": "2020-04-02 23:18:47.541350", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2020-04-02T23:18:47.619 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:47 +0000 (0:00:00.171) 0:01:48.540 ******** 2020-04-02T23:18:47.626 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.010757", "end": "2020-04-02 23:18:47.590557", "rc": 0, "start": "2020-04-02 23:18:47.579800", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2020-04-02T23:18:47.668 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:47 +0000 (0:00:00.048) 0:01:48.588 ******** 2020-04-02T23:18:47.672 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2020-04-02T23:18:47.674 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:47.716 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:47 +0000 (0:00:00.047) 0:01:48.636 ******** 2020-04-02T23:18:47.721 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:47.764 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:47 +0000 (0:00:00.048) 0:01:48.685 ******** 2020-04-02T23:18:47.769 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2020-04-02T23:18:47.771 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:47.809 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:47 +0000 (0:00:00.045) 0:01:48.730 ******** 2020-04-02T23:18:47.815 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:47.853 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:47 +0000 (0:00:00.043) 0:01:48.773 ******** 2020-04-02T23:18:47.858 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:47.898 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:47 +0000 (0:00:00.045) 0:01:48.819 ******** 2020-04-02T23:18:47.906 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:47.950 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:47 +0000 (0:00:00.051) 0:01:48.870 ******** 2020-04-02T23:18:47.954 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2020-04-02T23:18:47.955 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:47.998 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:47 +0000 (0:00:00.048) 0:01:48.919 ******** 2020-04-02T23:18:48.004 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:48.043 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:48 +0000 (0:00:00.044) 0:01:48.964 ******** 2020-04-02T23:18:48.902 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2020-04-02T23:18:48.902 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: gdisk", "Installed: device-mapper"]} 2020-04-02T23:18:48.953 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:48 +0000 (0:00:00.910) 0:01:49.874 ******** 2020-04-02T23:18:48.959 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: gdisk", "Installed: device-mapper"]} 2020-04-02T23:18:48.999 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:48 +0000 (0:00:00.046) 0:01:49.920 ******** 2020-04-02T23:18:49.006 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-04-02T23:18:49.006 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'block_used': 12911789, u'uuid': u'02783226-4726-4004-a66c-c6bc58415d09', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227183319, u'size_available': 930542874624, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60990063, u'device': u'/dev/sda1', u'inode_used': 64913, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227183319, "block_size": 4096, "block_total": 240095108, "block_used": 12911789, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60990063, "inode_total": 61054976, "inode_used": 64913, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930542874624, "size_total": 983429562368, "uuid": "02783226-4726-4004-a66c-c6bc58415d09"}} 2020-04-02T23:18:49.048 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:49 +0000 (0:00:00.048) 0:01:49.969 ******** 2020-04-02T23:18:49.054 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item={u'block_used': 12911796, u'uuid': u'02783226-4726-4004-a66c-c6bc58415d09', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227183312, u'size_available': 930542845952, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60990058, u'device': u'/dev/sda1', u'inode_used': 64918, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227183312, "block_size": 4096, "block_total": 240095108, "block_used": 12911796, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60990058, "inode_total": 61054976, "inode_used": 64918, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930542845952, "size_total": 983429562368, "uuid": "02783226-4726-4004-a66c-c6bc58415d09"}} 2020-04-02T23:18:49.093 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:49 +0000 (0:00:00.044) 0:01:50.014 ******** 2020-04-02T23:18:49.238 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2020-04-02T23:18:49.238 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.005020", "end": "2020-04-02 23:18:49.218502", "rc": 0, "start": "2020-04-02 23:18:49.213482", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:18:49.283 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:49 +0000 (0:00:00.190) 0:01:50.204 ******** 2020-04-02T23:18:49.301 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.005051", "end": "2020-04-02 23:18:49.270691", "rc": 0, "start": "2020-04-02 23:18:49.265640", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:18:49.341 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:49 +0000 (0:00:00.057) 0:01:50.262 ******** 2020-04-02T23:18:49.347 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2020-04-02T23:18:49.347 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'block_used': 12911789, u'uuid': u'02783226-4726-4004-a66c-c6bc58415d09', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227183319, u'size_available': 930542874624, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60990063, u'device': u'/dev/sda1', u'inode_used': 64913, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227183319, "block_size": 4096, "block_total": 240095108, "block_used": 12911789, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60990063, "inode_total": 61054976, "inode_used": 64913, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930542874624, "size_total": 983429562368, "uuid": "02783226-4726-4004-a66c-c6bc58415d09"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:49.388 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:49 +0000 (0:00:00.046) 0:01:50.309 ******** 2020-04-02T23:18:49.394 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'block_used': 12911796, u'uuid': u'02783226-4726-4004-a66c-c6bc58415d09', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227183312, u'size_available': 930542845952, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60990058, u'device': u'/dev/sda1', u'inode_used': 64918, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227183312, "block_size": 4096, "block_total": 240095108, "block_used": 12911796, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60990058, "inode_total": 61054976, "inode_used": 64918, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930542845952, "size_total": 983429562368, "uuid": "02783226-4726-4004-a66c-c6bc58415d09"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:49.440 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:49 +0000 (0:00:00.051) 0:01:50.360 ******** 2020-04-02T23:18:49.444 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-04-02T23:18:49.487 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:49 +0000 (0:00:00.047) 0:01:50.408 ******** 2020-04-02T23:18:49.541 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:49 +0000 (0:00:00.052) 0:01:50.461 ******** 2020-04-02T23:18:49.546 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-04-02T23:18:49.548 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XN3Z', u'wwn-0x5000c50092940234'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5XN3Z', u'wwn': u'0x5000c50092940234', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'mq-deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'02783226-4726-4004-a66c-c6bc58415d09', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XN3Z-part1', u'wwn-0x5000c50092940234-part1'], u'uuids': [u'02783226-4726-4004-a66c-c6bc58415d09']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XN3Z", "wwn-0x5000c50092940234"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XN3Z-part1", "wwn-0x5000c50092940234-part1"], "labels": [], "masters": [], "uuids": ["02783226-4726-4004-a66c-c6bc58415d09"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "02783226-4726-4004-a66c-c6bc58415d09"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XN3Z", "size": "931.51 GB", "support_discard": "0", "vend 2020-04-02T23:18:49.549 INFO:teuthology.task.ansible.out:or": "ATA", "virtual": 1, "wwn": "0x5000c50092940234"}}, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:49.582 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XGPQ', u'wwn-0x5000c50092928bab'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5XGPQ', u'wwn': u'0x5000c50092928bab', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'mq-deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'02783226-4726-4004-a66c-c6bc58415d09', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XGPQ-part1', u'wwn-0x5000c50092928bab-part1'], u'uuids': [u'02783226-4726-4004-a66c-c6bc58415d09']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XGPQ", "wwn-0x5000c50092928bab"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XGPQ-part1", "wwn-0x5000c50092928bab-part1"], "labels": [], "masters": [], "uuids": ["02783226-4726-4004-a66c-c6bc58415d09"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "02783226-4726-4004-a66c-c6bc58415d09"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XGPQ", "size": "931.51 GB", "support_discard": "0", "vend 2020-04-02T23:18:49.583 INFO:teuthology.task.ansible.out:or": "ATA", "virtual": 1, "wwn": "0x5000c50092928bab"}}, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:51.190 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-RnzFhj-cOu7-nPMI-seys-ClLa-UMrv-Ud7vCo', u'nvme-INTEL_SSDPEDMD400G4_PHFT62050074400BGN', u'nvme-nvme.8086-50484654363230353030373434303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_4', u'vg_nvme-lv_1', u'vg_nvme-lv_3', u'vg_nvme-lv_5', u'vg_nvme-lv_2'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.452656", "end": "2020-04-02 23:18:51.151000", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_4", "vg_nvme-lv_1", "vg_nvme-lv_3", "vg_nvme-lv_5", "vg_nvme-lv_2"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-RnzFhj-cOu7-nPMI-seys-ClLa-UMrv-Ud7vCo", "nvme-INTEL_SSDPEDMD400G4_PHFT62050074400BGN", "nvme-nvme.8086-50484654363230353030373434303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:18:49.698344", "stderr": "", "stderr_lines": [], "stdout": "Creating new GP 2020-04-02T23:18:51.192 INFO:teuthology.task.ansible.out:T entries.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-02T23:18:51.318 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-EF2OlG-Vdwr-Pe0S-tSKY-E2Xm-hiAn-EYTNYV', u'nvme-INTEL_SSDPEDMD400G4_CVFT6246000Z400BGN', u'nvme-nvme.8086-43564654363234363030305a34303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_4', u'vg_nvme-lv_1', u'vg_nvme-lv_3', u'vg_nvme-lv_5', u'vg_nvme-lv_2'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.546887", "end": "2020-04-02 23:18:51.286499", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_4", "vg_nvme-lv_1", "vg_nvme-lv_3", "vg_nvme-lv_5", "vg_nvme-lv_2"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-EF2OlG-Vdwr-Pe0S-tSKY-E2Xm-hiAn-EYTNYV", "nvme-INTEL_SSDPEDMD400G4_CVFT6246000Z400BGN", "nvme-nvme.8086-43564654363234363030305a34303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:18:49.739612", "stderr": "", "stderr_lines": [], "stdout": "Creating new GP 2020-04-02T23:18:51.319 INFO:teuthology.task.ansible.out:T entries.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-02T23:18:52.470 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-cly0MwHSiviEOPouQrewtc1wtxQwUYCp00a6emceKREVPuadWCIcyQXtNS4QzJdo'], u'uuids': [u'8e5cc9d2-f08f-44c4-8f8f-4c997d20f377']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.076027", "end": "2020-04-02 23:18:52.432838", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-cly0MwHSiviEOPouQrewtc1wtxQwUYCp00a6emceKREVPuadWCIcyQXtNS4QzJdo"], "labels": [], "masters": [], "uuids": ["8e5cc9d2-f08f-44c4-8f8f-4c997d20f377"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:18:51.356811", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-02T23:18:52.554 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-e48egT7Iv3nhtEdv9Tx51VOU9Ef5qo9qTz84zDgW6s30kYjhKc375C3O7jlDRujH'], u'uuids': [u'1cc94287-3dd0-4b9b-b278-97d8be5e22f6']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.044161", "end": "2020-04-02 23:18:52.524851", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-e48egT7Iv3nhtEdv9Tx51VOU9Ef5qo9qTz84zDgW6s30kYjhKc375C3O7jlDRujH"], "labels": [], "masters": [], "uuids": ["1cc94287-3dd0-4b9b-b278-97d8be5e22f6"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:18:51.480690", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-02T23:18:53.725 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-cly0MwHSiviEOPouQrewtc1wtxQwUYCpNictEwkZnExLyZjkXTPHex5lKgXVB508'], u'uuids': [u'850e8cf7-0124-48e1-9cbe-d77ef564347f']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.062733", "end": "2020-04-02 23:18:53.689732", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-cly0MwHSiviEOPouQrewtc1wtxQwUYCpNictEwkZnExLyZjkXTPHex5lKgXVB508"], "labels": [], "masters": [], "uuids": ["850e8cf7-0124-48e1-9cbe-d77ef564347f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:18:52.626999", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-02T23:18:53.799 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-e48egT7Iv3nhtEdv9Tx51VOU9Ef5qo9q1Yqid1qRAiKCNzWD7hVnef8soCHWtwpx'], u'uuids': [u'5fabdef3-15cf-45ed-a34d-bfd049784fac']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.045407", "end": "2020-04-02 23:18:53.765061", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-e48egT7Iv3nhtEdv9Tx51VOU9Ef5qo9q1Yqid1qRAiKCNzWD7hVnef8soCHWtwpx"], "labels": [], "masters": [], "uuids": ["5fabdef3-15cf-45ed-a34d-bfd049784fac"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:18:52.719654", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-02T23:18:54.974 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-cly0MwHSiviEOPouQrewtc1wtxQwUYCpXuj9Bw6Uu7DUd6zwjRgeOAO6JF00vwv0'], u'uuids': [u'2fc0f93a-8071-40a0-a8dd-6ba7e1d57fe4']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.055317", "end": "2020-04-02 23:18:54.939279", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-cly0MwHSiviEOPouQrewtc1wtxQwUYCpXuj9Bw6Uu7DUd6zwjRgeOAO6JF00vwv0"], "labels": [], "masters": [], "uuids": ["2fc0f93a-8071-40a0-a8dd-6ba7e1d57fe4"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:18:53.883962", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-02T23:18:55.090 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-e48egT7Iv3nhtEdv9Tx51VOU9Ef5qo9qziESITLep8yyirL2fHIl4tQVcstLb2qf'], u'uuids': [u'ed399876-c007-434e-909c-ab04dc42c693']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.072501", "end": "2020-04-02 23:18:55.057691", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-e48egT7Iv3nhtEdv9Tx51VOU9Ef5qo9qziESITLep8yyirL2fHIl4tQVcstLb2qf"], "labels": [], "masters": [], "uuids": ["ed399876-c007-434e-909c-ab04dc42c693"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:18:53.985190", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-02T23:18:56.231 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-cly0MwHSiviEOPouQrewtc1wtxQwUYCpR2mRhfToy22zIc1bvqUkiMjJxL55rhUa'], u'uuids': [u'640e9890-6b18-4ce0-986c-3f156a57642f']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.063686", "end": "2020-04-02 23:18:56.197595", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-cly0MwHSiviEOPouQrewtc1wtxQwUYCpR2mRhfToy22zIc1bvqUkiMjJxL55rhUa"], "labels": [], "masters": [], "uuids": ["640e9890-6b18-4ce0-986c-3f156a57642f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:18:55.133909", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-02T23:18:56.358 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-e48egT7Iv3nhtEdv9Tx51VOU9Ef5qo9qn3XdbVfv3fovcjLa3onWzHCd1rY7RI8M'], u'uuids': [u'76264769-5ea0-4835-b318-6b307ba91744']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.070114", "end": "2020-04-02 23:18:56.320251", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-e48egT7Iv3nhtEdv9Tx51VOU9Ef5qo9qn3XdbVfv3fovcjLa3onWzHCd1rY7RI8M"], "labels": [], "masters": [], "uuids": ["76264769-5ea0-4835-b318-6b307ba91744"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:18:55.250137", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-02T23:18:57.468 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-cly0MwHSiviEOPouQrewtc1wtxQwUYCpbHIJbeuhLZpixMMnFWa5WXResshm352m'], u'uuids': [u'5a1da162-0da5-4c9f-8d6e-7f9bb7599118']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.042064", "end": "2020-04-02 23:18:57.432079", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-cly0MwHSiviEOPouQrewtc1wtxQwUYCpbHIJbeuhLZpixMMnFWa5WXResshm352m"], "labels": [], "masters": [], "uuids": ["5a1da162-0da5-4c9f-8d6e-7f9bb7599118"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:18:56.390015", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-02T23:18:57.523 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:57 +0000 (0:00:07.982) 0:01:58.444 ******** 2020-04-02T23:18:57.562 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-04-02T23:18:57.563 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XN3Z', u'wwn-0x5000c50092940234'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5XN3Z', u'wwn': u'0x5000c50092940234', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'mq-deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'02783226-4726-4004-a66c-c6bc58415d09', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XN3Z-part1', u'wwn-0x5000c50092940234-part1'], u'uuids': [u'02783226-4726-4004-a66c-c6bc58415d09']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XN3Z", "wwn-0x5000c50092940234"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XN3Z-part1", "wwn-0x5000c50092940234-part1"], "labels": [], "masters": [], "uuids": ["02783226-4726-4004-a66c-c6bc58415d09"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "02783226-4726-4004-a66c-c6bc58415d09"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XN3Z", "size": "931.51 GB", "support_discard": "0", "vend 2020-04-02T23:18:57.565 INFO:teuthology.task.ansible.out:or": "ATA", "virtual": 1, "wwn": "0x5000c50092940234"}}, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:57.660 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-04-02T23:18:57.661 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-e48egT7Iv3nhtEdv9Tx51VOU9Ef5qo9qChcL4gtsdPsjRN52EiEZeHQiPtmJwM1I'], u'uuids': [u'ce70f5ed-068e-45fa-86be-43cc89847f6d']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.092275", "end": "2020-04-02 23:18:57.624545", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-e48egT7Iv3nhtEdv9Tx51VOU9Ef5qo9qChcL4gtsdPsjRN52EiEZeHQiPtmJwM1I"], "labels": [], "masters": [], "uuids": ["ce70f5ed-068e-45fa-86be-43cc89847f6d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:18:56.532270", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-02T23:18:57.709 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:57 +0000 (0:00:00.186) 0:01:58.630 ******** 2020-04-02T23:18:57.770 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-04-02T23:18:57.771 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XGPQ', u'wwn-0x5000c50092928bab'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5XGPQ', u'wwn': u'0x5000c50092928bab', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'mq-deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'02783226-4726-4004-a66c-c6bc58415d09', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XGPQ-part1', u'wwn-0x5000c50092928bab-part1'], u'uuids': [u'02783226-4726-4004-a66c-c6bc58415d09']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XGPQ", "wwn-0x5000c50092928bab"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XGPQ-part1", "wwn-0x5000c50092928bab-part1"], "labels": [], "masters": [], "uuids": ["02783226-4726-4004-a66c-c6bc58415d09"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "02783226-4726-4004-a66c-c6bc58415d09"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XGPQ", "size": "931.51 GB", "support_discard": "0", "vend 2020-04-02T23:18:57.773 INFO:teuthology.task.ansible.out:or": "ATA", "virtual": 1, "wwn": "0x5000c50092928bab"}}, "skip_reason": "Conditional result was False"} 2020-04-02T23:18:57.798 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-RnzFhj-cOu7-nPMI-seys-ClLa-UMrv-Ud7vCo', u'nvme-INTEL_SSDPEDMD400G4_PHFT62050074400BGN', u'nvme-nvme.8086-50484654363230353030373434303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_4', u'vg_nvme-lv_1', u'vg_nvme-lv_3', u'vg_nvme-lv_5', u'vg_nvme-lv_2'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.037554", "end": "2020-04-02 23:18:57.770899", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_4", "vg_nvme-lv_1", "vg_nvme-lv_3", "vg_nvme-lv_5", "vg_nvme-lv_2"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-RnzFhj-cOu7-nPMI-seys-ClLa-UMrv-Ud7vCo", "nvme-INTEL_SSDPEDMD400G4_PHFT62050074400BGN", "nvme-nvme.8086-50484654363230353030373434303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:18:57.733345", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 11 2020-04-02T23:18:57.800 INFO:teuthology.task.ansible.out:0 MiB) copied, 0.0346994 s, 3.3 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0346994 s, 3.3 GB/s"], "stdout": "", "stdout_lines": []} 2020-04-02T23:18:58.001 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-EF2OlG-Vdwr-Pe0S-tSKY-E2Xm-hiAn-EYTNYV', u'nvme-INTEL_SSDPEDMD400G4_CVFT6246000Z400BGN', u'nvme-nvme.8086-43564654363234363030305a34303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_4', u'vg_nvme-lv_1', u'vg_nvme-lv_3', u'vg_nvme-lv_5', u'vg_nvme-lv_2'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.037283", "end": "2020-04-02 23:18:57.978030", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_4", "vg_nvme-lv_1", "vg_nvme-lv_3", "vg_nvme-lv_5", "vg_nvme-lv_2"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-EF2OlG-Vdwr-Pe0S-tSKY-E2Xm-hiAn-EYTNYV", "nvme-INTEL_SSDPEDMD400G4_CVFT6246000Z400BGN", "nvme-nvme.8086-43564654363234363030305a34303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:18:57.940747", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 11 2020-04-02T23:18:58.002 INFO:teuthology.task.ansible.out:0 MiB) copied, 0.0346671 s, 3.3 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0346671 s, 3.3 GB/s"], "stdout": "", "stdout_lines": []} 2020-04-02T23:18:58.127 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-cly0MwHSiviEOPouQrewtc1wtxQwUYCp00a6emceKREVPuadWCIcyQXtNS4QzJdo'], u'uuids': [u'8e5cc9d2-f08f-44c4-8f8f-4c997d20f377']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.140464", "end": "2020-04-02 23:18:58.104370", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-cly0MwHSiviEOPouQrewtc1wtxQwUYCp00a6emceKREVPuadWCIcyQXtNS4QzJdo"], "labels": [], "masters": [], "uuids": ["8e5cc9d2-f08f-44c4-8f8f-4c997d20f377"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:18:57.963906", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.137874 s, 837 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.137874 s, 837 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-02T23:18:58.353 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-e48egT7Iv3nhtEdv9Tx51VOU9Ef5qo9qTz84zDgW6s30kYjhKc375C3O7jlDRujH'], u'uuids': [u'1cc94287-3dd0-4b9b-b278-97d8be5e22f6']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.144692", "end": "2020-04-02 23:18:58.318450", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-e48egT7Iv3nhtEdv9Tx51VOU9Ef5qo9qTz84zDgW6s30kYjhKc375C3O7jlDRujH"], "labels": [], "masters": [], "uuids": ["1cc94287-3dd0-4b9b-b278-97d8be5e22f6"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:18:58.173758", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.142042 s, 812 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.142042 s, 812 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-02T23:18:58.474 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-cly0MwHSiviEOPouQrewtc1wtxQwUYCpNictEwkZnExLyZjkXTPHex5lKgXVB508'], u'uuids': [u'850e8cf7-0124-48e1-9cbe-d77ef564347f']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.139808", "end": "2020-04-02 23:18:58.432173", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-cly0MwHSiviEOPouQrewtc1wtxQwUYCpNictEwkZnExLyZjkXTPHex5lKgXVB508"], "labels": [], "masters": [], "uuids": ["850e8cf7-0124-48e1-9cbe-d77ef564347f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:18:58.292365", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.137182 s, 841 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.137182 s, 841 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-02T23:18:58.676 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-e48egT7Iv3nhtEdv9Tx51VOU9Ef5qo9q1Yqid1qRAiKCNzWD7hVnef8soCHWtwpx'], u'uuids': [u'5fabdef3-15cf-45ed-a34d-bfd049784fac']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.140861", "end": "2020-04-02 23:18:58.647182", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-e48egT7Iv3nhtEdv9Tx51VOU9Ef5qo9q1Yqid1qRAiKCNzWD7hVnef8soCHWtwpx"], "labels": [], "masters": [], "uuids": ["5fabdef3-15cf-45ed-a34d-bfd049784fac"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:18:58.506321", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.138159 s, 835 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.138159 s, 835 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-02T23:18:58.802 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-cly0MwHSiviEOPouQrewtc1wtxQwUYCpXuj9Bw6Uu7DUd6zwjRgeOAO6JF00vwv0'], u'uuids': [u'2fc0f93a-8071-40a0-a8dd-6ba7e1d57fe4']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.144123", "end": "2020-04-02 23:18:58.777213", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-cly0MwHSiviEOPouQrewtc1wtxQwUYCpXuj9Bw6Uu7DUd6zwjRgeOAO6JF00vwv0"], "labels": [], "masters": [], "uuids": ["2fc0f93a-8071-40a0-a8dd-6ba7e1d57fe4"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:18:58.633090", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.141516 s, 815 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.141516 s, 815 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-02T23:18:58.995 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-e48egT7Iv3nhtEdv9Tx51VOU9Ef5qo9qziESITLep8yyirL2fHIl4tQVcstLb2qf'], u'uuids': [u'ed399876-c007-434e-909c-ab04dc42c693']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.139519", "end": "2020-04-02 23:18:58.968902", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-e48egT7Iv3nhtEdv9Tx51VOU9Ef5qo9qziESITLep8yyirL2fHIl4tQVcstLb2qf"], "labels": [], "masters": [], "uuids": ["ed399876-c007-434e-909c-ab04dc42c693"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:18:58.829383", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.137121 s, 841 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.137121 s, 841 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-02T23:18:59.143 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-cly0MwHSiviEOPouQrewtc1wtxQwUYCpR2mRhfToy22zIc1bvqUkiMjJxL55rhUa'], u'uuids': [u'640e9890-6b18-4ce0-986c-3f156a57642f']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.139889", "end": "2020-04-02 23:18:59.113247", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-cly0MwHSiviEOPouQrewtc1wtxQwUYCpR2mRhfToy22zIc1bvqUkiMjJxL55rhUa"], "labels": [], "masters": [], "uuids": ["640e9890-6b18-4ce0-986c-3f156a57642f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:18:58.973358", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.137252 s, 840 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.137252 s, 840 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-02T23:18:59.355 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-e48egT7Iv3nhtEdv9Tx51VOU9Ef5qo9qn3XdbVfv3fovcjLa3onWzHCd1rY7RI8M'], u'uuids': [u'76264769-5ea0-4835-b318-6b307ba91744']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.140358", "end": "2020-04-02 23:18:59.290199", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-e48egT7Iv3nhtEdv9Tx51VOU9Ef5qo9qn3XdbVfv3fovcjLa3onWzHCd1rY7RI8M"], "labels": [], "masters": [], "uuids": ["76264769-5ea0-4835-b318-6b307ba91744"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:18:59.149841", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.137886 s, 837 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.137886 s, 837 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-02T23:18:59.466 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-cly0MwHSiviEOPouQrewtc1wtxQwUYCpbHIJbeuhLZpixMMnFWa5WXResshm352m'], u'uuids': [u'5a1da162-0da5-4c9f-8d6e-7f9bb7599118']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.137497", "end": "2020-04-02 23:18:59.435641", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-cly0MwHSiviEOPouQrewtc1wtxQwUYCpbHIJbeuhLZpixMMnFWa5WXResshm352m"], "labels": [], "masters": [], "uuids": ["5a1da162-0da5-4c9f-8d6e-7f9bb7599118"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:18:59.298144", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.134827 s, 855 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.134827 s, 855 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-02T23:18:59.531 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:59 +0000 (0:00:01.821) 0:02:00.452 ******** 2020-04-02T23:18:59.663 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-e48egT7Iv3nhtEdv9Tx51VOU9Ef5qo9qChcL4gtsdPsjRN52EiEZeHQiPtmJwM1I'], u'uuids': [u'ce70f5ed-068e-45fa-86be-43cc89847f6d']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.137476", "end": "2020-04-02 23:18:59.612512", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-e48egT7Iv3nhtEdv9Tx51VOU9Ef5qo9qChcL4gtsdPsjRN52EiEZeHQiPtmJwM1I"], "labels": [], "masters": [], "uuids": ["ce70f5ed-068e-45fa-86be-43cc89847f6d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:18:59.475036", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.134862 s, 855 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.134862 s, 855 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-02T23:18:59.710 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:59 +0000 (0:00:00.178) 0:02:00.630 ******** 2020-04-02T23:18:59.802 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2020-04-02T23:18:59.803 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.058751", "end": "2020-04-02 23:18:59.770757", "rc": 0, "start": "2020-04-02 23:18:59.712006", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:18:59.843 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:18:59 +0000 (0:00:00.133) 0:02:00.764 ******** 2020-04-02T23:18:59.977 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.061513", "end": "2020-04-02 23:18:59.944288", "rc": 0, "start": "2020-04-02 23:18:59.882775", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:19:00.031 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:00 +0000 (0:00:00.187) 0:02:00.952 ******** 2020-04-02T23:19:00.078 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2020-04-02T23:19:00.080 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.044199", "end": "2020-04-02 23:19:00.054795", "rc": 0, "start": "2020-04-02 23:19:00.010596", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:19:00.123 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:00 +0000 (0:00:00.091) 0:02:01.044 ******** 2020-04-02T23:19:00.152 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-04-02T23:19:00.204 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:00 +0000 (0:00:00.081) 0:02:01.125 ******** 2020-04-02T23:19:00.235 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:00.283 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:00 +0000 (0:00:00.079) 0:02:01.204 ******** 2020-04-02T23:19:00.290 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2020-04-02T23:19:00.291 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.041825", "end": "2020-04-02 23:19:00.240968", "rc": 0, "start": "2020-04-02 23:19:00.199143", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:19:00.331 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:00 +0000 (0:00:00.048) 0:02:01.252 ******** 2020-04-02T23:19:00.338 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2020-04-02T23:19:00.340 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:00.379 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:00 +0000 (0:00:00.047) 0:02:01.300 ******** 2020-04-02T23:19:00.384 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-04-02T23:19:00.425 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:00 +0000 (0:00:00.046) 0:02:01.346 ******** 2020-04-02T23:19:00.431 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:00.471 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:00 +0000 (0:00:00.045) 0:02:01.392 ******** 2020-04-02T23:19:00.476 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2020-04-02T23:19:00.478 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:00.517 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:00 +0000 (0:00:00.045) 0:02:01.437 ******** 2020-04-02T23:19:00.520 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2020-04-02T23:19:00.522 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:00.558 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:00 +0000 (0:00:00.041) 0:02:01.479 ******** 2020-04-02T23:19:00.564 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2020-04-02T23:19:00.565 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:00.603 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:00 +0000 (0:00:00.044) 0:02:01.524 ******** 2020-04-02T23:19:00.639 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-04-02T23:19:00.640 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:00.686 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:00 +0000 (0:00:00.082) 0:02:01.607 ******** 2020-04-02T23:19:00.722 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2020-04-02T23:19:00.724 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:00.764 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:00 +0000 (0:00:00.078) 0:02:01.685 ******** 2020-04-02T23:19:00.769 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2020-04-02T23:19:00.770 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-04-02T23:19:00.810 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:00 +0000 (0:00:00.045) 0:02:01.731 ******** 2020-04-02T23:19:00.850 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-04-02T23:19:00.850 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'block_used': 12911789, u'uuid': u'02783226-4726-4004-a66c-c6bc58415d09', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227183319, u'size_available': 930542874624, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60990063, u'device': u'/dev/sda1', u'inode_used': 64913, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227183319, "block_size": 4096, "block_total": 240095108, "block_used": 12911789, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60990063, "inode_total": 61054976, "inode_used": 64913, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930542874624, "size_total": 983429562368, "uuid": "02783226-4726-4004-a66c-c6bc58415d09"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:00.891 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:00 +0000 (0:00:00.081) 0:02:01.812 ******** 2020-04-02T23:19:00.928 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2020-04-02T23:19:00.929 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:00.968 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:00 +0000 (0:00:00.076) 0:02:01.889 ******** 2020-04-02T23:19:00.974 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2020-04-02T23:19:00.974 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-04-02T23:19:01.025 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:01 +0000 (0:00:00.055) 0:02:01.944 ******** 2020-04-02T23:19:01.029 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-02T23:19:01.030 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:01.074 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:01 +0000 (0:00:00.050) 0:02:01.995 ******** 2020-04-02T23:19:01.080 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-04-02T23:19:01.081 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={u'block_used': 12911796, u'uuid': u'02783226-4726-4004-a66c-c6bc58415d09', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227183312, u'size_available': 930542845952, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60990058, u'device': u'/dev/sda1', u'inode_used': 64918, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227183312, "block_size": 4096, "block_total": 240095108, "block_used": 12911796, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60990058, "inode_total": 61054976, "inode_used": 64918, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930542845952, "size_total": 983429562368, "uuid": "02783226-4726-4004-a66c-c6bc58415d09"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:01.126 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:01 +0000 (0:00:00.051) 0:02:02.046 ******** 2020-04-02T23:19:01.131 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-02T23:19:01.133 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:01.172 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:01 +0000 (0:00:00.046) 0:02:02.093 ******** 2020-04-02T23:19:01.178 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2020-04-02T23:19:01.180 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:01.230 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:01 +0000 (0:00:00.057) 0:02:02.151 ******** 2020-04-02T23:19:01.238 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2020-04-02T23:19:01.239 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:01.283 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:01 +0000 (0:00:00.052) 0:02:02.204 ******** 2020-04-02T23:19:01.289 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:01.333 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:01 +0000 (0:00:00.050) 0:02:02.254 ******** 2020-04-02T23:19:01.338 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2020-04-02T23:19:01.339 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:01.378 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:01 +0000 (0:00:00.044) 0:02:02.299 ******** 2020-04-02T23:19:01.383 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-02T23:19:01.384 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:01.441 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:01 +0000 (0:00:00.062) 0:02:02.362 ******** 2020-04-02T23:19:01.448 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2020-04-02T23:19:01.450 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:01.494 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:01 +0000 (0:00:00.052) 0:02:02.415 ******** 2020-04-02T23:19:01.502 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:01.542 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:01 +0000 (0:00:00.048) 0:02:02.463 ******** 2020-04-02T23:19:01.568 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2020-04-02T23:19:01.570 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:01.624 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:01 +0000 (0:00:00.081) 0:02:02.545 ******** 2020-04-02T23:19:01.658 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2020-04-02T23:19:01.658 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:01.709 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:01 +0000 (0:00:00.084) 0:02:02.629 ******** 2020-04-02T23:19:02.239 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2020-04-02T23:19:02.240 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => (item={'value': {u'pvs': u'/dev/nvme0n1'}, 'key': u'vg_nvme'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-04-02T23:19:02.279 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:02 +0000 (0:00:00.570) 0:02:03.200 ******** 2020-04-02T23:19:02.285 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'value': {u'pvs': u'/dev/nvme0n1'}, 'key': u'vg_nvme'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-04-02T23:19:02.324 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:02 +0000 (0:00:00.045) 0:02:03.245 ******** 2020-04-02T23:19:02.948 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-04-02T23:19:02.949 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-02T23:19:02.985 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-02T23:19:03.288 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-02T23:19:03.323 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-02T23:19:03.643 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-02T23:19:03.682 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-02T23:19:04.000 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-02T23:19:04.055 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-02T23:19:04.057 INFO:teuthology.task.ansible.out: 2020-04-02T23:19:04.384 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-02T23:19:04.450 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:04 +0000 (0:00:02.125) 0:02:05.371 ******** 2020-04-02T23:19:04.458 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-02T23:19:04.503 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:04 +0000 (0:00:00.051) 0:02:05.423 ******** 2020-04-02T23:19:04.668 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** changed: [smithi196.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-04-02T23:19:04.714 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:04 +0000 (0:00:00.212) 0:02:05.635 ******** 2020-04-02T23:19:04.721 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-04-02T23:19:04.779 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:04 +0000 (0:00:00.064) 0:02:05.700 ******** 2020-04-02T23:19:04.786 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-04-02T23:19:04.787 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:04.841 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:04.952 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-04-02T23:19:05.023 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-04-02T23:19:05.162 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-04-02T23:19:05.216 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-04-02T23:19:05.359 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-04-02T23:19:05.403 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-04-02T23:19:05.545 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-04-02T23:19:05.592 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:05 +0000 (0:00:00.810) 0:02:06.511 ******** 2020-04-02T23:19:05.599 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-04-02T23:19:05.640 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:05 +0000 (0:00:00.049) 0:02:06.560 ******** 2020-04-02T23:19:05.797 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2020-04-02T23:19:05.798 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-04-02T23:19:05.835 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:05 +0000 (0:00:00.195) 0:02:06.756 ******** 2020-04-02T23:19:05.857 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-04-02T23:19:05.893 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:05 +0000 (0:00:00.058) 0:02:06.814 ******** 2020-04-02T23:19:05.903 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** ok: [smithi196.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2020-04-02T23:19:05.942 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:05 +0000 (0:00:00.048) 0:02:06.863 ******** 2020-04-02T23:19:05.946 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2020-04-02T23:19:05.998 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:05 +0000 (0:00:00.044) 0:02:06.907 ******** 2020-04-02T23:19:06.513 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2020-04-02T23:19:06.514 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true} 2020-04-02T23:19:06.557 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:06 +0000 (0:00:00.570) 0:02:07.478 ******** 2020-04-02T23:19:07.160 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2020-04-02T23:19:07.162 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2020-04-02T23:19:07.206 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:07 +0000 (0:00:00.649) 0:02:08.127 ******** 2020-04-02T23:19:07.234 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2020-04-02T23:19:07.235 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:07.275 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:07 +0000 (0:00:00.068) 0:02:08.196 ******** 2020-04-02T23:19:07.301 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2020-04-02T23:19:07.303 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:07.348 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:07 +0000 (0:00:00.073) 0:02:08.269 ******** 2020-04-02T23:19:07.375 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2020-04-02T23:19:07.376 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:07.418 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:07 +0000 (0:00:00.070) 0:02:08.339 ******** 2020-04-02T23:19:07.446 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2020-04-02T23:19:07.448 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:07.503 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:07 +0000 (0:00:00.084) 0:02:08.424 ******** 2020-04-02T23:19:07.529 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2020-04-02T23:19:07.530 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => {"changed": true} 2020-04-02T23:19:07.576 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:07 +0000 (0:00:00.072) 0:02:08.497 ******** 2020-04-02T23:19:07.581 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2020-04-02T23:19:07.583 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:07.626 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:07 +0000 (0:00:00.049) 0:02:08.547 ******** 2020-04-02T23:19:07.654 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2020-04-02T23:19:07.656 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:07.693 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:07 +0000 (0:00:00.067) 0:02:08.614 ******** 2020-04-02T23:19:07.720 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2020-04-02T23:19:07.722 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:07.759 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:07 +0000 (0:00:00.065) 0:02:08.680 ******** 2020-04-02T23:19:07.788 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2020-04-02T23:19:07.790 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:07.825 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:07 +0000 (0:00:00.065) 0:02:08.745 ******** 2020-04-02T23:19:07.851 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2020-04-02T23:19:07.852 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:07.890 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:07 +0000 (0:00:00.066) 0:02:08.811 ******** 2020-04-02T23:19:07.907 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2020-04-02T23:19:07.908 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2020-04-02T23:19:07.951 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:07 +0000 (0:00:00.059) 0:02:08.871 ******** 2020-04-02T23:19:07.956 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2020-04-02T23:19:07.958 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:07.999 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:07 +0000 (0:00:00.048) 0:02:08.920 ******** 2020-04-02T23:19:08.004 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2020-04-02T23:19:08.005 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:08.044 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:08 +0000 (0:00:00.044) 0:02:08.965 ******** 2020-04-02T23:19:08.049 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2020-04-02T23:19:08.050 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:08.091 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:08 +0000 (0:00:00.047) 0:02:09.012 ******** 2020-04-02T23:19:08.097 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2020-04-02T23:19:08.099 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:08.139 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:08 +0000 (0:00:00.047) 0:02:09.060 ******** 2020-04-02T23:19:08.165 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2020-04-02T23:19:08.166 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:08.203 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:08 +0000 (0:00:00.064) 0:02:09.124 ******** 2020-04-02T23:19:08.230 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:08.272 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:08 +0000 (0:00:00.063) 0:02:09.187 ******** 2020-04-02T23:19:08.293 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:08.332 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:08 +0000 (0:00:00.064) 0:02:09.252 ******** 2020-04-02T23:19:08.366 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:08.400 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:08 +0000 (0:00:00.068) 0:02:09.321 ******** 2020-04-02T23:19:08.440 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2020-04-02T23:19:08.442 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:08.479 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:08 +0000 (0:00:00.078) 0:02:09.399 ******** 2020-04-02T23:19:08.516 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2020-04-02T23:19:08.517 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:08.555 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:08 +0000 (0:00:00.074) 0:02:09.474 ******** 2020-04-02T23:19:08.580 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2020-04-02T23:19:08.581 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:08.618 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:08 +0000 (0:00:00.064) 0:02:09.539 ******** 2020-04-02T23:19:08.624 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2020-04-02T23:19:08.625 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2020-04-02T23:19:08.665 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:08 +0000 (0:00:00.047) 0:02:09.586 ******** 2020-04-02T23:19:08.672 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2020-04-02T23:19:08.673 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:08.714 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:08 +0000 (0:00:00.048) 0:02:09.635 ******** 2020-04-02T23:19:08.745 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2020-04-02T23:19:08.746 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:08.783 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:08 +0000 (0:00:00.069) 0:02:09.704 ******** 2020-04-02T23:19:08.983 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2020-04-02T23:19:08.985 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveEnterTimestamp": "Thu 2020-04-02 23:16:34 UTC", "ActiveEnterTimestampMonotonic": "11573175", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "tmp.mount ntpdate.service ntpd.service sntp.service sysinit.target -.mount systemd-journald.socket basic.target system.slice systemd-tmpfiles-setup.service", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2020-04-02 23:16:32 UTC", "AssertTimestampMonotonic": "10322784", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2020-04-02 23:16:32 UTC", "ConditionTimestampMonotonic": "10322751", "ConfigurationDirectoryMode": "0755", "Conflicts": "ntpd.service systemd-timesyncd.service shutdown.target", "ControlGroup": "/system.slice/chronyd.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description" 2020-04-02T23:19:08.987 INFO:teuthology.task.ansible.out:: "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2346", "ExecMainStartTimestamp": "Thu 2020-04-02 23:16:34 UTC", "ExecMainStartTimestampMonotonic": "11520869", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2020-04-02 23:16:33 UTC", "InactiveExitTimestampMonotonic": "10345884", "InvocationID": "aa706fdb6373451d91edf50649c68c73", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "167772 2020-04-02T23:19:08.988 INFO:teuthology.task.ansible.out:16", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127436", "LimitNPROCSoft": "127436", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127436", "LimitSIGPENDINGSoft": "127436", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2346", "MemoryAccounting": "yes", "MemoryCurrent": "3186688", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount system.slice sysinit.target", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardE 2020-04-02T23:19:08.990 INFO:teuthology.task.ansible.out:rror": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2020-04-02 23:16:34 UTC", "StateChangeTimestampMonotonic": "11573175", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Thu 2020-04-02 23:16:34 UTC", "WatchdogTimestampMonotonic": "11520882", "WatchdogUSec": "0"}} 2020-04-02T23:19:09.025 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:09 +0000 (0:00:00.241) 0:02:09.946 ******** 2020-04-02T23:19:09.057 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:09.098 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:09 +0000 (0:00:00.072) 0:02:10.019 ******** 2020-04-02T23:19:09.136 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2020-04-02T23:19:09.137 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:09.181 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:09 +0000 (0:00:00.083) 0:02:10.102 ******** 2020-04-02T23:19:09.211 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2020-04-02T23:19:09.213 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:09.264 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:09 +0000 (0:00:00.082) 0:02:10.185 ******** 2020-04-02T23:19:09.269 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2020-04-02T23:19:09.270 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2020-04-02T23:19:09.313 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:09 +0000 (0:00:00.048) 0:02:10.234 ******** 2020-04-02T23:19:09.468 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "gid": 1212, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2020-04-02T23:19:09.519 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:09 +0000 (0:00:00.205) 0:02:10.440 ******** 2020-04-02T23:19:09.644 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2020-04-02T23:19:09.649 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveEnterTimestamp": "Thu 2020-04-02 23:16:40 UTC", "ActiveEnterTimestampMonotonic": "12040165", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "ntpd.service systemd-journald.socket tmp.mount ntpdate.service basic.target sntp.service systemd-tmpfiles-setup.service system.slice sysinit.target -.mount", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2020-04-02 23:16:39 UTC", "AssertTimestampMonotonic": "10560376", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2020-04-02 23:16:39 UTC", "ConditionTimestampMonotonic": "10560352", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service shutdown.target ntpd.service", "ControlGroup": "/system.slice/chronyd.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description" 2020-04-02T23:19:09.650 INFO:teuthology.task.ansible.out:: "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2336", "ExecMainStartTimestamp": "Thu 2020-04-02 23:16:40 UTC", "ExecMainStartTimestampMonotonic": "11977268", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2020-04-02 23:16:39 UTC", "InactiveExitTimestampMonotonic": "10737549", "InvocationID": "819f8b6952f646b79ece193f6cf47b8d", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "167772 2020-04-02T23:19:09.651 INFO:teuthology.task.ansible.out:16", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127436", "LimitNPROCSoft": "127436", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127436", "LimitSIGPENDINGSoft": "127436", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2336", "MemoryAccounting": "yes", "MemoryCurrent": "3178496", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount sysinit.target system.slice", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardE 2020-04-02T23:19:09.653 INFO:teuthology.task.ansible.out:rror": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2020-04-02 23:16:40 UTC", "StateChangeTimestampMonotonic": "12040165", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Thu 2020-04-02 23:16:40 UTC", "WatchdogTimestampMonotonic": "11977282", "WatchdogUSec": "0"}} 2020-04-02T23:19:09.690 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:09 +0000 (0:00:00.171) 0:02:10.611 ******** 2020-04-02T23:19:09.718 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2020-04-02T23:19:09.720 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:09.758 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:09 +0000 (0:00:00.067) 0:02:10.679 ******** 2020-04-02T23:19:09.785 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2020-04-02T23:19:09.787 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:09.835 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:09 +0000 (0:00:00.077) 0:02:10.756 ******** 2020-04-02T23:19:09.863 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2020-04-02T23:19:09.865 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:09.909 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:09 +0000 (0:00:00.067) 0:02:10.824 ******** 2020-04-02T23:19:09.995 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2020-04-02T23:19:09.995 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1212, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2020-04-02T23:19:10.062 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:10 +0000 (0:00:00.159) 0:02:10.983 ******** 2020-04-02T23:19:10.099 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2020-04-02T23:19:10.100 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "gid": 1212, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2020-04-02T23:19:10.140 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:10 +0000 (0:00:00.078) 0:02:11.061 ******** 2020-04-02T23:19:10.614 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1212, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2020-04-02T23:19:10.658 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:10 +0000 (0:00:00.517) 0:02:11.579 ******** 2020-04-02T23:19:11.413 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2020-04-02T23:19:11.413 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-04-02T23:19:11.454 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:11 +0000 (0:00:00.795) 0:02:12.375 ******** 2020-04-02T23:19:11.482 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2020-04-02T23:19:11.484 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:11.524 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:11 +0000 (0:00:00.069) 0:02:12.445 ******** 2020-04-02T23:19:11.550 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2020-04-02T23:19:11.552 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2020-04-02T23:19:11.590 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:11 +0000 (0:00:00.065) 0:02:12.511 ******** 2020-04-02T23:19:11.703 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2020-04-02T23:19:11.704 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-04-02T23:19:11.741 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:11 +0000 (0:00:00.150) 0:02:12.662 ******** 2020-04-02T23:19:11.767 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2020-04-02T23:19:11.769 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:11.806 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:11 +0000 (0:00:00.065) 0:02:12.727 ******** 2020-04-02T23:19:11.812 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2020-04-02T23:19:11.812 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2020-04-02T23:19:11.851 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:11 +0000 (0:00:00.044) 0:02:12.772 ******** 2020-04-02T23:19:11.865 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ ok: [smithi196.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2020-04-02T23:19:11.896 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:11 +0000 (0:00:00.045) 0:02:12.817 ******** 2020-04-02T23:19:11.902 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2020-04-02T23:19:11.903 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:11.940 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:11 +0000 (0:00:00.044) 0:02:12.861 ******** 2020-04-02T23:19:11.977 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2020-04-02T23:19:11.984 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-04-02T23:19:12.020 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:12 +0000 (0:00:00.079) 0:02:12.941 ******** 2020-04-02T23:19:12.046 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2020-04-02T23:19:12.048 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:12.088 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:12 +0000 (0:00:00.065) 0:02:13.006 ******** 2020-04-02T23:19:12.111 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2020-04-02T23:19:12.113 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2020-04-02T23:19:12.154 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:12 +0000 (0:00:00.068) 0:02:13.075 ******** 2020-04-02T23:19:12.180 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2020-04-02T23:19:12.182 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:12.218 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:12 +0000 (0:00:00.063) 0:02:13.139 ******** 2020-04-02T23:19:12.243 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2020-04-02T23:19:12.245 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-04-02T23:19:12.285 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:12 +0000 (0:00:00.066) 0:02:13.206 ******** 2020-04-02T23:19:12.290 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2020-04-02T23:19:12.291 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-04-02T23:19:12.332 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:12 +0000 (0:00:00.046) 0:02:13.253 ******** 2020-04-02T23:19:12.338 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2020-04-02T23:19:12.339 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:12.379 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:12 +0000 (0:00:00.047) 0:02:13.300 ******** 2020-04-02T23:19:12.525 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2020-04-02T23:19:12.526 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-04-02T23:19:12.573 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:12 +0000 (0:00:00.193) 0:02:13.494 ******** 2020-04-02T23:19:12.579 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2020-04-02T23:19:12.579 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-04-02T23:19:12.620 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:12 +0000 (0:00:00.047) 0:02:13.541 ******** 2020-04-02T23:19:12.626 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2020-04-02T23:19:12.626 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:12.669 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:12 +0000 (0:00:00.046) 0:02:13.588 ******** 2020-04-02T23:19:12.705 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2020-04-02T23:19:12.706 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2020-04-02T23:19:12.707 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2020-04-02T23:19:12.718 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2020-04-02T23:19:12.718 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2020-04-02T23:19:12.757 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:12 +0000 (0:00:00.089) 0:02:13.678 ******** 2020-04-02T23:19:12.794 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2020-04-02T23:19:12.796 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:12.806 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'lo', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:12.808 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno2', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:12.819 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f0', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:12.821 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2020-04-02T23:19:12.822 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-04-02T23:19:12.862 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:12 +0000 (0:00:00.105) 0:02:13.783 ******** 2020-04-02T23:19:12.905 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:12 +0000 (0:00:00.042) 0:02:13.826 ******** 2020-04-02T23:19:12.911 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-02T23:19:12.911 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:12.954 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:12 +0000 (0:00:00.048) 0:02:13.874 ******** 2020-04-02T23:19:12.959 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2020-04-02T23:19:12.961 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:13.000 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:12 +0000 (0:00:00.045) 0:02:13.921 ******** 2020-04-02T23:19:13.006 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2020-04-02T23:19:13.007 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:13.059 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:13 +0000 (0:00:00.059) 0:02:13.980 ******** 2020-04-02T23:19:13.065 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2020-04-02T23:19:13.066 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2020-04-02T23:19:13.067 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2020-04-02T23:19:13.069 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2020-04-02T23:19:13.110 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:13 +0000 (0:00:00.049) 0:02:14.030 ******** 2020-04-02T23:19:13.115 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2020-04-02T23:19:13.116 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:13.170 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:13 +0000 (0:00:00.060) 0:02:14.091 ******** 2020-04-02T23:19:13.175 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** skipping: [smithi196.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno2', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:13.176 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'lo', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:13.178 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:13.179 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f0', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi196.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:13.219 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:13 +0000 (0:00:00.049) 0:02:14.140 ******** 2020-04-02T23:19:13.225 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2020-04-02T23:19:13.227 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:13.268 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:13 +0000 (0:00:00.048) 0:02:14.189 ******** 2020-04-02T23:19:13.275 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-02T23:19:13.276 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:13.317 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:13 +0000 (0:00:00.049) 0:02:14.238 ******** 2020-04-02T23:19:13.323 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:13.366 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:13 +0000 (0:00:00.048) 0:02:14.287 ******** 2020-04-02T23:19:13.372 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2020-04-02T23:19:13.374 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:13.423 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:13 +0000 (0:00:00.057) 0:02:14.344 ******** 2020-04-02T23:19:13.430 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-04-02T23:19:13.430 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:13.476 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:13 +0000 (0:00:00.050) 0:02:14.395 ******** 2020-04-02T23:19:13.480 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2020-04-02T23:19:13.480 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:13.531 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:13 +0000 (0:00:00.057) 0:02:14.452 ******** 2020-04-02T23:19:13.537 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2020-04-02T23:19:13.537 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:13.583 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:13 +0000 (0:00:00.051) 0:02:14.503 ******** 2020-04-02T23:19:13.589 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2020-04-02T23:19:13.589 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:13.630 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:13 +0000 (0:00:00.047) 0:02:14.551 ******** 2020-04-02T23:19:13.635 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-04-02T23:19:13.637 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:13.674 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:13 +0000 (0:00:00.043) 0:02:14.595 ******** 2020-04-02T23:19:13.679 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2020-04-02T23:19:13.680 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:13.720 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:13 +0000 (0:00:00.045) 0:02:14.641 ******** 2020-04-02T23:19:13.767 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-04-02T23:19:13.768 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:13.807 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:13 +0000 (0:00:00.086) 0:02:14.728 ******** 2020-04-02T23:19:13.846 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2020-04-02T23:19:13.847 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:13.887 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:13 +0000 (0:00:00.080) 0:02:14.808 ******** 2020-04-02T23:19:13.914 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-04-02T23:19:13.914 INFO:teuthology.task.ansible.out:skipping: [smithi196.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:13.953 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:13 +0000 (0:00:00.065) 0:02:14.873 ******** 2020-04-02T23:19:14.195 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-04-02T23:19:14.196 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.004836", "end": "2020-04-02 23:19:14.145203", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-04-02 23:19:14.140367", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:19:14.384 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.002967", "end": "2020-04-02 23:19:14.347169", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-04-02 23:19:14.344202", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:19:14.572 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.002809", "end": "2020-04-02 23:19:14.534996", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-04-02 23:19:14.532187", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2020-04-02T23:19:14.794 INFO:teuthology.task.ansible.out:ok: [smithi196.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.041610", "end": "2020-04-02 23:19:14.753457", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-04-02 23:19:14.711847", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:19:14.836 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:14 +0000 (0:00:00.883) 0:02:15.757 ******** 2020-04-02T23:19:14.880 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2020-04-02T23:19:14.933 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:14 +0000 (0:00:00.097) 0:02:15.854 ******** 2020-04-02T23:19:14.947 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-04-02T23:19:14.948 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:01.006094", "end": "2020-04-02 23:19:14.860907", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-04-02 23:19:13.854813", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:19:15.095 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.003064", "end": "2020-04-02 23:19:15.064817", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-04-02 23:19:15.061753", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:19:15.136 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2020-04-02T23:19:15.138 INFO:teuthology.task.ansible.out:changed: [smithi196.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2020-04-02T23:19:15.279 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-04-02T23:19:15.281 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.002842", "end": "2020-04-02 23:19:15.250753", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-04-02 23:19:15.247911", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2020-04-02T23:19:15.484 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.014532", "end": "2020-04-02 23:19:15.443462", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-04-02 23:19:15.428930", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:19:15.522 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:15 +0000 (0:00:00.588) 0:02:16.443 ******** 2020-04-02T23:19:15.548 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2020-04-02T23:19:15.586 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:15 +0000 (0:00:00.064) 0:02:16.507 ******** 2020-04-02T23:19:15.781 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2020-04-02T23:19:15.783 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2020-04-02T23:19:15.884 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** 2020-04-02T23:19:15.886 INFO:teuthology.task.ansible.out:skipping: no hosts matched 2020-04-02T23:19:15.887 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2020-04-02T23:19:15.889 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** skipping: no hosts matched PLAY RECAP ********************************************************************* 2020-04-02T23:19:15.889 INFO:teuthology.task.ansible.out:smithi174.front.sepia.ceph.com : ok=111 changed=33 unreachable=0 failed=0 skipped=172 rescued=0 ignored=3 smithi196.front.sepia.ceph.com : ok=111 changed=33 unreachable=0 failed=0 skipped=172 rescued=0 ignored=3 2020-04-02T23:19:15.889 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:15 +0000 (0:00:00.302) 0:02:16.810 ******** =============================================================================== 2020-04-02T23:19:15.890 INFO:teuthology.task.ansible.out:common : nrpe - Remove SELinux policy package -------------------------- 16.29s common : nrpe - Load SELinux policy package ---------------------------- 16.27s testnode : Zap all non-root disks --------------------------------------- 7.98s 2020-04-02T23:19:15.891 INFO:teuthology.task.ansible.out:testnode : Install packages --------------------------------------------- 7.02s testnode : Base group workaround for BZ1782899 -------------------------- 4.94s common : Install Kerberos Packages (RedHat) ----------------------------- 2.95s testnode : Ensure ceph dependency packages are not present. ------------- 2.81s Gathering Facts --------------------------------------------------------- 2.58s testnode : Ensure ceph packages are not present. ------------------------ 2.26s testnode : Create logical volume(s) ------------------------------------- 2.13s testnode : Blow away lingering OSD data and FSIDs ----------------------- 1.82s 2020-04-02T23:19:15.891 INFO:teuthology.task.ansible.out:testnode : Rebuild rpmdb ------------------------------------------------ 1.76s testnode : Configure version specific repos in /etc/yum.repos.d/ -------- 1.44s testnode : Configure local mirrorlists ---------------------------------- 1.39s common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/. --- 1.33s common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/. --- 1.28s common : nrpe - Set SELinux boolean nagios_run_sudo true ---------------- 1.02s testnode : Set the system's hostname ------------------------------------ 0.98s 2020-04-02T23:19:15.891 INFO:teuthology.task.ansible.out:testnode : Make sure rpm dependencies are installed --------------------- 0.91s common : Configure epel repos in /etc/yum.repos.d/ ---------------------- 0.89s 2020-04-02T23:19:16.171 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi196.front.sepia.ceph.com'), Remote(name='ubuntu@smithi174.front.sepia.ceph.com')] 2020-04-02T23:19:16.173 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-04-02T23:19:16.174 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi196.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:19:16.245 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:19:16.344 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-04-02T23:19:16.345 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi174.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:19:16.412 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:19:16.501 INFO:teuthology.run_tasks:Running task clock... 2020-04-02T23:19:16.521 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2020-04-02T23:19:16.521 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:19:16.537 INFO:teuthology.orchestra.run:Running command with timeout 60 2020-04-02T23:19:16.538 INFO:teuthology.orchestra.run.smithi196:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-04-02T23:19:16.643 INFO:teuthology.orchestra.run.smithi196.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2020-04-02T23:19:16.643 INFO:teuthology.orchestra.run.smithi196.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2020-04-02T23:19:16.710 INFO:teuthology.orchestra.run.smithi196.stderr:sudo: ntpd: command not found 2020-04-02T23:19:16.719 INFO:teuthology.orchestra.run.smithi196.stderr:Failed to start ntp.service: Unit ntp.service not found. 2020-04-02T23:19:16.737 INFO:teuthology.orchestra.run.smithi196.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2020-04-02T23:19:16.745 INFO:teuthology.orchestra.run.smithi196.stdout:506 Cannot talk to daemon 2020-04-02T23:19:16.803 INFO:teuthology.orchestra.run.smithi196.stderr:bash: ntpq: command not found 2020-04-02T23:19:16.810 INFO:teuthology.orchestra.run.smithi196.stdout:210 Number of sources = 4 2020-04-02T23:19:16.811 INFO:teuthology.orchestra.run.smithi196.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2020-04-02T23:19:16.811 INFO:teuthology.orchestra.run.smithi196.stdout:=============================================================================== 2020-04-02T23:19:16.811 INFO:teuthology.orchestra.run.smithi196.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-04-02T23:19:16.811 INFO:teuthology.orchestra.run.smithi196.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-04-02T23:19:16.811 INFO:teuthology.orchestra.run.smithi196.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-04-02T23:19:16.811 INFO:teuthology.orchestra.run.smithi196.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-04-02T23:19:16.812 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:19:16.826 INFO:teuthology.orchestra.run:Running command with timeout 60 2020-04-02T23:19:16.827 INFO:teuthology.orchestra.run.smithi174:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-04-02T23:19:16.934 INFO:teuthology.orchestra.run.smithi174.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2020-04-02T23:19:16.934 INFO:teuthology.orchestra.run.smithi174.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2020-04-02T23:19:16.985 INFO:teuthology.orchestra.run.smithi174.stdout:506 Cannot talk to daemon 2020-04-02T23:19:17.000 INFO:teuthology.orchestra.run.smithi174.stderr:sudo: ntpd: command not found 2020-04-02T23:19:17.000 INFO:teuthology.orchestra.run.smithi174.stderr:Failed to start ntp.service: Unit ntp.service not found. 2020-04-02T23:19:17.017 INFO:teuthology.orchestra.run.smithi174.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2020-04-02T23:19:17.101 INFO:teuthology.orchestra.run.smithi174.stdout:210 Number of sources = 4 2020-04-02T23:19:17.101 INFO:teuthology.orchestra.run.smithi174.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2020-04-02T23:19:17.101 INFO:teuthology.orchestra.run.smithi174.stdout:=============================================================================== 2020-04-02T23:19:17.101 INFO:teuthology.orchestra.run.smithi174.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-04-02T23:19:17.101 INFO:teuthology.orchestra.run.smithi174.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-04-02T23:19:17.101 INFO:teuthology.orchestra.run.smithi174.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-04-02T23:19:17.102 INFO:teuthology.orchestra.run.smithi174.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-04-02T23:19:17.133 INFO:teuthology.orchestra.run.smithi174.stderr:bash: ntpq: command not found 2020-04-02T23:19:17.133 INFO:teuthology.run_tasks:Running task install... 2020-04-02T23:19:17.142 DEBUG:teuthology.task.install:project ceph 2020-04-02T23:19:17.142 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'sha1': 'cbb84f71d70460f911296715ab61ac09c6962b17'}} 2020-04-02T23:19:17.142 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'dump', 'indent'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel']}, 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'sha1': 'cbb84f71d70460f911296715ab61ac09c6962b17'} 2020-04-02T23:19:17.142 INFO:teuthology.task.install:Using flavor: basic 2020-04-02T23:19:17.150 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2020-04-02T23:19:17.150 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']} 2020-04-02T23:19:17.150 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:19:17.164 INFO:teuthology.orchestra.run.smithi196:> sudo lsb_release -is 2020-04-02T23:19:17.239 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS 2020-04-02T23:19:17.241 DEBUG:teuthology.misc:System to be installed: CentOS 2020-04-02T23:19:17.241 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:19:17.241 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'sha1': 'cbb84f71d70460f911296715ab61ac09c6962b17', 'exclude_packages': [], 'debuginfo': None, 'install_ceph_packages': True, 'wait_for_package': False, 'downgrade_packages': [], 'project': 'ceph', 'tag': None, 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'branch': None, 'packages': {}, 'repos_only': False, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'dump', 'indent'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel']}, 'flavor': 'basic', 'extras': None} 2020-04-02T23:19:17.242 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:19:17.255 INFO:teuthology.orchestra.run.smithi174:> sudo lsb_release -is 2020-04-02T23:19:17.294 INFO:teuthology.orchestra.run.smithi196:> sudo lsb_release -is 2020-04-02T23:19:17.332 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS 2020-04-02T23:19:17.333 DEBUG:teuthology.misc:System to be installed: CentOS 2020-04-02T23:19:17.333 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'sha1': 'cbb84f71d70460f911296715ab61ac09c6962b17', 'exclude_packages': [], 'debuginfo': None, 'install_ceph_packages': True, 'wait_for_package': False, 'downgrade_packages': [], 'project': 'ceph', 'tag': None, 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'branch': None, 'packages': {}, 'repos_only': False, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'dump', 'indent'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel']}, 'flavor': 'basic', 'extras': None} 2020-04-02T23:19:17.333 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:19:17.368 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS 2020-04-02T23:19:17.369 DEBUG:teuthology.misc:System to be installed: CentOS 2020-04-02T23:19:17.370 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=cbb84f71d70460f911296715ab61ac09c6962b17 2020-04-02T23:19:17.385 INFO:teuthology.orchestra.run.smithi174:> sudo lsb_release -is 2020-04-02T23:19:17.460 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS 2020-04-02T23:19:17.461 DEBUG:teuthology.misc:System to be installed: CentOS 2020-04-02T23:19:17.462 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=cbb84f71d70460f911296715ab61ac09c6962b17 2020-04-02T23:19:17.614 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-greg-testing-42/cbb84f71d70460f911296715ab61ac09c6962b17/centos/8/flavors/default/ 2020-04-02T23:19:17.614 INFO:teuthology.task.install.rpm:Package version is 16.0.0-316.gcbb84f7 2020-04-02T23:19:17.691 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-greg-testing-42/cbb84f71d70460f911296715ab61ac09c6962b17/centos/8/flavors/default/ 2020-04-02T23:19:17.692 INFO:teuthology.task.install.rpm:Package version is 16.0.0-316.gcbb84f7 2020-04-02T23:19:17.817 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-greg-testing-42/cbb84f71d70460f911296715ab61ac09c6962b17/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-greg-testing-42/cbb84f71d70460f911296715ab61ac09c6962b17/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-greg-testing-42/cbb84f71d70460f911296715ab61ac09c6962b17/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2020-04-02T23:19:17.818 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:19:17.832 INFO:teuthology.orchestra.run.smithi196:> sudo sh -c 'cat > /etc/yum.repos.d/ceph.repo' 2020-04-02T23:19:17.872 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-greg-testing-42/cbb84f71d70460f911296715ab61ac09c6962b17/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-greg-testing-42/cbb84f71d70460f911296715ab61ac09c6962b17/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-greg-testing-42/cbb84f71d70460f911296715ab61ac09c6962b17/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2020-04-02T23:19:17.872 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:19:17.888 INFO:teuthology.orchestra.run.smithi174:> sudo sh -c 'cat > /etc/yum.repos.d/ceph.repo' 2020-04-02T23:19:17.920 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel on remote rpm x86_64 2020-04-02T23:19:17.920 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:19:17.974 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel on remote rpm x86_64 2020-04-02T23:19:17.974 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:19:17.975 INFO:teuthology.orchestra.run.smithi196:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/cbb84f71d70460f911296715ab61ac09c6962b17/;g' /etc/yum.repos.d/ceph.repo ; fi 2020-04-02T23:19:18.028 INFO:teuthology.orchestra.run.smithi174:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/cbb84f71d70460f911296715ab61ac09c6962b17/;g' /etc/yum.repos.d/ceph.repo ; fi 2020-04-02T23:19:18.044 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:19:18.096 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:19:18.098 INFO:teuthology.orchestra.run.smithi196:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2020-04-02T23:19:18.150 INFO:teuthology.orchestra.run.smithi174:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2020-04-02T23:19:18.178 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:19:18.232 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:19:18.233 INFO:teuthology.orchestra.run.smithi196:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2020-04-02T23:19:18.286 INFO:teuthology.orchestra.run.smithi174:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2020-04-02T23:19:18.300 INFO:teuthology.orchestra.run.smithi196.stdout:check_obsoletes = 1 2020-04-02T23:19:18.301 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:19:18.354 INFO:teuthology.orchestra.run.smithi174.stdout:check_obsoletes = 1 2020-04-02T23:19:18.354 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:19:18.357 INFO:teuthology.orchestra.run.smithi196:> sudo yum clean all 2020-04-02T23:19:18.407 INFO:teuthology.orchestra.run.smithi174:> sudo yum clean all 2020-04-02T23:19:18.633 INFO:teuthology.orchestra.run.smithi196.stdout:50 files removed 2020-04-02T23:19:18.661 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:19:18.674 INFO:teuthology.orchestra.run.smithi196:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel 2020-04-02T23:19:18.682 INFO:teuthology.orchestra.run.smithi174.stdout:50 files removed 2020-04-02T23:19:18.710 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:19:18.723 INFO:teuthology.orchestra.run.smithi174:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel 2020-04-02T23:19:19.439 INFO:teuthology.orchestra.run.smithi196.stdout:ceph packages for x86_64 180 kB/s | 69 kB 00:00 2020-04-02T23:19:19.487 INFO:teuthology.orchestra.run.smithi174.stdout:ceph packages for x86_64 181 kB/s | 69 kB 00:00 2020-04-02T23:19:19.780 INFO:teuthology.orchestra.run.smithi196.stdout:ceph noarch packages 45 kB/s | 14 kB 00:00 2020-04-02T23:19:19.826 INFO:teuthology.orchestra.run.smithi174.stdout:ceph noarch packages 45 kB/s | 14 kB 00:00 2020-04-02T23:19:20.110 INFO:teuthology.orchestra.run.smithi196.stdout:ceph source packages 4.5 kB/s | 1.4 kB 00:00 2020-04-02T23:19:20.158 INFO:teuthology.orchestra.run.smithi174.stdout:ceph source packages 4.5 kB/s | 1.4 kB 00:00 2020-04-02T23:19:20.280 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS-8 - AppStream 45 MB/s | 6.6 MB 00:00 2020-04-02T23:19:20.341 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS-8 - AppStream 42 MB/s | 6.6 MB 00:00 2020-04-02T23:19:21.455 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS-8 - Base 39 MB/s | 5.0 MB 00:00 2020-04-02T23:19:21.533 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS-8 - Base 38 MB/s | 5.0 MB 00:00 2020-04-02T23:19:22.225 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS-8 - Extras 69 kB/s | 4.4 kB 00:00 2020-04-02T23:19:22.335 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS-8 - Extras 69 kB/s | 4.4 kB 00:00 2020-04-02T23:19:22.364 INFO:teuthology.orchestra.run.smithi196.stdout:Copr repo for ceph-el8 owned by ktdreyer 498 kB/s | 47 kB 00:00 2020-04-02T23:19:22.480 INFO:teuthology.orchestra.run.smithi174.stdout:Copr repo for ceph-el8 owned by ktdreyer 473 kB/s | 47 kB 00:00 2020-04-02T23:19:22.733 INFO:teuthology.orchestra.run.smithi196.stdout:Extra Packages for Enterprise Linux 20 MB/s | 6.2 MB 00:00 2020-04-02T23:19:22.821 INFO:teuthology.orchestra.run.smithi174.stdout:Extra Packages for Enterprise Linux 22 MB/s | 6.2 MB 00:00 2020-04-02T23:19:23.982 INFO:teuthology.orchestra.run.smithi196.stdout:lab-extras 5.6 MB/s | 30 kB 00:00 2020-04-02T23:19:24.133 INFO:teuthology.orchestra.run.smithi174.stdout:lab-extras 5.8 MB/s | 30 kB 00:00 2020-04-02T23:19:24.839 INFO:teuthology.orchestra.run.smithi196.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2020-04-02T23:19:24.839 INFO:teuthology.orchestra.run.smithi196.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2020-04-02T23:19:24.842 INFO:teuthology.orchestra.run.smithi196.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2020-04-02T23:19:24.843 INFO:teuthology.orchestra.run.smithi196.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2020-04-02T23:19:24.844 INFO:teuthology.orchestra.run.smithi196.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2020-04-02T23:19:24.844 INFO:teuthology.orchestra.run.smithi196.stdout:Package xfsprogs-5.0.0-1.el8.x86_64 is already installed. 2020-04-02T23:19:24.965 INFO:teuthology.orchestra.run.smithi196.stdout:Dependencies resolved. 2020-04-02T23:19:24.978 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2020-04-02T23:19:24.978 INFO:teuthology.orchestra.run.smithi196.stdout: Package ArchVersion Repository Size 2020-04-02T23:19:24.978 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2020-04-02T23:19:24.978 INFO:teuthology.orchestra.run.smithi196.stdout:Installing: 2020-04-02T23:19:24.978 INFO:teuthology.orchestra.run.smithi196.stdout: ceph x86_642:16.0.0-316.gcbb84f7.el8 ceph 6.4 k 2020-04-02T23:19:24.978 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-base x86_642:16.0.0-316.gcbb84f7.el8 ceph 5.6 M 2020-04-02T23:19:24.979 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-fuse x86_642:16.0.0-316.gcbb84f7.el8 ceph 573 k 2020-04-02T23:19:24.979 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-immutable-object-cache x86_642:16.0.0-316.gcbb84f7.el8 ceph 203 k 2020-04-02T23:19:24.979 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr x86_642:16.0.0-316.gcbb84f7.el8 ceph 1.4 M 2020-04-02T23:19:24.979 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-radosgw x86_642:16.0.0-316.gcbb84f7.el8 ceph 9.8 M 2020-04-02T23:19:24.979 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-test x86_642:16.0.0-316.gcbb84f7.el8 ceph 42 M 2020-04-02T23:19:24.979 INFO:teuthology.orchestra.run.smithi196.stdout: cephadm x86_642:16.0.0-316.gcbb84f7.el8 ceph 39 k 2020-04-02T23:19:24.979 INFO:teuthology.orchestra.run.smithi196.stdout: libcephfs-devel x86_642:16.0.0-316.gcbb84f7.el8 ceph 21 k 2020-04-02T23:19:24.980 INFO:teuthology.orchestra.run.smithi196.stdout: libcephfs2 x86_642:16.0.0-316.gcbb84f7.el8 ceph 508 k 2020-04-02T23:19:24.980 INFO:teuthology.orchestra.run.smithi196.stdout: librados-devel x86_642:16.0.0-316.gcbb84f7.el8 ceph 141 k 2020-04-02T23:19:24.980 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cephfs x86_642:16.0.0-316.gcbb84f7.el8 ceph 162 k 2020-04-02T23:19:24.980 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rados x86_642:16.0.0-316.gcbb84f7.el8 ceph 352 k 2020-04-02T23:19:24.980 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rbd x86_642:16.0.0-316.gcbb84f7.el8 ceph 331 k 2020-04-02T23:19:24.980 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rgw x86_642:16.0.0-316.gcbb84f7.el8 ceph 113 k 2020-04-02T23:19:24.980 INFO:teuthology.orchestra.run.smithi196.stdout: rbd-fuse x86_642:16.0.0-316.gcbb84f7.el8 ceph 72 k 2020-04-02T23:19:24.981 INFO:teuthology.orchestra.run.smithi196.stdout: rbd-mirror x86_642:16.0.0-316.gcbb84f7.el8 ceph 2.7 M 2020-04-02T23:19:24.981 INFO:teuthology.orchestra.run.smithi196.stdout: rbd-nbd x86_642:16.0.0-316.gcbb84f7.el8 ceph 141 k 2020-04-02T23:19:24.981 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-cephadm noarch2:16.0.0-316.gcbb84f7.el8 ceph-noarch 40 k 2020-04-02T23:19:24.981 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-dashboard noarch2:16.0.0-316.gcbb84f7.el8 ceph-noarch 3.3 M 2020-04-02T23:19:24.981 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-diskprediction-local noarch2:16.0.0-316.gcbb84f7.el8 ceph-noarch 8.6 M 2020-04-02T23:19:24.981 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-rook noarch2:16.0.0-316.gcbb84f7.el8 ceph-noarch 27 k 2020-04-02T23:19:24.981 INFO:teuthology.orchestra.run.smithi196.stdout: bison x86_643.0.4-10.el8 CentOS-AppStream 688 k 2020-04-02T23:19:24.982 INFO:teuthology.orchestra.run.smithi196.stdout: flex x86_642.6.1-9.el8 CentOS-AppStream 320 k 2020-04-02T23:19:24.982 INFO:teuthology.orchestra.run.smithi196.stdout: libtool x86_642.4.6-25.el8 CentOS-AppStream 709 k 2020-04-02T23:19:24.982 INFO:teuthology.orchestra.run.smithi196.stdout: elfutils-libelf-devel x86_640.176-5.el8 CentOS-Base 54 k 2020-04-02T23:19:24.982 INFO:teuthology.orchestra.run.smithi196.stdout: libaio-devel x86_640.3.112-1.el8 CentOS-Base 19 k 2020-04-02T23:19:24.982 INFO:teuthology.orchestra.run.smithi196.stdout: libuuid-devel x86_642.32.1-17.el8 CentOS-Base 95 k 2020-04-02T23:19:24.982 INFO:teuthology.orchestra.run.smithi196.stdout: openssl-devel x86_641:1.1.1c-2.el8 CentOS-Base 2.3 M 2020-04-02T23:19:24.982 INFO:teuthology.orchestra.run.smithi196.stdout: xfsprogs-devel x86_645.0.0-1.el8 CentOS-Base 69 k 2020-04-02T23:19:24.982 INFO:teuthology.orchestra.run.smithi196.stdout:Upgrading: 2020-04-02T23:19:24.983 INFO:teuthology.orchestra.run.smithi196.stdout: librados2 x86_642:16.0.0-316.gcbb84f7.el8 ceph 3.6 M 2020-04-02T23:19:24.983 INFO:teuthology.orchestra.run.smithi196.stdout: librbd1 x86_642:16.0.0-316.gcbb84f7.el8 ceph 1.9 M 2020-04-02T23:19:24.983 INFO:teuthology.orchestra.run.smithi196.stdout:Installing dependencies: 2020-04-02T23:19:24.983 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-common x86_642:16.0.0-316.gcbb84f7.el8 ceph 21 M 2020-04-02T23:19:24.983 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mds x86_642:16.0.0-316.gcbb84f7.el8 ceph 2.0 M 2020-04-02T23:19:24.983 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mon x86_642:16.0.0-316.gcbb84f7.el8 ceph 4.4 M 2020-04-02T23:19:24.983 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-osd x86_642:16.0.0-316.gcbb84f7.el8 ceph 17 M 2020-04-02T23:19:24.984 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-selinux x86_642:16.0.0-316.gcbb84f7.el8 ceph 25 k 2020-04-02T23:19:24.984 INFO:teuthology.orchestra.run.smithi196.stdout: libradosstriper1 x86_642:16.0.0-316.gcbb84f7.el8 ceph 377 k 2020-04-02T23:19:24.984 INFO:teuthology.orchestra.run.smithi196.stdout: librgw2 x86_642:16.0.0-316.gcbb84f7.el8 ceph 3.2 M 2020-04-02T23:19:24.984 INFO:teuthology.orchestra.run.smithi196.stdout: python3-ceph-argparse x86_642:16.0.0-316.gcbb84f7.el8 ceph 40 k 2020-04-02T23:19:24.984 INFO:teuthology.orchestra.run.smithi196.stdout: python3-ceph-common x86_642:16.0.0-316.gcbb84f7.el8 ceph 62 k 2020-04-02T23:19:24.984 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-grafana-dashboards noarch2:16.0.0-316.gcbb84f7.el8 ceph-noarch 22 k 2020-04-02T23:19:24.984 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-modules-core noarch2:16.0.0-316.gcbb84f7.el8 ceph-noarch 161 k 2020-04-02T23:19:24.985 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-prometheus-alerts noarch2:16.0.0-316.gcbb84f7.el8 ceph-noarch 8.7 k 2020-04-02T23:19:24.985 INFO:teuthology.orchestra.run.smithi196.stdout: automake noarch1.16.1-6.el8 CentOS-AppStream 713 k 2020-04-02T23:19:24.985 INFO:teuthology.orchestra.run.smithi196.stdout: jq x86_641.5-12.el8 CentOS-AppStream 161 k 2020-04-02T23:19:24.985 INFO:teuthology.orchestra.run.smithi196.stdout: librdkafka x86_640.11.4-1.el8 CentOS-AppStream 353 k 2020-04-02T23:19:24.985 INFO:teuthology.orchestra.run.smithi196.stdout: lttng-ust x86_642.8.1-11.el8 CentOS-AppStream 259 k 2020-04-02T23:19:24.985 INFO:teuthology.orchestra.run.smithi196.stdout: oniguruma x86_646.8.2-1.el8 CentOS-AppStream 188 k 2020-04-02T23:19:24.986 INFO:teuthology.orchestra.run.smithi196.stdout: openblas x86_640.3.3-2.el8 CentOS-AppStream 4.3 M 2020-04-02T23:19:24.986 INFO:teuthology.orchestra.run.smithi196.stdout: openblas-threads x86_640.3.3-2.el8 CentOS-AppStream 4.4 M 2020-04-02T23:19:24.986 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jsonpatch noarch1.21-2.el8 CentOS-AppStream 27 k 2020-04-02T23:19:24.986 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jsonpointer noarch1.10-11.el8 CentOS-AppStream 20 k 2020-04-02T23:19:24.986 INFO:teuthology.orchestra.run.smithi196.stdout: python3-lxml x86_644.2.3-1.el8 CentOS-AppStream 1.5 M 2020-04-02T23:19:24.986 INFO:teuthology.orchestra.run.smithi196.stdout: python3-mako noarch1.0.6-13.el8 CentOS-AppStream 157 k 2020-04-02T23:19:24.986 INFO:teuthology.orchestra.run.smithi196.stdout: python3-markupsafe x86_640.23-19.el8 CentOS-AppStream 39 k 2020-04-02T23:19:24.986 INFO:teuthology.orchestra.run.smithi196.stdout: python3-numpy x86_641:1.14.3-9.el8 CentOS-AppStream 3.7 M 2020-04-02T23:19:24.987 INFO:teuthology.orchestra.run.smithi196.stdout: python3-numpy-f2py x86_641:1.14.3-9.el8 CentOS-AppStream 225 k 2020-04-02T23:19:24.987 INFO:teuthology.orchestra.run.smithi196.stdout: python3-prettytable noarch0.7.2-14.el8 CentOS-AppStream 44 k 2020-04-02T23:19:24.988 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyasn1 noarch0.3.7-6.el8 CentOS-AppStream 126 k 2020-04-02T23:19:24.988 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyasn1-modules noarch0.3.7-6.el8 CentOS-AppStream 110 k 2020-04-02T23:19:24.988 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pytz noarch2017.2-9.el8 CentOS-AppStream 54 k 2020-04-02T23:19:24.988 INFO:teuthology.orchestra.run.smithi196.stdout: python3-scipy x86_641.0.0-20.module_el8.1.0+245+c39af44f CentOS-AppStream 15 M 2020-04-02T23:19:24.988 INFO:teuthology.orchestra.run.smithi196.stdout: python3-webencodings noarch0.5.1-6.el8 CentOS-AppStream 27 k 2020-04-02T23:19:24.988 INFO:teuthology.orchestra.run.smithi196.stdout: python3-werkzeug noarch0.12.2-4.el8 CentOS-AppStream 457 k 2020-04-02T23:19:24.989 INFO:teuthology.orchestra.run.smithi196.stdout: socat x86_641.7.3.2-6.el8 CentOS-AppStream 298 k 2020-04-02T23:19:24.989 INFO:teuthology.orchestra.run.smithi196.stdout: fuse x86_642.9.7-12.el8 CentOS-Base 82 k 2020-04-02T23:19:24.989 INFO:teuthology.orchestra.run.smithi196.stdout: fuse-common x86_643.2.1-12.el8 CentOS-Base 21 k 2020-04-02T23:19:24.989 INFO:teuthology.orchestra.run.smithi196.stdout: keyutils-libs-devel x86_641.5.10-6.el8 CentOS-Base 48 k 2020-04-02T23:19:24.989 INFO:teuthology.orchestra.run.smithi196.stdout: krb5-devel x86_641.17-9.el8 CentOS-Base 548 k 2020-04-02T23:19:24.989 INFO:teuthology.orchestra.run.smithi196.stdout: libcom_err-devel x86_641.44.6-3.el8 CentOS-Base 38 k 2020-04-02T23:19:24.989 INFO:teuthology.orchestra.run.smithi196.stdout: libgfortran x86_648.3.1-4.5.el8 CentOS-Base 638 k 2020-04-02T23:19:24.989 INFO:teuthology.orchestra.run.smithi196.stdout: libquadmath x86_648.3.1-4.5.el8 CentOS-Base 169 k 2020-04-02T23:19:24.990 INFO:teuthology.orchestra.run.smithi196.stdout: librabbitmq x86_640.9.0-1.el8 CentOS-Base 47 k 2020-04-02T23:19:24.990 INFO:teuthology.orchestra.run.smithi196.stdout: libselinux-devel x86_642.9-2.1.el8 CentOS-Base 199 k 2020-04-02T23:19:24.990 INFO:teuthology.orchestra.run.smithi196.stdout: libsepol-devel x86_642.9-1.el8 CentOS-Base 86 k 2020-04-02T23:19:24.990 INFO:teuthology.orchestra.run.smithi196.stdout: libverto-devel x86_640.3.0-5.el8 CentOS-Base 18 k 2020-04-02T23:19:24.990 INFO:teuthology.orchestra.run.smithi196.stdout: libxslt x86_641.1.32-3.el8 CentOS-Base 249 k 2020-04-02T23:19:24.990 INFO:teuthology.orchestra.run.smithi196.stdout: pcre2-devel x86_6410.32-1.el8 CentOS-Base 605 k 2020-04-02T23:19:24.990 INFO:teuthology.orchestra.run.smithi196.stdout: pcre2-utf16 x86_6410.32-1.el8 CentOS-Base 228 k 2020-04-02T23:19:24.991 INFO:teuthology.orchestra.run.smithi196.stdout: pcre2-utf32 x86_6410.32-1.el8 CentOS-Base 220 k 2020-04-02T23:19:24.991 INFO:teuthology.orchestra.run.smithi196.stdout: python3-chardet noarch3.0.4-7.el8 CentOS-Base 195 k 2020-04-02T23:19:24.991 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jwt noarch1.6.1-2.el8 CentOS-Base 43 k 2020-04-02T23:19:24.991 INFO:teuthology.orchestra.run.smithi196.stdout: python3-oauthlib noarch2.1.0-1.el8 CentOS-Base 155 k 2020-04-02T23:19:24.991 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pysocks noarch1.6.8-3.el8 CentOS-Base 34 k 2020-04-02T23:19:24.991 INFO:teuthology.orchestra.run.smithi196.stdout: python3-requests noarch2.20.0-2.1.el8_1 CentOS-Base 123 k 2020-04-02T23:19:24.991 INFO:teuthology.orchestra.run.smithi196.stdout: python3-requests-oauthlib noarch1.0.0-1.el8 CentOS-Base 43 k 2020-04-02T23:19:24.991 INFO:teuthology.orchestra.run.smithi196.stdout: python3-urllib3 noarch1.24.2-2.el8 CentOS-Base 176 k 2020-04-02T23:19:24.992 INFO:teuthology.orchestra.run.smithi196.stdout: zlib-devel x86_641.2.11-10.el8 CentOS-Base 56 k 2020-04-02T23:19:24.992 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cheroot noarch8.2.1-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 145 k 2020-04-02T23:19:24.992 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cherrypy noarch18.4.0-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 385 k 2020-04-02T23:19:24.992 INFO:teuthology.orchestra.run.smithi196.stdout: python3-execnet noarch1.7.1-1.el8.2 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 356 k 2020-04-02T23:19:24.992 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco noarch6.2-6.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 11 k 2020-04-02T23:19:24.992 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-functools noarch2.0-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 18 k 2020-04-02T23:19:24.992 INFO:teuthology.orchestra.run.smithi196.stdout: python3-logutils noarch0.3.5-11.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 49 k 2020-04-02T23:19:24.993 INFO:teuthology.orchestra.run.smithi196.stdout: python3-more-itertools noarch7.2.0-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 59 k 2020-04-02T23:19:24.993 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pecan noarch1.3.2-9.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 283 k 2020-04-02T23:19:24.993 INFO:teuthology.orchestra.run.smithi196.stdout: python3-portend noarch2.6-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 16 k 2020-04-02T23:19:24.993 INFO:teuthology.orchestra.run.smithi196.stdout: python3-remoto noarch1.1.4-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 48 k 2020-04-02T23:19:24.993 INFO:teuthology.orchestra.run.smithi196.stdout: python3-repoze-lru noarch0.7-6.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 34 k 2020-04-02T23:19:24.993 INFO:teuthology.orchestra.run.smithi196.stdout: python3-routes noarch2.4.1-12.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 197 k 2020-04-02T23:19:24.993 INFO:teuthology.orchestra.run.smithi196.stdout: python3-simplegeneric noarch0.8.1-17.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 19 k 2020-04-02T23:19:24.993 INFO:teuthology.orchestra.run.smithi196.stdout: python3-singledispatch noarch3.4.0.3-18.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 24 k 2020-04-02T23:19:24.994 INFO:teuthology.orchestra.run.smithi196.stdout: python3-tempora noarch1.14.1-5.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 30 k 2020-04-02T23:19:24.994 INFO:teuthology.orchestra.run.smithi196.stdout: python3-trustme noarch0.5.2-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 27 k 2020-04-02T23:19:24.994 INFO:teuthology.orchestra.run.smithi196.stdout: python3-zc-lockfile noarch2.0-2.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 23 k 2020-04-02T23:19:24.994 INFO:teuthology.orchestra.run.smithi196.stdout: gperftools-libs x86_642.7-6.el8 epel 315 k 2020-04-02T23:19:24.994 INFO:teuthology.orchestra.run.smithi196.stdout: liboath x86_642.6.2-3.el8 epel 59 k 2020-04-02T23:19:24.994 INFO:teuthology.orchestra.run.smithi196.stdout: libunwind x86_641.3.1-3.el8 epel 75 k 2020-04-02T23:19:24.994 INFO:teuthology.orchestra.run.smithi196.stdout: python3-apipkg noarch1.5-6.el8 epel 21 k 2020-04-02T23:19:24.995 INFO:teuthology.orchestra.run.smithi196.stdout: python3-bcrypt x86_643.1.6-2.el8.1 epel 44 k 2020-04-02T23:19:24.995 INFO:teuthology.orchestra.run.smithi196.stdout: python3-beautifulsoup4 noarch4.6.3-2.el8.1 epel 185 k 2020-04-02T23:19:24.995 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cachetools noarch3.1.1-4.el8 epel 33 k 2020-04-02T23:19:24.995 INFO:teuthology.orchestra.run.smithi196.stdout: python3-certifi noarch2018.10.15-7.el8 epel 16 k 2020-04-02T23:19:24.995 INFO:teuthology.orchestra.run.smithi196.stdout: python3-google-auth noarch1:1.1.1-10.el8 epel 81 k 2020-04-02T23:19:24.995 INFO:teuthology.orchestra.run.smithi196.stdout: python3-kubernetes noarch10.0.1-2.el8 epel 1.1 M 2020-04-02T23:19:24.995 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rsa noarch3.4.2-12.el8 epel 73 k 2020-04-02T23:19:24.995 INFO:teuthology.orchestra.run.smithi196.stdout: python3-waitress noarch1.2.1-2.el8.1 epel 241 k 2020-04-02T23:19:24.996 INFO:teuthology.orchestra.run.smithi196.stdout: python3-webob noarch1.8.5-1.el8.1 epel 251 k 2020-04-02T23:19:24.996 INFO:teuthology.orchestra.run.smithi196.stdout: python3-websocket-client noarch0.56.0-5.el8 epel 61 k 2020-04-02T23:19:24.996 INFO:teuthology.orchestra.run.smithi196.stdout: python3-webtest noarch2.0.33-1.el8 epel 85 k 2020-04-02T23:19:24.996 INFO:teuthology.orchestra.run.smithi196.stdout: xmlstarlet x86_641.6.1-11.el8 epel 69 k 2020-04-02T23:19:24.996 INFO:teuthology.orchestra.run.smithi196.stdout: leveldb x86_641.21-2.el8 lab-extras 179 k 2020-04-02T23:19:24.996 INFO:teuthology.orchestra.run.smithi196.stdout:Installing weak dependencies: 2020-04-02T23:19:24.996 INFO:teuthology.orchestra.run.smithi196.stdout: python3-html5lib noarch1:0.999999999-6.el8 CentOS-AppStream 214 k 2020-04-02T23:19:24.997 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cssselect noarch0.9.2-10.el8 epel 40 k 2020-04-02T23:19:24.997 INFO:teuthology.orchestra.run.smithi196.stdout: 2020-04-02T23:19:24.997 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction Summary 2020-04-02T23:19:24.997 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2020-04-02T23:19:24.997 INFO:teuthology.orchestra.run.smithi196.stdout:Install 123 Packages 2020-04-02T23:19:24.998 INFO:teuthology.orchestra.run.smithi196.stdout:Upgrade 2 Packages 2020-04-02T23:19:24.998 INFO:teuthology.orchestra.run.smithi196.stdout: 2020-04-02T23:19:24.999 INFO:teuthology.orchestra.run.smithi196.stdout:Total download size: 174 M 2020-04-02T23:19:24.999 INFO:teuthology.orchestra.run.smithi196.stdout:Downloading Packages: 2020-04-02T23:19:25.010 INFO:teuthology.orchestra.run.smithi174.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2020-04-02T23:19:25.011 INFO:teuthology.orchestra.run.smithi174.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2020-04-02T23:19:25.014 INFO:teuthology.orchestra.run.smithi174.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2020-04-02T23:19:25.015 INFO:teuthology.orchestra.run.smithi174.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2020-04-02T23:19:25.016 INFO:teuthology.orchestra.run.smithi174.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2020-04-02T23:19:25.016 INFO:teuthology.orchestra.run.smithi174.stdout:Package xfsprogs-5.0.0-1.el8.x86_64 is already installed. 2020-04-02T23:19:25.141 INFO:teuthology.orchestra.run.smithi174.stdout:Dependencies resolved. 2020-04-02T23:19:25.153 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2020-04-02T23:19:25.153 INFO:teuthology.orchestra.run.smithi174.stdout: Package ArchVersion Repository Size 2020-04-02T23:19:25.153 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2020-04-02T23:19:25.153 INFO:teuthology.orchestra.run.smithi174.stdout:Installing: 2020-04-02T23:19:25.154 INFO:teuthology.orchestra.run.smithi174.stdout: ceph x86_642:16.0.0-316.gcbb84f7.el8 ceph 6.4 k 2020-04-02T23:19:25.154 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-base x86_642:16.0.0-316.gcbb84f7.el8 ceph 5.6 M 2020-04-02T23:19:25.154 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-fuse x86_642:16.0.0-316.gcbb84f7.el8 ceph 573 k 2020-04-02T23:19:25.154 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-immutable-object-cache x86_642:16.0.0-316.gcbb84f7.el8 ceph 203 k 2020-04-02T23:19:25.154 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr x86_642:16.0.0-316.gcbb84f7.el8 ceph 1.4 M 2020-04-02T23:19:25.154 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-radosgw x86_642:16.0.0-316.gcbb84f7.el8 ceph 9.8 M 2020-04-02T23:19:25.154 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-test x86_642:16.0.0-316.gcbb84f7.el8 ceph 42 M 2020-04-02T23:19:25.155 INFO:teuthology.orchestra.run.smithi174.stdout: cephadm x86_642:16.0.0-316.gcbb84f7.el8 ceph 39 k 2020-04-02T23:19:25.155 INFO:teuthology.orchestra.run.smithi174.stdout: libcephfs-devel x86_642:16.0.0-316.gcbb84f7.el8 ceph 21 k 2020-04-02T23:19:25.155 INFO:teuthology.orchestra.run.smithi174.stdout: libcephfs2 x86_642:16.0.0-316.gcbb84f7.el8 ceph 508 k 2020-04-02T23:19:25.155 INFO:teuthology.orchestra.run.smithi174.stdout: librados-devel x86_642:16.0.0-316.gcbb84f7.el8 ceph 141 k 2020-04-02T23:19:25.155 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cephfs x86_642:16.0.0-316.gcbb84f7.el8 ceph 162 k 2020-04-02T23:19:25.155 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rados x86_642:16.0.0-316.gcbb84f7.el8 ceph 352 k 2020-04-02T23:19:25.155 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rbd x86_642:16.0.0-316.gcbb84f7.el8 ceph 331 k 2020-04-02T23:19:25.156 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rgw x86_642:16.0.0-316.gcbb84f7.el8 ceph 113 k 2020-04-02T23:19:25.156 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-fuse x86_642:16.0.0-316.gcbb84f7.el8 ceph 72 k 2020-04-02T23:19:25.156 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-mirror x86_642:16.0.0-316.gcbb84f7.el8 ceph 2.7 M 2020-04-02T23:19:25.156 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-nbd x86_642:16.0.0-316.gcbb84f7.el8 ceph 141 k 2020-04-02T23:19:25.156 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-cephadm noarch2:16.0.0-316.gcbb84f7.el8 ceph-noarch 40 k 2020-04-02T23:19:25.156 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-dashboard noarch2:16.0.0-316.gcbb84f7.el8 ceph-noarch 3.3 M 2020-04-02T23:19:25.156 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-diskprediction-local noarch2:16.0.0-316.gcbb84f7.el8 ceph-noarch 8.6 M 2020-04-02T23:19:25.157 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-rook noarch2:16.0.0-316.gcbb84f7.el8 ceph-noarch 27 k 2020-04-02T23:19:25.157 INFO:teuthology.orchestra.run.smithi174.stdout: bison x86_643.0.4-10.el8 CentOS-AppStream 688 k 2020-04-02T23:19:25.157 INFO:teuthology.orchestra.run.smithi174.stdout: flex x86_642.6.1-9.el8 CentOS-AppStream 320 k 2020-04-02T23:19:25.157 INFO:teuthology.orchestra.run.smithi174.stdout: libtool x86_642.4.6-25.el8 CentOS-AppStream 709 k 2020-04-02T23:19:25.158 INFO:teuthology.orchestra.run.smithi174.stdout: elfutils-libelf-devel x86_640.176-5.el8 CentOS-Base 54 k 2020-04-02T23:19:25.158 INFO:teuthology.orchestra.run.smithi174.stdout: libaio-devel x86_640.3.112-1.el8 CentOS-Base 19 k 2020-04-02T23:19:25.158 INFO:teuthology.orchestra.run.smithi174.stdout: libuuid-devel x86_642.32.1-17.el8 CentOS-Base 95 k 2020-04-02T23:19:25.158 INFO:teuthology.orchestra.run.smithi174.stdout: openssl-devel x86_641:1.1.1c-2.el8 CentOS-Base 2.3 M 2020-04-02T23:19:25.158 INFO:teuthology.orchestra.run.smithi174.stdout: xfsprogs-devel x86_645.0.0-1.el8 CentOS-Base 69 k 2020-04-02T23:19:25.158 INFO:teuthology.orchestra.run.smithi174.stdout:Upgrading: 2020-04-02T23:19:25.158 INFO:teuthology.orchestra.run.smithi174.stdout: librados2 x86_642:16.0.0-316.gcbb84f7.el8 ceph 3.6 M 2020-04-02T23:19:25.159 INFO:teuthology.orchestra.run.smithi174.stdout: librbd1 x86_642:16.0.0-316.gcbb84f7.el8 ceph 1.9 M 2020-04-02T23:19:25.159 INFO:teuthology.orchestra.run.smithi174.stdout:Installing dependencies: 2020-04-02T23:19:25.159 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-common x86_642:16.0.0-316.gcbb84f7.el8 ceph 21 M 2020-04-02T23:19:25.159 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mds x86_642:16.0.0-316.gcbb84f7.el8 ceph 2.0 M 2020-04-02T23:19:25.159 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mon x86_642:16.0.0-316.gcbb84f7.el8 ceph 4.4 M 2020-04-02T23:19:25.159 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-osd x86_642:16.0.0-316.gcbb84f7.el8 ceph 17 M 2020-04-02T23:19:25.160 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-selinux x86_642:16.0.0-316.gcbb84f7.el8 ceph 25 k 2020-04-02T23:19:25.160 INFO:teuthology.orchestra.run.smithi174.stdout: libradosstriper1 x86_642:16.0.0-316.gcbb84f7.el8 ceph 377 k 2020-04-02T23:19:25.160 INFO:teuthology.orchestra.run.smithi174.stdout: librgw2 x86_642:16.0.0-316.gcbb84f7.el8 ceph 3.2 M 2020-04-02T23:19:25.160 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ceph-argparse x86_642:16.0.0-316.gcbb84f7.el8 ceph 40 k 2020-04-02T23:19:25.160 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ceph-common x86_642:16.0.0-316.gcbb84f7.el8 ceph 62 k 2020-04-02T23:19:25.160 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-grafana-dashboards noarch2:16.0.0-316.gcbb84f7.el8 ceph-noarch 22 k 2020-04-02T23:19:25.161 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-modules-core noarch2:16.0.0-316.gcbb84f7.el8 ceph-noarch 161 k 2020-04-02T23:19:25.161 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-prometheus-alerts noarch2:16.0.0-316.gcbb84f7.el8 ceph-noarch 8.7 k 2020-04-02T23:19:25.161 INFO:teuthology.orchestra.run.smithi174.stdout: automake noarch1.16.1-6.el8 CentOS-AppStream 713 k 2020-04-02T23:19:25.161 INFO:teuthology.orchestra.run.smithi174.stdout: jq x86_641.5-12.el8 CentOS-AppStream 161 k 2020-04-02T23:19:25.161 INFO:teuthology.orchestra.run.smithi174.stdout: librdkafka x86_640.11.4-1.el8 CentOS-AppStream 353 k 2020-04-02T23:19:25.161 INFO:teuthology.orchestra.run.smithi174.stdout: lttng-ust x86_642.8.1-11.el8 CentOS-AppStream 259 k 2020-04-02T23:19:25.161 INFO:teuthology.orchestra.run.smithi174.stdout: oniguruma x86_646.8.2-1.el8 CentOS-AppStream 188 k 2020-04-02T23:19:25.162 INFO:teuthology.orchestra.run.smithi174.stdout: openblas x86_640.3.3-2.el8 CentOS-AppStream 4.3 M 2020-04-02T23:19:25.162 INFO:teuthology.orchestra.run.smithi174.stdout: openblas-threads x86_640.3.3-2.el8 CentOS-AppStream 4.4 M 2020-04-02T23:19:25.162 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jsonpatch noarch1.21-2.el8 CentOS-AppStream 27 k 2020-04-02T23:19:25.162 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jsonpointer noarch1.10-11.el8 CentOS-AppStream 20 k 2020-04-02T23:19:25.162 INFO:teuthology.orchestra.run.smithi174.stdout: python3-lxml x86_644.2.3-1.el8 CentOS-AppStream 1.5 M 2020-04-02T23:19:25.162 INFO:teuthology.orchestra.run.smithi174.stdout: python3-mako noarch1.0.6-13.el8 CentOS-AppStream 157 k 2020-04-02T23:19:25.162 INFO:teuthology.orchestra.run.smithi174.stdout: python3-markupsafe x86_640.23-19.el8 CentOS-AppStream 39 k 2020-04-02T23:19:25.163 INFO:teuthology.orchestra.run.smithi174.stdout: python3-numpy x86_641:1.14.3-9.el8 CentOS-AppStream 3.7 M 2020-04-02T23:19:25.163 INFO:teuthology.orchestra.run.smithi174.stdout: python3-numpy-f2py x86_641:1.14.3-9.el8 CentOS-AppStream 225 k 2020-04-02T23:19:25.163 INFO:teuthology.orchestra.run.smithi174.stdout: python3-prettytable noarch0.7.2-14.el8 CentOS-AppStream 44 k 2020-04-02T23:19:25.163 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyasn1 noarch0.3.7-6.el8 CentOS-AppStream 126 k 2020-04-02T23:19:25.163 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyasn1-modules noarch0.3.7-6.el8 CentOS-AppStream 110 k 2020-04-02T23:19:25.163 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pytz noarch2017.2-9.el8 CentOS-AppStream 54 k 2020-04-02T23:19:25.163 INFO:teuthology.orchestra.run.smithi174.stdout: python3-scipy x86_641.0.0-20.module_el8.1.0+245+c39af44f CentOS-AppStream 15 M 2020-04-02T23:19:25.163 INFO:teuthology.orchestra.run.smithi174.stdout: python3-webencodings noarch0.5.1-6.el8 CentOS-AppStream 27 k 2020-04-02T23:19:25.164 INFO:teuthology.orchestra.run.smithi174.stdout: python3-werkzeug noarch0.12.2-4.el8 CentOS-AppStream 457 k 2020-04-02T23:19:25.164 INFO:teuthology.orchestra.run.smithi174.stdout: socat x86_641.7.3.2-6.el8 CentOS-AppStream 298 k 2020-04-02T23:19:25.164 INFO:teuthology.orchestra.run.smithi174.stdout: fuse x86_642.9.7-12.el8 CentOS-Base 82 k 2020-04-02T23:19:25.164 INFO:teuthology.orchestra.run.smithi174.stdout: fuse-common x86_643.2.1-12.el8 CentOS-Base 21 k 2020-04-02T23:19:25.164 INFO:teuthology.orchestra.run.smithi174.stdout: keyutils-libs-devel x86_641.5.10-6.el8 CentOS-Base 48 k 2020-04-02T23:19:25.164 INFO:teuthology.orchestra.run.smithi174.stdout: krb5-devel x86_641.17-9.el8 CentOS-Base 548 k 2020-04-02T23:19:25.164 INFO:teuthology.orchestra.run.smithi174.stdout: libcom_err-devel x86_641.44.6-3.el8 CentOS-Base 38 k 2020-04-02T23:19:25.165 INFO:teuthology.orchestra.run.smithi174.stdout: libgfortran x86_648.3.1-4.5.el8 CentOS-Base 638 k 2020-04-02T23:19:25.165 INFO:teuthology.orchestra.run.smithi174.stdout: libquadmath x86_648.3.1-4.5.el8 CentOS-Base 169 k 2020-04-02T23:19:25.165 INFO:teuthology.orchestra.run.smithi174.stdout: librabbitmq x86_640.9.0-1.el8 CentOS-Base 47 k 2020-04-02T23:19:25.165 INFO:teuthology.orchestra.run.smithi174.stdout: libselinux-devel x86_642.9-2.1.el8 CentOS-Base 199 k 2020-04-02T23:19:25.165 INFO:teuthology.orchestra.run.smithi174.stdout: libsepol-devel x86_642.9-1.el8 CentOS-Base 86 k 2020-04-02T23:19:25.165 INFO:teuthology.orchestra.run.smithi174.stdout: libverto-devel x86_640.3.0-5.el8 CentOS-Base 18 k 2020-04-02T23:19:25.165 INFO:teuthology.orchestra.run.smithi174.stdout: libxslt x86_641.1.32-3.el8 CentOS-Base 249 k 2020-04-02T23:19:25.166 INFO:teuthology.orchestra.run.smithi174.stdout: pcre2-devel x86_6410.32-1.el8 CentOS-Base 605 k 2020-04-02T23:19:25.166 INFO:teuthology.orchestra.run.smithi174.stdout: pcre2-utf16 x86_6410.32-1.el8 CentOS-Base 228 k 2020-04-02T23:19:25.166 INFO:teuthology.orchestra.run.smithi174.stdout: pcre2-utf32 x86_6410.32-1.el8 CentOS-Base 220 k 2020-04-02T23:19:25.166 INFO:teuthology.orchestra.run.smithi174.stdout: python3-chardet noarch3.0.4-7.el8 CentOS-Base 195 k 2020-04-02T23:19:25.166 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jwt noarch1.6.1-2.el8 CentOS-Base 43 k 2020-04-02T23:19:25.166 INFO:teuthology.orchestra.run.smithi174.stdout: python3-oauthlib noarch2.1.0-1.el8 CentOS-Base 155 k 2020-04-02T23:19:25.167 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pysocks noarch1.6.8-3.el8 CentOS-Base 34 k 2020-04-02T23:19:25.167 INFO:teuthology.orchestra.run.smithi174.stdout: python3-requests noarch2.20.0-2.1.el8_1 CentOS-Base 123 k 2020-04-02T23:19:25.167 INFO:teuthology.orchestra.run.smithi174.stdout: python3-requests-oauthlib noarch1.0.0-1.el8 CentOS-Base 43 k 2020-04-02T23:19:25.167 INFO:teuthology.orchestra.run.smithi174.stdout: python3-urllib3 noarch1.24.2-2.el8 CentOS-Base 176 k 2020-04-02T23:19:25.168 INFO:teuthology.orchestra.run.smithi174.stdout: zlib-devel x86_641.2.11-10.el8 CentOS-Base 56 k 2020-04-02T23:19:25.168 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cheroot noarch8.2.1-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 145 k 2020-04-02T23:19:25.168 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cherrypy noarch18.4.0-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 385 k 2020-04-02T23:19:25.168 INFO:teuthology.orchestra.run.smithi174.stdout: python3-execnet noarch1.7.1-1.el8.2 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 356 k 2020-04-02T23:19:25.168 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco noarch6.2-6.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 11 k 2020-04-02T23:19:25.168 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-functools noarch2.0-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 18 k 2020-04-02T23:19:25.168 INFO:teuthology.orchestra.run.smithi174.stdout: python3-logutils noarch0.3.5-11.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 49 k 2020-04-02T23:19:25.169 INFO:teuthology.orchestra.run.smithi174.stdout: python3-more-itertools noarch7.2.0-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 59 k 2020-04-02T23:19:25.169 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pecan noarch1.3.2-9.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 283 k 2020-04-02T23:19:25.169 INFO:teuthology.orchestra.run.smithi174.stdout: python3-portend noarch2.6-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 16 k 2020-04-02T23:19:25.169 INFO:teuthology.orchestra.run.smithi174.stdout: python3-remoto noarch1.1.4-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 48 k 2020-04-02T23:19:25.169 INFO:teuthology.orchestra.run.smithi174.stdout: python3-repoze-lru noarch0.7-6.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 34 k 2020-04-02T23:19:25.169 INFO:teuthology.orchestra.run.smithi174.stdout: python3-routes noarch2.4.1-12.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 197 k 2020-04-02T23:19:25.169 INFO:teuthology.orchestra.run.smithi174.stdout: python3-simplegeneric noarch0.8.1-17.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 19 k 2020-04-02T23:19:25.170 INFO:teuthology.orchestra.run.smithi174.stdout: python3-singledispatch noarch3.4.0.3-18.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 24 k 2020-04-02T23:19:25.170 INFO:teuthology.orchestra.run.smithi174.stdout: python3-tempora noarch1.14.1-5.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 30 k 2020-04-02T23:19:25.170 INFO:teuthology.orchestra.run.smithi174.stdout: python3-trustme noarch0.5.2-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 27 k 2020-04-02T23:19:25.170 INFO:teuthology.orchestra.run.smithi174.stdout: python3-zc-lockfile noarch2.0-2.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 23 k 2020-04-02T23:19:25.170 INFO:teuthology.orchestra.run.smithi174.stdout: gperftools-libs x86_642.7-6.el8 epel 315 k 2020-04-02T23:19:25.170 INFO:teuthology.orchestra.run.smithi174.stdout: liboath x86_642.6.2-3.el8 epel 59 k 2020-04-02T23:19:25.170 INFO:teuthology.orchestra.run.smithi174.stdout: libunwind x86_641.3.1-3.el8 epel 75 k 2020-04-02T23:19:25.171 INFO:teuthology.orchestra.run.smithi174.stdout: python3-apipkg noarch1.5-6.el8 epel 21 k 2020-04-02T23:19:25.171 INFO:teuthology.orchestra.run.smithi174.stdout: python3-bcrypt x86_643.1.6-2.el8.1 epel 44 k 2020-04-02T23:19:25.171 INFO:teuthology.orchestra.run.smithi174.stdout: python3-beautifulsoup4 noarch4.6.3-2.el8.1 epel 185 k 2020-04-02T23:19:25.171 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cachetools noarch3.1.1-4.el8 epel 33 k 2020-04-02T23:19:25.171 INFO:teuthology.orchestra.run.smithi174.stdout: python3-certifi noarch2018.10.15-7.el8 epel 16 k 2020-04-02T23:19:25.171 INFO:teuthology.orchestra.run.smithi174.stdout: python3-google-auth noarch1:1.1.1-10.el8 epel 81 k 2020-04-02T23:19:25.171 INFO:teuthology.orchestra.run.smithi174.stdout: python3-kubernetes noarch10.0.1-2.el8 epel 1.1 M 2020-04-02T23:19:25.171 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rsa noarch3.4.2-12.el8 epel 73 k 2020-04-02T23:19:25.172 INFO:teuthology.orchestra.run.smithi174.stdout: python3-waitress noarch1.2.1-2.el8.1 epel 241 k 2020-04-02T23:19:25.172 INFO:teuthology.orchestra.run.smithi174.stdout: python3-webob noarch1.8.5-1.el8.1 epel 251 k 2020-04-02T23:19:25.172 INFO:teuthology.orchestra.run.smithi174.stdout: python3-websocket-client noarch0.56.0-5.el8 epel 61 k 2020-04-02T23:19:25.172 INFO:teuthology.orchestra.run.smithi174.stdout: python3-webtest noarch2.0.33-1.el8 epel 85 k 2020-04-02T23:19:25.172 INFO:teuthology.orchestra.run.smithi174.stdout: xmlstarlet x86_641.6.1-11.el8 epel 69 k 2020-04-02T23:19:25.172 INFO:teuthology.orchestra.run.smithi174.stdout: leveldb x86_641.21-2.el8 lab-extras 179 k 2020-04-02T23:19:25.172 INFO:teuthology.orchestra.run.smithi174.stdout:Installing weak dependencies: 2020-04-02T23:19:25.173 INFO:teuthology.orchestra.run.smithi174.stdout: python3-html5lib noarch1:0.999999999-6.el8 CentOS-AppStream 214 k 2020-04-02T23:19:25.173 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cssselect noarch0.9.2-10.el8 epel 40 k 2020-04-02T23:19:25.173 INFO:teuthology.orchestra.run.smithi174.stdout: 2020-04-02T23:19:25.173 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction Summary 2020-04-02T23:19:25.173 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2020-04-02T23:19:25.173 INFO:teuthology.orchestra.run.smithi174.stdout:Install 123 Packages 2020-04-02T23:19:25.173 INFO:teuthology.orchestra.run.smithi174.stdout:Upgrade 2 Packages 2020-04-02T23:19:25.173 INFO:teuthology.orchestra.run.smithi174.stdout: 2020-04-02T23:19:25.174 INFO:teuthology.orchestra.run.smithi196.stdout:(1/125): ceph-16.0.0-316.gcbb84f7.el8.x86_64.rp 40 kB/s | 6.4 kB 00:00 2020-04-02T23:19:25.174 INFO:teuthology.orchestra.run.smithi174.stdout:Total download size: 174 M 2020-04-02T23:19:25.174 INFO:teuthology.orchestra.run.smithi174.stdout:Downloading Packages: 2020-04-02T23:19:25.323 INFO:teuthology.orchestra.run.smithi174.stdout:(1/125): ceph-16.0.0-316.gcbb84f7.el8.x86_64.rp 42 kB/s | 6.4 kB 00:00 2020-04-02T23:19:25.376 INFO:teuthology.orchestra.run.smithi196.stdout:(2/125): ceph-fuse-16.0.0-316.gcbb84f7.el8.x86_ 2.5 MB/s | 573 kB 00:00 2020-04-02T23:19:25.415 INFO:teuthology.orchestra.run.smithi196.stdout:(3/125): ceph-immutable-object-cache-16.0.0-316 5.1 MB/s | 203 kB 00:00 2020-04-02T23:19:25.550 INFO:teuthology.orchestra.run.smithi174.stdout:(2/125): ceph-fuse-16.0.0-316.gcbb84f7.el8.x86_ 2.5 MB/s | 573 kB 00:00 2020-04-02T23:19:25.598 INFO:teuthology.orchestra.run.smithi174.stdout:(3/125): ceph-immutable-object-cache-16.0.0-316 4.1 MB/s | 203 kB 00:00 2020-04-02T23:19:25.857 INFO:teuthology.orchestra.run.smithi196.stdout:(4/125): ceph-mds-16.0.0-316.gcbb84f7.el8.x86_6 4.6 MB/s | 2.0 MB 00:00 2020-04-02T23:19:26.133 INFO:teuthology.orchestra.run.smithi174.stdout:(4/125): ceph-mds-16.0.0-316.gcbb84f7.el8.x86_6 3.8 MB/s | 2.0 MB 00:00 2020-04-02T23:19:26.193 INFO:teuthology.orchestra.run.smithi196.stdout:(5/125): ceph-mgr-16.0.0-316.gcbb84f7.el8.x86_6 4.3 MB/s | 1.4 MB 00:00 2020-04-02T23:19:26.221 INFO:teuthology.orchestra.run.smithi196.stdout:(6/125): ceph-base-16.0.0-316.gcbb84f7.el8.x86_ 4.6 MB/s | 5.6 MB 00:01 2020-04-02T23:19:26.509 INFO:teuthology.orchestra.run.smithi174.stdout:(5/125): ceph-mgr-16.0.0-316.gcbb84f7.el8.x86_6 3.8 MB/s | 1.4 MB 00:00 2020-04-02T23:19:26.564 INFO:teuthology.orchestra.run.smithi174.stdout:(6/125): ceph-base-16.0.0-316.gcbb84f7.el8.x86_ 4.0 MB/s | 5.6 MB 00:01 2020-04-02T23:19:27.147 INFO:teuthology.orchestra.run.smithi196.stdout:(7/125): ceph-mon-16.0.0-316.gcbb84f7.el8.x86_6 4.5 MB/s | 4.4 MB 00:00 2020-04-02T23:19:27.504 INFO:teuthology.orchestra.run.smithi174.stdout:(7/125): ceph-mon-16.0.0-316.gcbb84f7.el8.x86_6 4.4 MB/s | 4.4 MB 00:00 2020-04-02T23:19:28.776 INFO:teuthology.orchestra.run.smithi174.stdout:(8/125): ceph-osd-16.0.0-316.gcbb84f7.el8.x86_6 7.5 MB/s | 17 MB 00:02 2020-04-02T23:19:28.826 INFO:teuthology.orchestra.run.smithi174.stdout:(9/125): ceph-selinux-16.0.0-316.gcbb84f7.el8.x 499 kB/s | 25 kB 00:00 2020-04-02T23:19:28.875 INFO:teuthology.orchestra.run.smithi196.stdout:(8/125): ceph-osd-16.0.0-316.gcbb84f7.el8.x86_6 6.3 MB/s | 17 MB 00:02 2020-04-02T23:19:28.945 INFO:teuthology.orchestra.run.smithi196.stdout:(9/125): ceph-radosgw-16.0.0-316.gcbb84f7.el8.x 5.5 MB/s | 9.8 MB 00:01 2020-04-02T23:19:28.945 INFO:teuthology.orchestra.run.smithi196.stdout:(10/125): ceph-selinux-16.0.0-316.gcbb84f7.el8. 356 kB/s | 25 kB 00:00 2020-04-02T23:19:29.021 INFO:teuthology.orchestra.run.smithi196.stdout:(11/125): cephadm-16.0.0-316.gcbb84f7.el8.x86_6 519 kB/s | 39 kB 00:00 2020-04-02T23:19:29.095 INFO:teuthology.orchestra.run.smithi196.stdout:(12/125): libcephfs-devel-16.0.0-316.gcbb84f7.e 289 kB/s | 21 kB 00:00 2020-04-02T23:19:29.188 INFO:teuthology.orchestra.run.smithi196.stdout:(13/125): libcephfs2-16.0.0-316.gcbb84f7.el8.x8 5.3 MB/s | 508 kB 00:00 2020-04-02T23:19:29.266 INFO:teuthology.orchestra.run.smithi196.stdout:(14/125): librados-devel-16.0.0-316.gcbb84f7.el 1.8 MB/s | 141 kB 00:00 2020-04-02T23:19:29.354 INFO:teuthology.orchestra.run.smithi196.stdout:(15/125): libradosstriper1-16.0.0-316.gcbb84f7. 4.2 MB/s | 377 kB 00:00 2020-04-02T23:19:29.700 INFO:teuthology.orchestra.run.smithi174.stdout:(10/125): ceph-radosgw-16.0.0-316.gcbb84f7.el8. 4.5 MB/s | 9.8 MB 00:02 2020-04-02T23:19:29.783 INFO:teuthology.orchestra.run.smithi174.stdout:(11/125): cephadm-16.0.0-316.gcbb84f7.el8.x86_6 477 kB/s | 39 kB 00:00 2020-04-02T23:19:29.866 INFO:teuthology.orchestra.run.smithi174.stdout:(12/125): libcephfs-devel-16.0.0-316.gcbb84f7.e 258 kB/s | 21 kB 00:00 2020-04-02T23:19:29.876 INFO:teuthology.orchestra.run.smithi196.stdout:(16/125): librgw2-16.0.0-316.gcbb84f7.el8.x86_6 6.1 MB/s | 3.2 MB 00:00 2020-04-02T23:19:29.960 INFO:teuthology.orchestra.run.smithi196.stdout:(17/125): python3-ceph-argparse-16.0.0-316.gcbb 499 kB/s | 40 kB 00:00 2020-04-02T23:19:30.011 INFO:teuthology.orchestra.run.smithi174.stdout:(13/125): libcephfs2-16.0.0-316.gcbb84f7.el8.x8 3.4 MB/s | 508 kB 00:00 2020-04-02T23:19:30.023 INFO:teuthology.orchestra.run.smithi196.stdout:(18/125): python3-ceph-common-16.0.0-316.gcbb84 928 kB/s | 62 kB 00:00 2020-04-02T23:19:30.080 INFO:teuthology.orchestra.run.smithi174.stdout:(14/125): librados-devel-16.0.0-316.gcbb84f7.el 2.0 MB/s | 141 kB 00:00 2020-04-02T23:19:30.096 INFO:teuthology.orchestra.run.smithi196.stdout:(19/125): python3-cephfs-16.0.0-316.gcbb84f7.el 2.2 MB/s | 162 kB 00:00 2020-04-02T23:19:30.161 INFO:teuthology.orchestra.run.smithi174.stdout:(15/125): libradosstriper1-16.0.0-316.gcbb84f7. 4.6 MB/s | 377 kB 00:00 2020-04-02T23:19:30.184 INFO:teuthology.orchestra.run.smithi196.stdout:(20/125): python3-rados-16.0.0-316.gcbb84f7.el8 3.9 MB/s | 352 kB 00:00 2020-04-02T23:19:30.279 INFO:teuthology.orchestra.run.smithi196.stdout:(21/125): python3-rbd-16.0.0-316.gcbb84f7.el8.x 3.6 MB/s | 331 kB 00:00 2020-04-02T23:19:30.356 INFO:teuthology.orchestra.run.smithi196.stdout:(22/125): python3-rgw-16.0.0-316.gcbb84f7.el8.x 1.4 MB/s | 113 kB 00:00 2020-04-02T23:19:30.437 INFO:teuthology.orchestra.run.smithi196.stdout:(23/125): rbd-fuse-16.0.0-316.gcbb84f7.el8.x86_ 890 kB/s | 72 kB 00:00 2020-04-02T23:19:30.858 INFO:teuthology.orchestra.run.smithi174.stdout:(16/125): librgw2-16.0.0-316.gcbb84f7.el8.x86_6 4.5 MB/s | 3.2 MB 00:00 2020-04-02T23:19:30.928 INFO:teuthology.orchestra.run.smithi174.stdout:(17/125): python3-ceph-argparse-16.0.0-316.gcbb 570 kB/s | 40 kB 00:00 2020-04-02T23:19:30.945 INFO:teuthology.orchestra.run.smithi196.stdout:(24/125): rbd-mirror-16.0.0-316.gcbb84f7.el8.x8 5.3 MB/s | 2.7 MB 00:00 2020-04-02T23:19:30.991 INFO:teuthology.orchestra.run.smithi174.stdout:(18/125): python3-ceph-common-16.0.0-316.gcbb84 990 kB/s | 62 kB 00:00 2020-04-02T23:19:31.006 INFO:teuthology.orchestra.run.smithi196.stdout:(25/125): rbd-nbd-16.0.0-316.gcbb84f7.el8.x86_6 2.3 MB/s | 141 kB 00:00 2020-04-02T23:19:31.055 INFO:teuthology.orchestra.run.smithi174.stdout:(19/125): python3-cephfs-16.0.0-316.gcbb84f7.el 2.5 MB/s | 162 kB 00:00 2020-04-02T23:19:31.066 INFO:teuthology.orchestra.run.smithi196.stdout:(26/125): ceph-grafana-dashboards-16.0.0-316.gc 376 kB/s | 22 kB 00:00 2020-04-02T23:19:31.132 INFO:teuthology.orchestra.run.smithi196.stdout:(27/125): ceph-mgr-cephadm-16.0.0-316.gcbb84f7. 599 kB/s | 40 kB 00:00 2020-04-02T23:19:31.175 INFO:teuthology.orchestra.run.smithi174.stdout:(20/125): python3-rados-16.0.0-316.gcbb84f7.el8 2.9 MB/s | 352 kB 00:00 2020-04-02T23:19:31.308 INFO:teuthology.orchestra.run.smithi174.stdout:(21/125): python3-rbd-16.0.0-316.gcbb84f7.el8.x 2.4 MB/s | 331 kB 00:00 2020-04-02T23:19:31.335 INFO:teuthology.orchestra.run.smithi196.stdout:(28/125): ceph-common-16.0.0-316.gcbb84f7.el8.x 3.3 MB/s | 21 MB 00:06 2020-04-02T23:19:31.351 INFO:teuthology.orchestra.run.smithi174.stdout:(22/125): python3-rgw-16.0.0-316.gcbb84f7.el8.x 2.7 MB/s | 113 kB 00:00 2020-04-02T23:19:31.421 INFO:teuthology.orchestra.run.smithi174.stdout:(23/125): rbd-fuse-16.0.0-316.gcbb84f7.el8.x86_ 995 kB/s | 72 kB 00:00 2020-04-02T23:19:31.765 INFO:teuthology.orchestra.run.smithi196.stdout:(29/125): ceph-mgr-dashboard-16.0.0-316.gcbb84f 5.3 MB/s | 3.3 MB 00:00 2020-04-02T23:19:31.838 INFO:teuthology.orchestra.run.smithi196.stdout:(30/125): ceph-mgr-modules-core-16.0.0-316.gcbb 2.2 MB/s | 161 kB 00:00 2020-04-02T23:19:31.909 INFO:teuthology.orchestra.run.smithi196.stdout:(31/125): ceph-mgr-rook-16.0.0-316.gcbb84f7.el8 400 kB/s | 27 kB 00:00 2020-04-02T23:19:31.974 INFO:teuthology.orchestra.run.smithi196.stdout:(32/125): ceph-prometheus-alerts-16.0.0-316.gcb 130 kB/s | 8.7 kB 00:00 2020-04-02T23:19:32.019 INFO:teuthology.orchestra.run.smithi196.stdout:(33/125): automake-1.16.1-6.el8.noarch.rpm 15 MB/s | 713 kB 00:00 2020-04-02T23:19:32.029 INFO:teuthology.orchestra.run.smithi196.stdout:(34/125): bison-3.0.4-10.el8.x86_64.rpm 68 MB/s | 688 kB 00:00 2020-04-02T23:19:32.034 INFO:teuthology.orchestra.run.smithi196.stdout:(35/125): flex-2.6.1-9.el8.x86_64.rpm 67 MB/s | 320 kB 00:00 2020-04-02T23:19:32.036 INFO:teuthology.orchestra.run.smithi196.stdout:(36/125): jq-1.5-12.el8.x86_64.rpm 58 MB/s | 161 kB 00:00 2020-04-02T23:19:32.042 INFO:teuthology.orchestra.run.smithi196.stdout:(37/125): librdkafka-0.11.4-1.el8.x86_64.rpm 69 MB/s | 353 kB 00:00 2020-04-02T23:19:32.051 INFO:teuthology.orchestra.run.smithi196.stdout:(38/125): libtool-2.4.6-25.el8.x86_64.rpm 75 MB/s | 709 kB 00:00 2020-04-02T23:19:32.055 INFO:teuthology.orchestra.run.smithi196.stdout:(39/125): lttng-ust-2.8.1-11.el8.x86_64.rpm 66 MB/s | 259 kB 00:00 2020-04-02T23:19:32.058 INFO:teuthology.orchestra.run.smithi196.stdout:(40/125): oniguruma-6.8.2-1.el8.x86_64.rpm 60 MB/s | 188 kB 00:00 2020-04-02T23:19:32.094 INFO:teuthology.orchestra.run.smithi174.stdout:(24/125): rbd-mirror-16.0.0-316.gcbb84f7.el8.x8 4.0 MB/s | 2.7 MB 00:00 2020-04-02T23:19:32.109 INFO:teuthology.orchestra.run.smithi196.stdout:(41/125): openblas-0.3.3-2.el8.x86_64.rpm 85 MB/s | 4.3 MB 00:00 2020-04-02T23:19:32.159 INFO:teuthology.orchestra.run.smithi174.stdout:(25/125): rbd-nbd-16.0.0-316.gcbb84f7.el8.x86_6 2.1 MB/s | 141 kB 00:00 2020-04-02T23:19:32.162 INFO:teuthology.orchestra.run.smithi196.stdout:(42/125): openblas-threads-0.3.3-2.el8.x86_64.r 83 MB/s | 4.4 MB 00:00 2020-04-02T23:19:32.166 INFO:teuthology.orchestra.run.smithi196.stdout:(43/125): python3-html5lib-0.999999999-6.el8.no 58 MB/s | 214 kB 00:00 2020-04-02T23:19:32.173 INFO:teuthology.orchestra.run.smithi196.stdout:(44/125): python3-jsonpatch-1.21-2.el8.noarch.r 20 MB/s | 27 kB 00:00 2020-04-02T23:19:32.173 INFO:teuthology.orchestra.run.smithi196.stdout:(45/125): python3-jsonpointer-1.10-11.el8.noarc 16 MB/s | 20 kB 00:00 2020-04-02T23:19:32.188 INFO:teuthology.orchestra.run.smithi196.stdout:(46/125): python3-lxml-4.2.3-1.el8.x86_64.rpm 82 MB/s | 1.5 MB 00:00 2020-04-02T23:19:32.191 INFO:teuthology.orchestra.run.smithi196.stdout:(47/125): python3-mako-1.0.6-13.el8.noarch.rpm 56 MB/s | 157 kB 00:00 2020-04-02T23:19:32.192 INFO:teuthology.orchestra.run.smithi196.stdout:(48/125): python3-markupsafe-0.23-19.el8.x86_64 28 MB/s | 39 kB 00:00 2020-04-02T23:19:32.215 INFO:teuthology.orchestra.run.smithi174.stdout:(26/125): ceph-grafana-dashboards-16.0.0-316.gc 401 kB/s | 22 kB 00:00 2020-04-02T23:19:32.236 INFO:teuthology.orchestra.run.smithi196.stdout:(49/125): python3-numpy-1.14.3-9.el8.x86_64.rpm 85 MB/s | 3.7 MB 00:00 2020-04-02T23:19:32.240 INFO:teuthology.orchestra.run.smithi196.stdout:(50/125): python3-numpy-f2py-1.14.3-9.el8.x86_6 62 MB/s | 225 kB 00:00 2020-04-02T23:19:32.244 INFO:teuthology.orchestra.run.smithi196.stdout:(51/125): python3-prettytable-0.7.2-14.el8.noar 31 MB/s | 44 kB 00:00 2020-04-02T23:19:32.245 INFO:teuthology.orchestra.run.smithi196.stdout:(52/125): python3-pyasn1-0.3.7-6.el8.noarch.rpm 53 MB/s | 126 kB 00:00 2020-04-02T23:19:32.246 INFO:teuthology.orchestra.run.smithi196.stdout:(53/125): python3-pyasn1-modules-0.3.7-6.el8.no 53 MB/s | 110 kB 00:00 2020-04-02T23:19:32.248 INFO:teuthology.orchestra.run.smithi196.stdout:(54/125): python3-pytz-2017.2-9.el8.noarch.rpm 34 MB/s | 54 kB 00:00 2020-04-02T23:19:32.275 INFO:teuthology.orchestra.run.smithi174.stdout:(27/125): ceph-mgr-cephadm-16.0.0-316.gcbb84f7. 684 kB/s | 40 kB 00:00 2020-04-02T23:19:32.480 INFO:teuthology.orchestra.run.smithi196.stdout:(55/125): python3-scipy-1.0.0-20.module_el8.1.0 63 MB/s | 15 MB 00:00 2020-04-02T23:19:32.482 INFO:teuthology.orchestra.run.smithi196.stdout:(56/125): python3-webencodings-0.5.1-6.el8.noar 19 MB/s | 27 kB 00:00 2020-04-02T23:19:32.488 INFO:teuthology.orchestra.run.smithi196.stdout:(57/125): python3-werkzeug-0.12.2-4.el8.noarch. 75 MB/s | 457 kB 00:00 2020-04-02T23:19:32.492 INFO:teuthology.orchestra.run.smithi196.stdout:(58/125): socat-1.7.3.2-6.el8.x86_64.rpm 69 MB/s | 298 kB 00:00 2020-04-02T23:19:32.494 INFO:teuthology.orchestra.run.smithi196.stdout:(59/125): elfutils-libelf-devel-0.176-5.el8.x86 37 MB/s | 54 kB 00:00 2020-04-02T23:19:32.496 INFO:teuthology.orchestra.run.smithi196.stdout:(60/125): fuse-2.9.7-12.el8.x86_64.rpm 40 MB/s | 82 kB 00:00 2020-04-02T23:19:32.497 INFO:teuthology.orchestra.run.smithi196.stdout:(61/125): fuse-common-3.2.1-12.el8.x86_64.rpm 19 MB/s | 21 kB 00:00 2020-04-02T23:19:32.499 INFO:teuthology.orchestra.run.smithi196.stdout:(62/125): keyutils-libs-devel-1.5.10-6.el8.x86_ 33 MB/s | 48 kB 00:00 2020-04-02T23:19:32.506 INFO:teuthology.orchestra.run.smithi196.stdout:(63/125): krb5-devel-1.17-9.el8.x86_64.rpm 76 MB/s | 548 kB 00:00 2020-04-02T23:19:32.507 INFO:teuthology.orchestra.run.smithi196.stdout:(64/125): libaio-devel-0.3.112-1.el8.x86_64.rpm 15 MB/s | 19 kB 00:00 2020-04-02T23:19:32.509 INFO:teuthology.orchestra.run.smithi196.stdout:(65/125): libcom_err-devel-1.44.6-3.el8.x86_64. 28 MB/s | 38 kB 00:00 2020-04-02T23:19:32.517 INFO:teuthology.orchestra.run.smithi196.stdout:(66/125): libgfortran-8.3.1-4.5.el8.x86_64.rpm 78 MB/s | 638 kB 00:00 2020-04-02T23:19:32.520 INFO:teuthology.orchestra.run.smithi196.stdout:(67/125): libquadmath-8.3.1-4.5.el8.x86_64.rpm 59 MB/s | 169 kB 00:00 2020-04-02T23:19:32.522 INFO:teuthology.orchestra.run.smithi196.stdout:(68/125): librabbitmq-0.9.0-1.el8.x86_64.rpm 33 MB/s | 47 kB 00:00 2020-04-02T23:19:32.529 INFO:teuthology.orchestra.run.smithi196.stdout:(69/125): libselinux-devel-2.9-2.1.el8.x86_64.r 66 MB/s | 199 kB 00:00 2020-04-02T23:19:32.529 INFO:teuthology.orchestra.run.smithi196.stdout:(70/125): libsepol-devel-2.9-1.el8.x86_64.rpm 48 MB/s | 86 kB 00:00 2020-04-02T23:19:32.529 INFO:teuthology.orchestra.run.smithi196.stdout:(71/125): libuuid-devel-2.32.1-17.el8.x86_64.rp 49 MB/s | 95 kB 00:00 2020-04-02T23:19:32.530 INFO:teuthology.orchestra.run.smithi196.stdout:(72/125): libverto-devel-0.3.0-5.el8.x86_64.rpm 16 MB/s | 18 kB 00:00 2020-04-02T23:19:32.534 INFO:teuthology.orchestra.run.smithi196.stdout:(73/125): libxslt-1.1.32-3.el8.x86_64.rpm 66 MB/s | 249 kB 00:00 2020-04-02T23:19:32.561 INFO:teuthology.orchestra.run.smithi196.stdout:(74/125): openssl-devel-1.1.1c-2.el8.x86_64.rpm 84 MB/s | 2.3 MB 00:00 2020-04-02T23:19:32.570 INFO:teuthology.orchestra.run.smithi196.stdout:(75/125): pcre2-devel-10.32-1.el8.x86_64.rpm 75 MB/s | 605 kB 00:00 2020-04-02T23:19:32.573 INFO:teuthology.orchestra.run.smithi196.stdout:(76/125): pcre2-utf16-10.32-1.el8.x86_64.rpm 64 MB/s | 228 kB 00:00 2020-04-02T23:19:32.576 INFO:teuthology.orchestra.run.smithi196.stdout:(77/125): pcre2-utf32-10.32-1.el8.x86_64.rpm 64 MB/s | 220 kB 00:00 2020-04-02T23:19:32.580 INFO:teuthology.orchestra.run.smithi196.stdout:(78/125): python3-chardet-3.0.4-7.el8.noarch.rp 64 MB/s | 195 kB 00:00 2020-04-02T23:19:32.581 INFO:teuthology.orchestra.run.smithi196.stdout:(79/125): python3-jwt-1.6.1-2.el8.noarch.rpm 31 MB/s | 43 kB 00:00 2020-04-02T23:19:32.584 INFO:teuthology.orchestra.run.smithi196.stdout:(80/125): python3-oauthlib-2.1.0-1.el8.noarch.r 59 MB/s | 155 kB 00:00 2020-04-02T23:19:32.585 INFO:teuthology.orchestra.run.smithi196.stdout:(81/125): python3-pysocks-1.6.8-3.el8.noarch.rp 23 MB/s | 34 kB 00:00 2020-04-02T23:19:32.588 INFO:teuthology.orchestra.run.smithi196.stdout:(82/125): python3-requests-2.20.0-2.1.el8_1.noa 54 MB/s | 123 kB 00:00 2020-04-02T23:19:32.589 INFO:teuthology.orchestra.run.smithi196.stdout:(83/125): python3-requests-oauthlib-1.0.0-1.el8 29 MB/s | 43 kB 00:00 2020-04-02T23:19:32.592 INFO:teuthology.orchestra.run.smithi196.stdout:(84/125): python3-urllib3-1.24.2-2.el8.noarch.r 60 MB/s | 176 kB 00:00 2020-04-02T23:19:32.598 INFO:teuthology.orchestra.run.smithi196.stdout:(85/125): xfsprogs-devel-5.0.0-1.el8.x86_64.rpm 35 MB/s | 69 kB 00:00 2020-04-02T23:19:32.598 INFO:teuthology.orchestra.run.smithi196.stdout:(86/125): zlib-devel-1.2.11-10.el8.x86_64.rpm 35 MB/s | 56 kB 00:00 2020-04-02T23:19:32.655 INFO:teuthology.orchestra.run.smithi196.stdout:(87/125): python3-cheroot-8.2.1-1.el8.noarch.rp 2.4 MB/s | 145 kB 00:00 2020-04-02T23:19:32.676 INFO:teuthology.orchestra.run.smithi196.stdout:(88/125): python3-cherrypy-18.4.0-1.el8.noarch. 18 MB/s | 385 kB 00:00 2020-04-02T23:19:32.689 INFO:teuthology.orchestra.run.smithi196.stdout:(89/125): python3-execnet-1.7.1-1.el8.2.noarch. 26 MB/s | 356 kB 00:00 2020-04-02T23:19:32.699 INFO:teuthology.orchestra.run.smithi196.stdout:(90/125): python3-jaraco-6.2-6.el8.noarch.rpm 1.2 MB/s | 11 kB 00:00 2020-04-02T23:19:32.707 INFO:teuthology.orchestra.run.smithi196.stdout:(91/125): python3-jaraco-functools-2.0-4.el8.no 2.1 MB/s | 18 kB 00:00 2020-04-02T23:19:32.715 INFO:teuthology.orchestra.run.smithi196.stdout:(92/125): python3-logutils-0.3.5-11.el8.noarch. 5.8 MB/s | 49 kB 00:00 2020-04-02T23:19:32.724 INFO:teuthology.orchestra.run.smithi196.stdout:(93/125): python3-more-itertools-7.2.0-4.el8.no 6.7 MB/s | 59 kB 00:00 2020-04-02T23:19:32.736 INFO:teuthology.orchestra.run.smithi196.stdout:(94/125): python3-pecan-1.3.2-9.el8.noarch.rpm 24 MB/s | 283 kB 00:00 2020-04-02T23:19:32.745 INFO:teuthology.orchestra.run.smithi196.stdout:(95/125): python3-portend-2.6-1.el8.noarch.rpm 2.0 MB/s | 16 kB 00:00 2020-04-02T23:19:32.761 INFO:teuthology.orchestra.run.smithi196.stdout:(96/125): python3-remoto-1.1.4-4.el8.noarch.rpm 3.9 MB/s | 48 kB 00:00 2020-04-02T23:19:32.771 INFO:teuthology.orchestra.run.smithi196.stdout:(97/125): python3-repoze-lru-0.7-6.el8.noarch.r 4.0 MB/s | 34 kB 00:00 2020-04-02T23:19:32.775 INFO:teuthology.orchestra.run.smithi196.stdout:(98/125): python3-routes-2.4.1-12.el8.noarch.rp 19 MB/s | 197 kB 00:00 2020-04-02T23:19:32.784 INFO:teuthology.orchestra.run.smithi196.stdout:(99/125): python3-simplegeneric-0.8.1-17.el8.no 2.1 MB/s | 19 kB 00:00 2020-04-02T23:19:32.793 INFO:teuthology.orchestra.run.smithi196.stdout:(100/125): python3-singledispatch-3.4.0.3-18.el 2.8 MB/s | 24 kB 00:00 2020-04-02T23:19:32.801 INFO:teuthology.orchestra.run.smithi196.stdout:(101/125): python3-tempora-1.14.1-5.el8.noarch. 3.6 MB/s | 30 kB 00:00 2020-04-02T23:19:32.810 INFO:teuthology.orchestra.run.smithi196.stdout:(102/125): python3-trustme-0.5.2-4.el8.noarch.r 3.0 MB/s | 27 kB 00:00 2020-04-02T23:19:32.818 INFO:teuthology.orchestra.run.smithi196.stdout:(103/125): python3-zc-lockfile-2.0-2.el8.noarch 2.8 MB/s | 23 kB 00:00 2020-04-02T23:19:32.931 INFO:teuthology.orchestra.run.smithi196.stdout:(104/125): gperftools-libs-2.7-6.el8.x86_64.rpm 2.7 MB/s | 315 kB 00:00 2020-04-02T23:19:32.948 INFO:teuthology.orchestra.run.smithi174.stdout:(28/125): ceph-common-16.0.0-316.gcbb84f7.el8.x 2.7 MB/s | 21 MB 00:07 2020-04-02T23:19:32.950 INFO:teuthology.orchestra.run.smithi196.stdout:(105/125): liboath-2.6.2-3.el8.x86_64.rpm 3.0 MB/s | 59 kB 00:00 2020-04-02T23:19:32.965 INFO:teuthology.orchestra.run.smithi174.stdout:(29/125): ceph-mgr-dashboard-16.0.0-316.gcbb84f 4.8 MB/s | 3.3 MB 00:00 2020-04-02T23:19:32.970 INFO:teuthology.orchestra.run.smithi196.stdout:(106/125): libunwind-1.3.1-3.el8.x86_64.rpm 3.8 MB/s | 75 kB 00:00 2020-04-02T23:19:32.989 INFO:teuthology.orchestra.run.smithi196.stdout:(107/125): python3-apipkg-1.5-6.el8.noarch.rpm 1.1 MB/s | 21 kB 00:00 2020-04-02T23:19:33.008 INFO:teuthology.orchestra.run.smithi196.stdout:(108/125): python3-bcrypt-3.1.6-2.el8.1.x86_64. 2.2 MB/s | 44 kB 00:00 2020-04-02T23:19:33.028 INFO:teuthology.orchestra.run.smithi196.stdout:(109/125): python3-beautifulsoup4-4.6.3-2.el8.1 9.1 MB/s | 185 kB 00:00 2020-04-02T23:19:33.030 INFO:teuthology.orchestra.run.smithi174.stdout:(30/125): ceph-mgr-modules-core-16.0.0-316.gcbb 2.4 MB/s | 161 kB 00:00 2020-04-02T23:19:33.047 INFO:teuthology.orchestra.run.smithi196.stdout:(110/125): python3-cachetools-3.1.1-4.el8.noarc 1.7 MB/s | 33 kB 00:00 2020-04-02T23:19:33.066 INFO:teuthology.orchestra.run.smithi196.stdout:(111/125): python3-certifi-2018.10.15-7.el8.noa 858 kB/s | 16 kB 00:00 2020-04-02T23:19:33.085 INFO:teuthology.orchestra.run.smithi196.stdout:(112/125): python3-cssselect-0.9.2-10.el8.noarc 2.1 MB/s | 40 kB 00:00 2020-04-02T23:19:33.106 INFO:teuthology.orchestra.run.smithi196.stdout:(113/125): python3-google-auth-1.1.1-10.el8.noa 4.1 MB/s | 81 kB 00:00 2020-04-02T23:19:33.182 INFO:teuthology.orchestra.run.smithi196.stdout:(114/125): python3-kubernetes-10.0.1-2.el8.noar 14 MB/s | 1.1 MB 00:00 2020-04-02T23:19:33.201 INFO:teuthology.orchestra.run.smithi196.stdout:(115/125): python3-rsa-3.4.2-12.el8.noarch.rpm 3.7 MB/s | 73 kB 00:00 2020-04-02T23:19:33.222 INFO:teuthology.orchestra.run.smithi196.stdout:(116/125): python3-waitress-1.2.1-2.el8.1.noarc 11 MB/s | 241 kB 00:00 2020-04-02T23:19:33.243 INFO:teuthology.orchestra.run.smithi196.stdout:(117/125): python3-webob-1.8.5-1.el8.1.noarch.r 12 MB/s | 251 kB 00:00 2020-04-02T23:19:33.262 INFO:teuthology.orchestra.run.smithi196.stdout:(118/125): python3-websocket-client-0.56.0-5.el 3.1 MB/s | 61 kB 00:00 2020-04-02T23:19:33.282 INFO:teuthology.orchestra.run.smithi196.stdout:(119/125): python3-webtest-2.0.33-1.el8.noarch. 4.2 MB/s | 85 kB 00:00 2020-04-02T23:19:33.302 INFO:teuthology.orchestra.run.smithi196.stdout:(120/125): xmlstarlet-1.6.1-11.el8.x86_64.rpm 3.5 MB/s | 69 kB 00:00 2020-04-02T23:19:33.307 INFO:teuthology.orchestra.run.smithi196.stdout:(121/125): leveldb-1.21-2.el8.x86_64.rpm 40 MB/s | 179 kB 00:00 2020-04-02T23:19:33.364 INFO:teuthology.orchestra.run.smithi174.stdout:(31/125): ceph-test-16.0.0-316.gcbb84f7.el8.x86 9.2 MB/s | 42 MB 00:04 2020-04-02T23:19:33.365 INFO:teuthology.orchestra.run.smithi174.stdout:(32/125): ceph-mgr-rook-16.0.0-316.gcbb84f7.el8 81 kB/s | 27 kB 00:00 2020-04-02T23:19:33.403 INFO:teuthology.orchestra.run.smithi174.stdout:(33/125): automake-1.16.1-6.el8.noarch.rpm 18 MB/s | 713 kB 00:00 2020-04-02T23:19:33.404 INFO:teuthology.orchestra.run.smithi174.stdout:(34/125): ceph-prometheus-alerts-16.0.0-316.gcb 224 kB/s | 8.7 kB 00:00 2020-04-02T23:19:33.417 INFO:teuthology.orchestra.run.smithi174.stdout:(35/125): bison-3.0.4-10.el8.x86_64.rpm 50 MB/s | 688 kB 00:00 2020-04-02T23:19:33.420 INFO:teuthology.orchestra.run.smithi174.stdout:(36/125): jq-1.5-12.el8.x86_64.rpm 61 MB/s | 161 kB 00:00 2020-04-02T23:19:33.424 INFO:teuthology.orchestra.run.smithi174.stdout:(37/125): librdkafka-0.11.4-1.el8.x86_64.rpm 73 MB/s | 353 kB 00:00 2020-04-02T23:19:33.433 INFO:teuthology.orchestra.run.smithi174.stdout:(38/125): libtool-2.4.6-25.el8.x86_64.rpm 79 MB/s | 709 kB 00:00 2020-04-02T23:19:33.437 INFO:teuthology.orchestra.run.smithi174.stdout:(39/125): lttng-ust-2.8.1-11.el8.x86_64.rpm 67 MB/s | 259 kB 00:00 2020-04-02T23:19:33.441 INFO:teuthology.orchestra.run.smithi174.stdout:(40/125): oniguruma-6.8.2-1.el8.x86_64.rpm 51 MB/s | 188 kB 00:00 2020-04-02T23:19:33.444 INFO:teuthology.orchestra.run.smithi174.stdout:(41/125): flex-2.6.1-9.el8.x86_64.rpm 7.9 MB/s | 320 kB 00:00 2020-04-02T23:19:33.507 INFO:teuthology.orchestra.run.smithi174.stdout:(42/125): openblas-0.3.3-2.el8.x86_64.rpm 66 MB/s | 4.3 MB 00:00 2020-04-02T23:19:33.512 INFO:teuthology.orchestra.run.smithi174.stdout:(43/125): python3-html5lib-0.999999999-6.el8.no 40 MB/s | 214 kB 00:00 2020-04-02T23:19:33.515 INFO:teuthology.orchestra.run.smithi174.stdout:(44/125): python3-jsonpatch-1.21-2.el8.noarch.r 10 MB/s | 27 kB 00:00 2020-04-02T23:19:33.516 INFO:teuthology.orchestra.run.smithi174.stdout:(45/125): python3-jsonpointer-1.10-11.el8.noarc 12 MB/s | 20 kB 00:00 2020-04-02T23:19:33.543 INFO:teuthology.orchestra.run.smithi174.stdout:(46/125): python3-lxml-4.2.3-1.el8.x86_64.rpm 59 MB/s | 1.5 MB 00:00 2020-04-02T23:19:33.549 INFO:teuthology.orchestra.run.smithi174.stdout:(47/125): python3-mako-1.0.6-13.el8.noarch.rpm 35 MB/s | 157 kB 00:00 2020-04-02T23:19:33.550 INFO:teuthology.orchestra.run.smithi174.stdout:(48/125): python3-markupsafe-0.23-19.el8.x86_64 14 MB/s | 39 kB 00:00 2020-04-02T23:19:33.565 INFO:teuthology.orchestra.run.smithi174.stdout:(49/125): openblas-threads-0.3.3-2.el8.x86_64.r 36 MB/s | 4.4 MB 00:00 2020-04-02T23:19:33.575 INFO:teuthology.orchestra.run.smithi174.stdout:(50/125): python3-numpy-f2py-1.14.3-9.el8.x86_6 24 MB/s | 225 kB 00:00 2020-04-02T23:19:33.579 INFO:teuthology.orchestra.run.smithi174.stdout:(51/125): python3-prettytable-0.7.2-14.el8.noar 11 MB/s | 44 kB 00:00 2020-04-02T23:19:33.585 INFO:teuthology.orchestra.run.smithi174.stdout:(52/125): python3-pyasn1-0.3.7-6.el8.noarch.rpm 22 MB/s | 126 kB 00:00 2020-04-02T23:19:33.591 INFO:teuthology.orchestra.run.smithi174.stdout:(53/125): python3-pyasn1-modules-0.3.7-6.el8.no 19 MB/s | 110 kB 00:00 2020-04-02T23:19:33.596 INFO:teuthology.orchestra.run.smithi174.stdout:(54/125): python3-pytz-2017.2-9.el8.noarch.rpm 11 MB/s | 54 kB 00:00 2020-04-02T23:19:33.609 INFO:teuthology.orchestra.run.smithi174.stdout:(55/125): python3-numpy-1.14.3-9.el8.x86_64.rpm 63 MB/s | 3.7 MB 00:00 2020-04-02T23:19:33.612 INFO:teuthology.orchestra.run.smithi174.stdout:(56/125): python3-webencodings-0.5.1-6.el8.noar 10 MB/s | 27 kB 00:00 2020-04-02T23:19:33.621 INFO:teuthology.orchestra.run.smithi174.stdout:(57/125): python3-werkzeug-0.12.2-4.el8.noarch. 48 MB/s | 457 kB 00:00 2020-04-02T23:19:33.629 INFO:teuthology.orchestra.run.smithi174.stdout:(58/125): socat-1.7.3.2-6.el8.x86_64.rpm 40 MB/s | 298 kB 00:00 2020-04-02T23:19:33.633 INFO:teuthology.orchestra.run.smithi174.stdout:(59/125): elfutils-libelf-devel-0.176-5.el8.x86 15 MB/s | 54 kB 00:00 2020-04-02T23:19:33.637 INFO:teuthology.orchestra.run.smithi174.stdout:(60/125): fuse-2.9.7-12.el8.x86_64.rpm 20 MB/s | 82 kB 00:00 2020-04-02T23:19:33.640 INFO:teuthology.orchestra.run.smithi174.stdout:(61/125): fuse-common-3.2.1-12.el8.x86_64.rpm 6.6 MB/s | 21 kB 00:00 2020-04-02T23:19:33.644 INFO:teuthology.orchestra.run.smithi174.stdout:(62/125): keyutils-libs-devel-1.5.10-6.el8.x86_ 13 MB/s | 48 kB 00:00 2020-04-02T23:19:33.656 INFO:teuthology.orchestra.run.smithi174.stdout:(63/125): krb5-devel-1.17-9.el8.x86_64.rpm 46 MB/s | 548 kB 00:00 2020-04-02T23:19:33.660 INFO:teuthology.orchestra.run.smithi174.stdout:(64/125): libaio-devel-0.3.112-1.el8.x86_64.rpm 4.7 MB/s | 19 kB 00:00 2020-04-02T23:19:33.663 INFO:teuthology.orchestra.run.smithi174.stdout:(65/125): libcom_err-devel-1.44.6-3.el8.x86_64. 11 MB/s | 38 kB 00:00 2020-04-02T23:19:33.678 INFO:teuthology.orchestra.run.smithi174.stdout:(66/125): libgfortran-8.3.1-4.5.el8.x86_64.rpm 46 MB/s | 638 kB 00:00 2020-04-02T23:19:33.684 INFO:teuthology.orchestra.run.smithi174.stdout:(67/125): libquadmath-8.3.1-4.5.el8.x86_64.rpm 27 MB/s | 169 kB 00:00 2020-04-02T23:19:33.688 INFO:teuthology.orchestra.run.smithi174.stdout:(68/125): librabbitmq-0.9.0-1.el8.x86_64.rpm 10 MB/s | 47 kB 00:00 2020-04-02T23:19:33.695 INFO:teuthology.orchestra.run.smithi174.stdout:(69/125): libselinux-devel-2.9-2.1.el8.x86_64.r 28 MB/s | 199 kB 00:00 2020-04-02T23:19:33.701 INFO:teuthology.orchestra.run.smithi174.stdout:(70/125): libsepol-devel-2.9-1.el8.x86_64.rpm 16 MB/s | 86 kB 00:00 2020-04-02T23:19:33.706 INFO:teuthology.orchestra.run.smithi174.stdout:(71/125): libuuid-devel-2.32.1-17.el8.x86_64.rp 18 MB/s | 95 kB 00:00 2020-04-02T23:19:33.711 INFO:teuthology.orchestra.run.smithi174.stdout:(72/125): libverto-devel-0.3.0-5.el8.x86_64.rpm 4.0 MB/s | 18 kB 00:00 2020-04-02T23:19:33.719 INFO:teuthology.orchestra.run.smithi174.stdout:(73/125): libxslt-1.1.32-3.el8.x86_64.rpm 30 MB/s | 249 kB 00:00 2020-04-02T23:19:33.772 INFO:teuthology.orchestra.run.smithi174.stdout:(74/125): openssl-devel-1.1.1c-2.el8.x86_64.rpm 43 MB/s | 2.3 MB 00:00 2020-04-02T23:19:33.790 INFO:teuthology.orchestra.run.smithi174.stdout:(75/125): pcre2-devel-10.32-1.el8.x86_64.rpm 33 MB/s | 605 kB 00:00 2020-04-02T23:19:33.884 INFO:teuthology.orchestra.run.smithi174.stdout:(76/125): python3-scipy-1.0.0-20.module_el8.1.0 50 MB/s | 15 MB 00:00 2020-04-02T23:19:33.886 INFO:teuthology.orchestra.run.smithi174.stdout:(77/125): pcre2-utf16-10.32-1.el8.x86_64.rpm 2.3 MB/s | 228 kB 00:00 2020-04-02T23:19:33.889 INFO:teuthology.orchestra.run.smithi174.stdout:(78/125): pcre2-utf32-10.32-1.el8.x86_64.rpm 54 MB/s | 220 kB 00:00 2020-04-02T23:19:33.890 INFO:teuthology.orchestra.run.smithi174.stdout:(79/125): python3-chardet-3.0.4-7.el8.noarch.rp 53 MB/s | 195 kB 00:00 2020-04-02T23:19:33.891 INFO:teuthology.orchestra.run.smithi174.stdout:(80/125): python3-jwt-1.6.1-2.el8.noarch.rpm 18 MB/s | 43 kB 00:00 2020-04-02T23:19:33.893 INFO:teuthology.orchestra.run.smithi174.stdout:(81/125): python3-pysocks-1.6.8-3.el8.noarch.rp 15 MB/s | 34 kB 00:00 2020-04-02T23:19:33.894 INFO:teuthology.orchestra.run.smithi174.stdout:(82/125): python3-oauthlib-2.1.0-1.el8.noarch.r 45 MB/s | 155 kB 00:00 2020-04-02T23:19:33.897 INFO:teuthology.orchestra.run.smithi174.stdout:(83/125): python3-requests-2.20.0-2.1.el8_1.noa 51 MB/s | 123 kB 00:00 2020-04-02T23:19:33.897 INFO:teuthology.orchestra.run.smithi174.stdout:(84/125): python3-requests-oauthlib-1.0.0-1.el8 19 MB/s | 43 kB 00:00 2020-04-02T23:19:33.899 INFO:teuthology.orchestra.run.smithi174.stdout:(85/125): python3-urllib3-1.24.2-2.el8.noarch.r 50 MB/s | 176 kB 00:00 2020-04-02T23:19:33.916 INFO:teuthology.orchestra.run.smithi174.stdout:(86/125): xfsprogs-devel-5.0.0-1.el8.x86_64.rpm 3.5 MB/s | 69 kB 00:00 2020-04-02T23:19:33.917 INFO:teuthology.orchestra.run.smithi174.stdout:(87/125): zlib-devel-1.2.11-10.el8.x86_64.rpm 3.2 MB/s | 56 kB 00:00 2020-04-02T23:19:33.975 INFO:teuthology.orchestra.run.smithi174.stdout:(88/125): python3-cheroot-8.2.1-1.el8.noarch.rp 2.4 MB/s | 145 kB 00:00 2020-04-02T23:19:33.996 INFO:teuthology.orchestra.run.smithi174.stdout:(89/125): python3-execnet-1.7.1-1.el8.2.noarch. 17 MB/s | 356 kB 00:00 2020-04-02T23:19:34.000 INFO:teuthology.orchestra.run.smithi174.stdout:(90/125): python3-cherrypy-18.4.0-1.el8.noarch. 4.5 MB/s | 385 kB 00:00 2020-04-02T23:19:34.004 INFO:teuthology.orchestra.run.smithi174.stdout:(91/125): python3-jaraco-6.2-6.el8.noarch.rpm 1.4 MB/s | 11 kB 00:00 2020-04-02T23:19:34.009 INFO:teuthology.orchestra.run.smithi174.stdout:(92/125): python3-jaraco-functools-2.0-4.el8.no 2.0 MB/s | 18 kB 00:00 2020-04-02T23:19:34.013 INFO:teuthology.orchestra.run.smithi174.stdout:(93/125): python3-logutils-0.3.5-11.el8.noarch. 5.6 MB/s | 49 kB 00:00 2020-04-02T23:19:34.018 INFO:teuthology.orchestra.run.smithi174.stdout:(94/125): python3-more-itertools-7.2.0-4.el8.no 6.4 MB/s | 59 kB 00:00 2020-04-02T23:19:34.025 INFO:teuthology.orchestra.run.smithi174.stdout:(95/125): python3-pecan-1.3.2-9.el8.noarch.rpm 23 MB/s | 283 kB 00:00 2020-04-02T23:19:34.026 INFO:teuthology.orchestra.run.smithi174.stdout:(96/125): python3-portend-2.6-1.el8.noarch.rpm 1.9 MB/s | 16 kB 00:00 2020-04-02T23:19:34.037 INFO:teuthology.orchestra.run.smithi174.stdout:(97/125): python3-repoze-lru-0.7-6.el8.noarch.r 3.9 MB/s | 34 kB 00:00 2020-04-02T23:19:34.037 INFO:teuthology.orchestra.run.smithi174.stdout:(98/125): python3-remoto-1.1.4-4.el8.noarch.rpm 4.5 MB/s | 48 kB 00:00 2020-04-02T23:19:34.044 INFO:teuthology.orchestra.run.smithi174.stdout:(99/125): python3-simplegeneric-0.8.1-17.el8.no 2.2 MB/s | 19 kB 00:00 2020-04-02T23:19:34.049 INFO:teuthology.orchestra.run.smithi174.stdout:(100/125): python3-routes-2.4.1-12.el8.noarch.r 14 MB/s | 197 kB 00:00 2020-04-02T23:19:34.057 INFO:teuthology.orchestra.run.smithi174.stdout:(101/125): python3-tempora-1.14.1-5.el8.noarch. 3.4 MB/s | 30 kB 00:00 2020-04-02T23:19:34.061 INFO:teuthology.orchestra.run.smithi174.stdout:(102/125): python3-singledispatch-3.4.0.3-18.el 1.4 MB/s | 24 kB 00:00 2020-04-02T23:19:34.066 INFO:teuthology.orchestra.run.smithi174.stdout:(103/125): python3-trustme-0.5.2-4.el8.noarch.r 3.2 MB/s | 27 kB 00:00 2020-04-02T23:19:34.071 INFO:teuthology.orchestra.run.smithi174.stdout:(104/125): python3-zc-lockfile-2.0-2.el8.noarch 2.7 MB/s | 23 kB 00:00 2020-04-02T23:19:34.075 INFO:teuthology.orchestra.run.smithi196.stdout:(122/125): ceph-test-16.0.0-316.gcbb84f7.el8.x8 8.2 MB/s | 42 MB 00:05 2020-04-02T23:19:34.104 INFO:teuthology.orchestra.run.smithi196.stdout:(123/125): ceph-mgr-diskprediction-local-16.0.0 3.1 MB/s | 8.6 MB 00:02 2020-04-02T23:19:34.114 INFO:teuthology.orchestra.run.smithi196.stdout:(124/125): librados2-16.0.0-316.gcbb84f7.el8.x8 4.4 MB/s | 3.6 MB 00:00 2020-04-02T23:19:34.145 INFO:teuthology.orchestra.run.smithi174.stdout:(105/125): liboath-2.6.2-3.el8.x86_64.rpm 788 kB/s | 59 kB 00:00 2020-04-02T23:19:34.159 INFO:teuthology.orchestra.run.smithi174.stdout:(106/125): gperftools-libs-2.7-6.el8.x86_64.rpm 3.3 MB/s | 315 kB 00:00 2020-04-02T23:19:34.175 INFO:teuthology.orchestra.run.smithi174.stdout:(107/125): python3-apipkg-1.5-6.el8.noarch.rpm 1.3 MB/s | 21 kB 00:00 2020-04-02T23:19:34.182 INFO:teuthology.orchestra.run.smithi174.stdout:(108/125): libunwind-1.3.1-3.el8.x86_64.rpm 1.9 MB/s | 75 kB 00:00 2020-04-02T23:19:34.191 INFO:teuthology.orchestra.run.smithi174.stdout:(109/125): python3-bcrypt-3.1.6-2.el8.1.x86_64. 2.7 MB/s | 44 kB 00:00 2020-04-02T23:19:34.207 INFO:teuthology.orchestra.run.smithi174.stdout:(110/125): python3-cachetools-3.1.1-4.el8.noarc 2.1 MB/s | 33 kB 00:00 2020-04-02T23:19:34.220 INFO:teuthology.orchestra.run.smithi174.stdout:(111/125): python3-beautifulsoup4-4.6.3-2.el8.1 4.8 MB/s | 185 kB 00:00 2020-04-02T23:19:34.222 INFO:teuthology.orchestra.run.smithi174.stdout:(112/125): python3-certifi-2018.10.15-7.el8.noa 1.0 MB/s | 16 kB 00:00 2020-04-02T23:19:34.234 INFO:teuthology.orchestra.run.smithi196.stdout:(125/125): librbd1-16.0.0-316.gcbb84f7.el8.x86_ 12 MB/s | 1.9 MB 00:00 2020-04-02T23:19:34.238 INFO:teuthology.orchestra.run.smithi196.stdout:-------------------------------------------------------------------------------- 2020-04-02T23:19:34.239 INFO:teuthology.orchestra.run.smithi196.stdout:Total 19 MB/s | 174 MB 00:09 2020-04-02T23:19:34.253 INFO:teuthology.orchestra.run.smithi174.stdout:(113/125): python3-cssselect-0.9.2-10.el8.noarc 2.1 MB/s | 40 kB 00:00 2020-04-02T23:19:34.254 INFO:teuthology.orchestra.run.smithi174.stdout:(114/125): python3-google-auth-1.1.1-10.el8.noa 4.5 MB/s | 81 kB 00:00 2020-04-02T23:19:34.256 INFO:teuthology.orchestra.run.smithi174.stdout:(115/125): python3-rsa-3.4.2-12.el8.noarch.rpm 4.5 MB/s | 73 kB 00:00 2020-04-02T23:19:34.274 INFO:teuthology.orchestra.run.smithi174.stdout:(116/125): python3-waitress-1.2.1-2.el8.1.noarc 14 MB/s | 241 kB 00:00 2020-04-02T23:19:34.291 INFO:teuthology.orchestra.run.smithi174.stdout:(117/125): python3-webob-1.8.5-1.el8.1.noarch.r 14 MB/s | 251 kB 00:00 2020-04-02T23:19:34.305 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction check 2020-04-02T23:19:34.307 INFO:teuthology.orchestra.run.smithi174.stdout:(118/125): python3-websocket-client-0.56.0-5.el 3.8 MB/s | 61 kB 00:00 2020-04-02T23:19:34.317 INFO:teuthology.orchestra.run.smithi174.stdout:(119/125): python3-kubernetes-10.0.1-2.el8.noar 14 MB/s | 1.1 MB 00:00 2020-04-02T23:19:34.325 INFO:teuthology.orchestra.run.smithi174.stdout:(120/125): python3-webtest-2.0.33-1.el8.noarch. 5.2 MB/s | 85 kB 00:00 2020-04-02T23:19:34.329 INFO:teuthology.orchestra.run.smithi174.stdout:(121/125): leveldb-1.21-2.el8.x86_64.rpm 30 MB/s | 179 kB 00:00 2020-04-02T23:19:34.336 INFO:teuthology.orchestra.run.smithi174.stdout:(122/125): xmlstarlet-1.6.1-11.el8.x86_64.rpm 3.5 MB/s | 69 kB 00:00 2020-04-02T23:19:34.414 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction check succeeded. 2020-04-02T23:19:34.415 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction test 2020-04-02T23:19:34.579 INFO:teuthology.orchestra.run.smithi174.stdout:(123/125): librbd1-16.0.0-316.gcbb84f7.el8.x86_ 7.9 MB/s | 1.9 MB 00:00 2020-04-02T23:19:34.785 INFO:teuthology.orchestra.run.smithi174.stdout:(124/125): ceph-mgr-diskprediction-local-16.0.0 4.7 MB/s | 8.6 MB 00:01 2020-04-02T23:19:34.868 INFO:teuthology.orchestra.run.smithi174.stdout:(125/125): librados2-16.0.0-316.gcbb84f7.el8.x8 6.6 MB/s | 3.6 MB 00:00 2020-04-02T23:19:34.872 INFO:teuthology.orchestra.run.smithi174.stdout:-------------------------------------------------------------------------------- 2020-04-02T23:19:34.873 INFO:teuthology.orchestra.run.smithi174.stdout:Total 18 MB/s | 174 MB 00:09 2020-04-02T23:19:34.933 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction check 2020-04-02T23:19:35.041 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction check succeeded. 2020-04-02T23:19:35.041 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction test 2020-04-02T23:19:35.689 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction test succeeded. 2020-04-02T23:19:35.689 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction 2020-04-02T23:19:36.282 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction test succeeded. 2020-04-02T23:19:36.282 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction 2020-04-02T23:19:40.273 INFO:teuthology.orchestra.run.smithi196.stdout: Preparing : 1/1 2020-04-02T23:19:40.449 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/127 2020-04-02T23:19:40.596 INFO:teuthology.orchestra.run.smithi174.stdout: Preparing : 1/1 2020-04-02T23:19:40.661 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : librabbitmq-0.9.0-1.el8.x86_64 2/127 2020-04-02T23:19:40.765 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/127 2020-04-02T23:19:40.858 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/127 2020-04-02T23:19:40.945 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : librabbitmq-0.9.0-1.el8.x86_64 2/127 2020-04-02T23:19:41.120 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/127 2020-04-02T23:19:41.252 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/127 2020-04-02T23:19:41.458 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : librados2-2:16.0.0-316.gcbb84f7.el8.x86_64 4/127 2020-04-02T23:19:41.516 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/127 2020-04-02T23:19:41.678 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : librados2-2:16.0.0-316.gcbb84f7.el8.x86_64 4/127 2020-04-02T23:19:41.700 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: librados2-2:16.0.0-316.gcbb84f7.el8.x86_64 4/127 2020-04-02T23:19:41.915 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librados2-2:16.0.0-316.gcbb84f7.el8.x86_64 4/127 2020-04-02T23:19:41.917 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : librbd1-2:16.0.0-316.gcbb84f7.el8.x86_64 5/127 2020-04-02T23:19:42.014 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: librbd1-2:16.0.0-316.gcbb84f7.el8.x86_64 5/127 2020-04-02T23:19:42.103 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : librbd1-2:16.0.0-316.gcbb84f7.el8.x86_64 5/127 2020-04-02T23:19:42.184 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libcephfs2-2:16.0.0-316.gcbb84f7.el8.x86_64 6/127 2020-04-02T23:19:42.208 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librbd1-2:16.0.0-316.gcbb84f7.el8.x86_64 5/127 2020-04-02T23:19:42.267 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: libcephfs2-2:16.0.0-316.gcbb84f7.el8.x86_64 6/127 2020-04-02T23:19:42.329 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libcephfs2-2:16.0.0-316.gcbb84f7.el8.x86_64 6/127 2020-04-02T23:19:42.422 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libcephfs2-2:16.0.0-316.gcbb84f7.el8.x86_64 6/127 2020-04-02T23:19:42.474 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-rados-2:16.0.0-316.gcbb84f7.el8.x86_64 7/127 2020-04-02T23:19:42.586 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-rados-2:16.0.0-316.gcbb84f7.el8.x86_64 7/127 2020-04-02T23:19:42.650 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 8/127 2020-04-02T23:19:42.719 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 8/127 2020-04-02T23:19:42.977 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 8/127 2020-04-02T23:19:43.065 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 8/127 2020-04-02T23:19:43.141 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : librgw2-2:16.0.0-316.gcbb84f7.el8.x86_64 9/127 2020-04-02T23:19:43.195 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : librgw2-2:16.0.0-316.gcbb84f7.el8.x86_64 9/127 2020-04-02T23:19:43.250 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: librgw2-2:16.0.0-316.gcbb84f7.el8.x86_64 9/127 2020-04-02T23:19:43.288 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librgw2-2:16.0.0-316.gcbb84f7.el8.x86_64 9/127 2020-04-02T23:19:43.476 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 10/127 2020-04-02T23:19:43.495 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 10/127 2020-04-02T23:19:43.636 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libradosstriper1-2:16.0.0-316.gcbb84f7.el8.x86_6 11/127 2020-04-02T23:19:43.649 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libradosstriper1-2:16.0.0-316.gcbb84f7.el8.x86_6 11/127 2020-04-02T23:19:43.749 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libradosstriper1-2:16.0.0-316.gcbb84f7.el8.x86_6 11/127 2020-04-02T23:19:43.771 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: libradosstriper1-2:16.0.0-316.gcbb84f7.el8.x86_6 11/127 2020-04-02T23:19:43.914 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 12/127 2020-04-02T23:19:43.994 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 12/127 2020-04-02T23:19:44.050 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-more-itertools-7.2.0-4.el8.noarch 13/127 2020-04-02T23:19:44.139 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-more-itertools-7.2.0-4.el8.noarch 13/127 2020-04-02T23:19:44.170 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : zlib-devel-1.2.11-10.el8.x86_64 14/127 2020-04-02T23:19:44.343 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : zlib-devel-1.2.11-10.el8.x86_64 14/127 2020-04-02T23:19:44.352 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 15/127 2020-04-02T23:19:44.571 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libxslt-1.1.32-3.el8.x86_64 16/127 2020-04-02T23:19:44.574 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 15/127 2020-04-02T23:19:44.711 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libquadmath-8.3.1-4.5.el8.x86_64 17/127 2020-04-02T23:19:44.825 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libxslt-1.1.32-3.el8.x86_64 16/127 2020-04-02T23:19:44.843 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libquadmath-8.3.1-4.5.el8.x86_64 17/127 2020-04-02T23:19:44.983 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libquadmath-8.3.1-4.5.el8.x86_64 17/127 2020-04-02T23:19:45.027 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libgfortran-8.3.1-4.5.el8.x86_64 18/127 2020-04-02T23:19:45.119 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: libquadmath-8.3.1-4.5.el8.x86_64 17/127 2020-04-02T23:19:45.349 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libgfortran-8.3.1-4.5.el8.x86_64 18/127 2020-04-02T23:19:45.568 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libgfortran-8.3.1-4.5.el8.x86_64 18/127 2020-04-02T23:19:45.702 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : openblas-0.3.3-2.el8.x86_64 19/127 2020-04-02T23:19:45.888 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: libgfortran-8.3.1-4.5.el8.x86_64 18/127 2020-04-02T23:19:46.049 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : openblas-0.3.3-2.el8.x86_64 19/127 2020-04-02T23:19:46.239 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: openblas-0.3.3-2.el8.x86_64 19/127 2020-04-02T23:19:46.369 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : openblas-threads-0.3.3-2.el8.x86_64 20/127 2020-04-02T23:19:46.594 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: openblas-0.3.3-2.el8.x86_64 19/127 2020-04-02T23:19:46.774 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : openblas-threads-0.3.3-2.el8.x86_64 20/127 2020-04-02T23:19:47.050 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: openblas-threads-0.3.3-2.el8.x86_64 20/127 2020-04-02T23:19:47.360 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 21/127 2020-04-02T23:19:47.467 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: openblas-threads-0.3.3-2.el8.x86_64 20/127 2020-04-02T23:19:47.557 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/127 2020-04-02T23:19:47.661 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-ceph-argparse-2:16.0.0-316.gcbb84f7.el8. 23/127 2020-04-02T23:19:47.805 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 21/127 2020-04-02T23:19:47.856 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cephfs-2:16.0.0-316.gcbb84f7.el8.x86_64 24/127 2020-04-02T23:19:48.060 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 25/127 2020-04-02T23:19:48.162 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/127 2020-04-02T23:19:48.316 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-ceph-argparse-2:16.0.0-316.gcbb84f7.el8. 23/127 2020-04-02T23:19:48.547 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-cephfs-2:16.0.0-316.gcbb84f7.el8.x86_64 24/127 2020-04-02T23:19:48.799 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 25/127 2020-04-02T23:19:50.013 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 25/127 2020-04-02T23:19:50.280 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-scipy-1.0.0-20.module_el8.1.0+245+c39af4 26/127 2020-04-02T23:19:50.455 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 27/127 2020-04-02T23:19:50.687 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 28/127 2020-04-02T23:19:50.745 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 25/127 2020-04-02T23:19:50.882 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 29/127 2020-04-02T23:19:51.018 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-scipy-1.0.0-20.module_el8.1.0+245+c39af4 26/127 2020-04-02T23:19:51.079 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-rsa-3.4.2-12.el8.noarch 30/127 2020-04-02T23:19:51.210 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 27/127 2020-04-02T23:19:51.258 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-rgw-2:16.0.0-316.gcbb84f7.el8.x86_64 31/127 2020-04-02T23:19:51.448 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-rbd-2:16.0.0-316.gcbb84f7.el8.x86_64 32/127 2020-04-02T23:19:51.467 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 28/127 2020-04-02T23:19:51.613 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : librados-devel-2:16.0.0-316.gcbb84f7.el8.x86_64 33/127 2020-04-02T23:19:51.730 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 29/127 2020-04-02T23:19:51.839 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 34/127 2020-04-02T23:19:51.943 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-rsa-3.4.2-12.el8.noarch 30/127 2020-04-02T23:19:51.987 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 35/127 2020-04-02T23:19:52.158 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 36/127 2020-04-02T23:19:52.171 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-rgw-2:16.0.0-316.gcbb84f7.el8.x86_64 31/127 2020-04-02T23:19:52.341 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 37/127 2020-04-02T23:19:52.370 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-rbd-2:16.0.0-316.gcbb84f7.el8.x86_64 32/127 2020-04-02T23:19:52.518 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : librados-devel-2:16.0.0-316.gcbb84f7.el8.x86_64 33/127 2020-04-02T23:19:52.539 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 38/127 2020-04-02T23:19:52.736 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 39/127 2020-04-02T23:19:52.803 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 34/127 2020-04-02T23:19:52.973 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 40/127 2020-04-02T23:19:53.216 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 41/127 2020-04-02T23:19:53.432 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-execnet-1.7.1-1.el8.2.noarch 42/127 2020-04-02T23:19:53.502 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 35/127 2020-04-02T23:19:53.579 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-remoto-1.1.4-4.el8.noarch 43/127 2020-04-02T23:19:53.664 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 36/127 2020-04-02T23:19:53.882 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 37/127 2020-04-02T23:19:53.932 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 44/127 2020-04-02T23:19:54.132 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 38/127 2020-04-02T23:19:54.133 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : gperftools-libs-2.7-6.el8.x86_64 45/127 2020-04-02T23:19:54.294 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : leveldb-1.21-2.el8.x86_64 46/127 2020-04-02T23:19:54.367 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 39/127 2020-04-02T23:19:54.469 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 47/127 2020-04-02T23:19:54.622 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 40/127 2020-04-02T23:19:54.625 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-trustme-0.5.2-4.el8.noarch 48/127 2020-04-02T23:19:54.773 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 49/127 2020-04-02T23:19:54.905 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 50/127 2020-04-02T23:19:54.907 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 41/127 2020-04-02T23:19:55.070 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 51/127 2020-04-02T23:19:55.170 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-execnet-1.7.1-1.el8.2.noarch 42/127 2020-04-02T23:19:55.255 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 52/127 2020-04-02T23:19:55.388 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-remoto-1.1.4-4.el8.noarch 43/127 2020-04-02T23:19:55.396 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 53/127 2020-04-02T23:19:55.516 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 54/127 2020-04-02T23:19:55.589 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 44/127 2020-04-02T23:19:55.683 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 55/127 2020-04-02T23:19:55.802 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : gperftools-libs-2.7-6.el8.x86_64 45/127 2020-04-02T23:19:55.884 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cheroot-8.2.1-1.el8.noarch 56/127 2020-04-02T23:19:55.973 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : leveldb-1.21-2.el8.x86_64 46/127 2020-04-02T23:19:56.115 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pysocks-1.6.8-3.el8.noarch 57/127 2020-04-02T23:19:56.156 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 47/127 2020-04-02T23:19:56.313 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-trustme-0.5.2-4.el8.noarch 48/127 2020-04-02T23:19:56.343 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-urllib3-1.24.2-2.el8.noarch 58/127 2020-04-02T23:19:56.469 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 49/127 2020-04-02T23:19:56.548 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-chardet-3.0.4-7.el8.noarch 59/127 2020-04-02T23:19:56.634 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 50/127 2020-04-02T23:19:56.739 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-requests-2.20.0-2.1.el8_1.noarch 60/127 2020-04-02T23:19:56.834 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 51/127 2020-04-02T23:19:57.026 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 52/127 2020-04-02T23:19:57.209 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 53/127 2020-04-02T23:19:57.404 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 54/127 2020-04-02T23:19:57.596 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 55/127 2020-04-02T23:19:57.741 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 61/127 2020-04-02T23:19:57.839 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-cheroot-8.2.1-1.el8.noarch 56/127 2020-04-02T23:19:57.946 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-kubernetes-10.0.1-2.el8.noarch 62/127 2020-04-02T23:19:58.078 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-pysocks-1.6.8-3.el8.noarch 57/127 2020-04-02T23:19:58.128 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : pcre2-utf32-10.32-1.el8.x86_64 63/127 2020-04-02T23:19:58.367 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-urllib3-1.24.2-2.el8.noarch 58/127 2020-04-02T23:19:58.407 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : pcre2-utf16-10.32-1.el8.x86_64 64/127 2020-04-02T23:19:58.586 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : pcre2-devel-10.32-1.el8.x86_64 65/127 2020-04-02T23:19:58.648 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-chardet-3.0.4-7.el8.noarch 59/127 2020-04-02T23:19:58.707 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 66/127 2020-04-02T23:19:58.821 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-requests-2.20.0-2.1.el8_1.noarch 60/127 2020-04-02T23:19:58.855 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libuuid-devel-2.32.1-17.el8.x86_64 67/127 2020-04-02T23:19:59.114 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libsepol-devel-2.9-1.el8.x86_64 68/127 2020-04-02T23:19:59.638 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libselinux-devel-2.9-2.1.el8.x86_64 69/127 2020-04-02T23:19:59.805 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libcom_err-devel-1.44.6-3.el8.x86_64 70/127 2020-04-02T23:19:59.864 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 61/127 2020-04-02T23:19:59.991 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 71/127 2020-04-02T23:20:00.153 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-kubernetes-10.0.1-2.el8.noarch 62/127 2020-04-02T23:20:00.170 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : krb5-devel-1.17-9.el8.x86_64 72/127 2020-04-02T23:20:00.170 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : fuse-common-3.2.1-12.el8.x86_64 73/127 2020-04-02T23:20:00.170 INFO:teuthology.orchestra.run.smithi174.stdout:warning: /etc/fuse.conf created as /etc/fuse.conf.rpmnew 2020-04-02T23:20:00.170 INFO:teuthology.orchestra.run.smithi174.stdout: 2020-04-02T23:20:00.351 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : pcre2-utf32-10.32-1.el8.x86_64 63/127 2020-04-02T23:20:00.528 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : fuse-2.9.7-12.el8.x86_64 74/127 2020-04-02T23:20:00.646 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : pcre2-utf16-10.32-1.el8.x86_64 64/127 2020-04-02T23:20:00.686 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : socat-1.7.3.2-6.el8.x86_64 75/127 2020-04-02T23:20:00.848 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : pcre2-devel-10.32-1.el8.x86_64 65/127 2020-04-02T23:20:00.938 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 76/127 2020-04-02T23:20:01.029 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 66/127 2020-04-02T23:20:01.138 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 77/127 2020-04-02T23:20:01.169 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libuuid-devel-2.32.1-17.el8.x86_64 67/127 2020-04-02T23:20:01.429 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libsepol-devel-2.9-1.el8.x86_64 68/127 2020-04-02T23:20:01.529 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 78/127 2020-04-02T23:20:01.650 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libselinux-devel-2.9-2.1.el8.x86_64 69/127 2020-04-02T23:20:01.753 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-lxml-4.2.3-1.el8.x86_64 79/127 2020-04-02T23:20:01.867 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libcom_err-devel-1.44.6-3.el8.x86_64 70/127 2020-04-02T23:20:01.941 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 80/127 2020-04-02T23:20:02.094 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 71/127 2020-04-02T23:20:02.128 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 81/127 2020-04-02T23:20:02.289 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 82/127 2020-04-02T23:20:02.316 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : krb5-devel-1.17-9.el8.x86_64 72/127 2020-04-02T23:20:02.316 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : fuse-common-3.2.1-12.el8.x86_64 73/127 2020-04-02T23:20:02.316 INFO:teuthology.orchestra.run.smithi196.stdout:warning: /etc/fuse.conf created as /etc/fuse.conf.rpmnew 2020-04-02T23:20:02.316 INFO:teuthology.orchestra.run.smithi196.stdout: 2020-04-02T23:20:02.506 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-portend-2.6-1.el8.noarch 83/127 2020-04-02T23:20:02.698 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : fuse-2.9.7-12.el8.x86_64 74/127 2020-04-02T23:20:02.741 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 84/127 2020-04-02T23:20:02.878 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : socat-1.7.3.2-6.el8.x86_64 75/127 2020-04-02T23:20:02.929 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 85/127 2020-04-02T23:20:03.145 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 86/127 2020-04-02T23:20:03.147 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 76/127 2020-04-02T23:20:03.383 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 77/127 2020-04-02T23:20:03.478 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 87/127 2020-04-02T23:20:03.740 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 88/127 2020-04-02T23:20:03.787 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 78/127 2020-04-02T23:20:03.915 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 89/127 2020-04-02T23:20:04.069 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-lxml-4.2.3-1.el8.x86_64 79/127 2020-04-02T23:20:04.086 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 90/127 2020-04-02T23:20:04.200 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : oniguruma-6.8.2-1.el8.x86_64 91/127 2020-04-02T23:20:04.277 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 80/127 2020-04-02T23:20:04.291 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: oniguruma-6.8.2-1.el8.x86_64 91/127 2020-04-02T23:20:04.473 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 81/127 2020-04-02T23:20:04.572 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : jq-1.5-12.el8.x86_64 92/127 2020-04-02T23:20:04.684 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 82/127 2020-04-02T23:20:04.796 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : automake-1.16.1-6.el8.noarch 93/127 2020-04-02T23:20:04.914 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-prometheus-alerts-2:16.0.0-316.gcbb84f7.el8 94/127 2020-04-02T23:20:04.962 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-portend-2.6-1.el8.noarch 83/127 2020-04-02T23:20:05.077 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-grafana-dashboards-2:16.0.0-316.gcbb84f7.el 95/127 2020-04-02T23:20:05.229 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 84/127 2020-04-02T23:20:05.284 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-ceph-common-2:16.0.0-316.gcbb84f7.el8.x8 96/127 2020-04-02T23:20:05.417 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 85/127 2020-04-02T23:20:05.677 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 86/127 2020-04-02T23:20:06.025 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 87/127 2020-04-02T23:20:06.327 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 88/127 2020-04-02T23:20:06.536 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 89/127 2020-04-02T23:20:06.749 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 90/127 2020-04-02T23:20:06.912 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : oniguruma-6.8.2-1.el8.x86_64 91/127 2020-04-02T23:20:06.991 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: oniguruma-6.8.2-1.el8.x86_64 91/127 2020-04-02T23:20:07.278 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : jq-1.5-12.el8.x86_64 92/127 2020-04-02T23:20:07.511 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : automake-1.16.1-6.el8.noarch 93/127 2020-04-02T23:20:07.685 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-prometheus-alerts-2:16.0.0-316.gcbb84f7.el8 94/127 2020-04-02T23:20:07.890 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-grafana-dashboards-2:16.0.0-316.gcbb84f7.el 95/127 2020-04-02T23:20:08.112 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-ceph-common-2:16.0.0-316.gcbb84f7.el8.x8 96/127 2020-04-02T23:20:08.739 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-common-2:16.0.0-316.gcbb84f7.el8.x86_64 97/127 2020-04-02T23:20:08.982 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-common-2:16.0.0-316.gcbb84f7.el8.x86_64 97/127 2020-04-02T23:20:09.685 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-common-2:16.0.0-316.gcbb84f7.el8.x86_64 97/127 2020-04-02T23:20:09.944 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-base-2:16.0.0-316.gcbb84f7.el8.x86_64 98/127 2020-04-02T23:20:10.068 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-base-2:16.0.0-316.gcbb84f7.el8.x86_64 98/127 2020-04-02T23:20:10.198 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-selinux-2:16.0.0-316.gcbb84f7.el8.x86_64 99/127 2020-04-02T23:20:11.526 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-common-2:16.0.0-316.gcbb84f7.el8.x86_64 97/127 2020-04-02T23:20:11.753 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-common-2:16.0.0-316.gcbb84f7.el8.x86_64 97/127 2020-04-02T23:20:12.455 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-common-2:16.0.0-316.gcbb84f7.el8.x86_64 97/127 2020-04-02T23:20:12.753 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-base-2:16.0.0-316.gcbb84f7.el8.x86_64 98/127 2020-04-02T23:20:12.830 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-base-2:16.0.0-316.gcbb84f7.el8.x86_64 98/127 2020-04-02T23:20:12.994 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-selinux-2:16.0.0-316.gcbb84f7.el8.x86_64 99/127 2020-04-02T23:20:26.482 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-selinux-2:16.0.0-316.gcbb84f7.el8.x86_64 99/127 2020-04-02T23:20:26.483 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /sys 2020-04-02T23:20:26.483 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /proc 2020-04-02T23:20:26.483 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /dev 2020-04-02T23:20:26.484 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /run 2020-04-02T23:20:26.484 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /mnt 2020-04-02T23:20:26.484 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /var/tmp 2020-04-02T23:20:26.484 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /home 2020-04-02T23:20:26.484 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /tmp 2020-04-02T23:20:26.484 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /dev 2020-04-02T23:20:26.485 INFO:teuthology.orchestra.run.smithi174.stdout: 2020-04-02T23:20:26.821 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mds-2:16.0.0-316.gcbb84f7.el8.x86_64 100/127 2020-04-02T23:20:27.218 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mds-2:16.0.0-316.gcbb84f7.el8.x86_64 100/127 2020-04-02T23:20:27.421 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mon-2:16.0.0-316.gcbb84f7.el8.x86_64 101/127 2020-04-02T23:20:28.836 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mon-2:16.0.0-316.gcbb84f7.el8.x86_64 101/127 2020-04-02T23:20:29.045 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-osd-2:16.0.0-316.gcbb84f7.el8.x86_64 102/127 2020-04-02T23:20:29.069 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-osd-2:16.0.0-316.gcbb84f7.el8.x86_64 102/127 2020-04-02T23:20:29.312 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-selinux-2:16.0.0-316.gcbb84f7.el8.x86_64 99/127 2020-04-02T23:20:29.312 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /sys 2020-04-02T23:20:29.312 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /proc 2020-04-02T23:20:29.312 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /dev 2020-04-02T23:20:29.313 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /run 2020-04-02T23:20:29.314 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /mnt 2020-04-02T23:20:29.315 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /var/tmp 2020-04-02T23:20:29.315 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /home 2020-04-02T23:20:29.315 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /tmp 2020-04-02T23:20:29.315 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /dev 2020-04-02T23:20:29.315 INFO:teuthology.orchestra.run.smithi196.stdout: 2020-04-02T23:20:29.686 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mds-2:16.0.0-316.gcbb84f7.el8.x86_64 100/127 2020-04-02T23:20:30.075 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-mds-2:16.0.0-316.gcbb84f7.el8.x86_64 100/127 2020-04-02T23:20:30.258 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mon-2:16.0.0-316.gcbb84f7.el8.x86_64 101/127 2020-04-02T23:20:30.394 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: cephadm-2:16.0.0-316.gcbb84f7.el8.x86_64 103/127 2020-04-02T23:20:30.564 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : cephadm-2:16.0.0-316.gcbb84f7.el8.x86_64 103/127 2020-04-02T23:20:30.705 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-cephadm-2:16.0.0-316.gcbb84f7.el8.noarc 104/127 2020-04-02T23:20:31.544 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.0.0-316.gcbb84f7.el8.noarc 104/127 2020-04-02T23:20:31.678 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-mon-2:16.0.0-316.gcbb84f7.el8.x86_64 101/127 2020-04-02T23:20:31.795 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-dashboard-2:16.0.0-316.gcbb84f7.el8.noa 105/127 2020-04-02T23:20:31.949 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-osd-2:16.0.0-316.gcbb84f7.el8.x86_64 102/127 2020-04-02T23:20:31.972 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-osd-2:16.0.0-316.gcbb84f7.el8.x86_64 102/127 2020-04-02T23:20:32.838 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.0.0-316.gcbb84f7.el8.noa 105/127 2020-04-02T23:20:33.020 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-diskprediction-local-2:16.0.0-316.gcbb8 106/127 2020-04-02T23:20:33.090 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.0.0-316.gcbb8 106/127 2020-04-02T23:20:33.328 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: cephadm-2:16.0.0-316.gcbb84f7.el8.x86_64 103/127 2020-04-02T23:20:33.460 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-modules-core-2:16.0.0-316.gcbb84f7.el8. 107/127 2020-04-02T23:20:33.481 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : cephadm-2:16.0.0-316.gcbb84f7.el8.x86_64 103/127 2020-04-02T23:20:33.657 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mgr-cephadm-2:16.0.0-316.gcbb84f7.el8.noarc 104/127 2020-04-02T23:20:33.686 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-2:16.0.0-316.gcbb84f7.el8.x86_64 108/127 2020-04-02T23:20:33.709 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mgr-2:16.0.0-316.gcbb84f7.el8.x86_64 108/127 2020-04-02T23:20:33.898 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-rook-2:16.0.0-316.gcbb84f7.el8.noarch 109/127 2020-04-02T23:20:33.912 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mgr-rook-2:16.0.0-316.gcbb84f7.el8.noarch 109/127 2020-04-02T23:20:34.495 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.0.0-316.gcbb84f7.el8.noarc 104/127 2020-04-02T23:20:34.765 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mgr-dashboard-2:16.0.0-316.gcbb84f7.el8.noa 105/127 2020-04-02T23:20:34.912 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-2:16.0.0-316.gcbb84f7.el8.x86_64 110/127 2020-04-02T23:20:35.061 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-radosgw-2:16.0.0-316.gcbb84f7.el8.x86_64 111/127 2020-04-02T23:20:35.410 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-radosgw-2:16.0.0-316.gcbb84f7.el8.x86_64 111/127 2020-04-02T23:20:35.562 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : rbd-mirror-2:16.0.0-316.gcbb84f7.el8.x86_64 112/127 2020-04-02T23:20:35.801 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.0.0-316.gcbb84f7.el8.noa 105/127 2020-04-02T23:20:35.981 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mgr-diskprediction-local-2:16.0.0-316.gcbb8 106/127 2020-04-02T23:20:36.049 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.0.0-316.gcbb8 106/127 2020-04-02T23:20:36.410 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mgr-modules-core-2:16.0.0-316.gcbb84f7.el8. 107/127 2020-04-02T23:20:36.641 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mgr-2:16.0.0-316.gcbb84f7.el8.x86_64 108/127 2020-04-02T23:20:36.667 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-mgr-2:16.0.0-316.gcbb84f7.el8.x86_64 108/127 2020-04-02T23:20:36.880 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mgr-rook-2:16.0.0-316.gcbb84f7.el8.noarch 109/127 2020-04-02T23:20:36.893 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-mgr-rook-2:16.0.0-316.gcbb84f7.el8.noarch 109/127 2020-04-02T23:20:38.188 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-2:16.0.0-316.gcbb84f7.el8.x86_64 110/127 2020-04-02T23:20:38.358 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-radosgw-2:16.0.0-316.gcbb84f7.el8.x86_64 111/127 2020-04-02T23:20:38.691 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-radosgw-2:16.0.0-316.gcbb84f7.el8.x86_64 111/127 2020-04-02T23:20:38.856 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : rbd-mirror-2:16.0.0-316.gcbb84f7.el8.x86_64 112/127 2020-04-02T23:20:39.453 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: rbd-mirror-2:16.0.0-316.gcbb84f7.el8.x86_64 112/127 2020-04-02T23:20:39.777 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-test-2:16.0.0-316.gcbb84f7.el8.x86_64 113/127 2020-04-02T23:20:39.936 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libtool-2.4.6-25.el8.x86_64 114/127 2020-04-02T23:20:39.997 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 114/127 2020-04-02T23:20:40.870 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-fuse-2:16.0.0-316.gcbb84f7.el8.x86_64 115/127 2020-04-02T23:20:41.130 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : openssl-devel-1:1.1.1c-2.el8.x86_64 116/127 2020-04-02T23:20:41.296 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : xfsprogs-devel-5.0.0-1.el8.x86_64 117/127 2020-04-02T23:20:41.430 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libcephfs-devel-2:16.0.0-316.gcbb84f7.el8.x86_64 118/127 2020-04-02T23:20:41.569 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : elfutils-libelf-devel-0.176-5.el8.x86_64 119/127 2020-04-02T23:20:41.732 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : rbd-fuse-2:16.0.0-316.gcbb84f7.el8.x86_64 120/127 2020-04-02T23:20:41.879 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : rbd-nbd-2:16.0.0-316.gcbb84f7.el8.x86_64 121/127 2020-04-02T23:20:42.028 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-immutable-object-cache-2:16.0.0-316.gcbb84f 122/127 2020-04-02T23:20:42.051 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.0.0-316.gcbb84f 122/127 2020-04-02T23:20:42.211 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 123/127 2020-04-02T23:20:42.393 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : flex-2.6.1-9.el8.x86_64 124/127 2020-04-02T23:20:42.486 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 124/127 2020-04-02T23:20:42.685 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : bison-3.0.4-10.el8.x86_64 125/127 2020-04-02T23:20:42.699 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 125/127 2020-04-02T23:20:42.700 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 126/127 2020-04-02T23:20:42.922 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 126/127 2020-04-02T23:20:42.922 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 127/127 2020-04-02T23:20:43.122 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: rbd-mirror-2:16.0.0-316.gcbb84f7.el8.x86_64 112/127 2020-04-02T23:20:44.027 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 127/127 2020-04-02T23:20:44.027 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-2:16.0.0-316.gcbb84f7.el8.x86_64 1/127 2020-04-02T23:20:44.027 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-base-2:16.0.0-316.gcbb84f7.el8.x86_64 2/127 2020-04-02T23:20:44.027 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-common-2:16.0.0-316.gcbb84f7.el8.x86_64 3/127 2020-04-02T23:20:44.027 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-fuse-2:16.0.0-316.gcbb84f7.el8.x86_64 4/127 2020-04-02T23:20:44.027 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-immutable-object-cache-2:16.0.0-316.gcbb84f 5/127 2020-04-02T23:20:44.027 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mds-2:16.0.0-316.gcbb84f7.el8.x86_64 6/127 2020-04-02T23:20:44.028 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-2:16.0.0-316.gcbb84f7.el8.x86_64 7/127 2020-04-02T23:20:44.028 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mon-2:16.0.0-316.gcbb84f7.el8.x86_64 8/127 2020-04-02T23:20:44.028 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-osd-2:16.0.0-316.gcbb84f7.el8.x86_64 9/127 2020-04-02T23:20:44.028 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-radosgw-2:16.0.0-316.gcbb84f7.el8.x86_64 10/127 2020-04-02T23:20:44.028 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-selinux-2:16.0.0-316.gcbb84f7.el8.x86_64 11/127 2020-04-02T23:20:44.028 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-test-2:16.0.0-316.gcbb84f7.el8.x86_64 12/127 2020-04-02T23:20:44.028 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : cephadm-2:16.0.0-316.gcbb84f7.el8.x86_64 13/127 2020-04-02T23:20:44.029 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libcephfs-devel-2:16.0.0-316.gcbb84f7.el8.x86_64 14/127 2020-04-02T23:20:44.029 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libcephfs2-2:16.0.0-316.gcbb84f7.el8.x86_64 15/127 2020-04-02T23:20:44.029 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librados-devel-2:16.0.0-316.gcbb84f7.el8.x86_64 16/127 2020-04-02T23:20:44.029 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libradosstriper1-2:16.0.0-316.gcbb84f7.el8.x86_6 17/127 2020-04-02T23:20:44.029 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librgw2-2:16.0.0-316.gcbb84f7.el8.x86_64 18/127 2020-04-02T23:20:44.029 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-ceph-argparse-2:16.0.0-316.gcbb84f7.el8. 19/127 2020-04-02T23:20:44.029 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-ceph-common-2:16.0.0-316.gcbb84f7.el8.x8 20/127 2020-04-02T23:20:44.030 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cephfs-2:16.0.0-316.gcbb84f7.el8.x86_64 21/127 2020-04-02T23:20:44.030 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-rados-2:16.0.0-316.gcbb84f7.el8.x86_64 22/127 2020-04-02T23:20:44.030 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-rbd-2:16.0.0-316.gcbb84f7.el8.x86_64 23/127 2020-04-02T23:20:44.030 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-rgw-2:16.0.0-316.gcbb84f7.el8.x86_64 24/127 2020-04-02T23:20:44.030 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : rbd-fuse-2:16.0.0-316.gcbb84f7.el8.x86_64 25/127 2020-04-02T23:20:44.030 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : rbd-mirror-2:16.0.0-316.gcbb84f7.el8.x86_64 26/127 2020-04-02T23:20:44.030 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : rbd-nbd-2:16.0.0-316.gcbb84f7.el8.x86_64 27/127 2020-04-02T23:20:44.031 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-grafana-dashboards-2:16.0.0-316.gcbb84f7.el 28/127 2020-04-02T23:20:44.031 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-cephadm-2:16.0.0-316.gcbb84f7.el8.noarc 29/127 2020-04-02T23:20:44.031 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-dashboard-2:16.0.0-316.gcbb84f7.el8.noa 30/127 2020-04-02T23:20:44.031 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.0.0-316.gcbb8 31/127 2020-04-02T23:20:44.044 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-modules-core-2:16.0.0-316.gcbb84f7.el8. 32/127 2020-04-02T23:20:44.044 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-rook-2:16.0.0-316.gcbb84f7.el8.noarch 33/127 2020-04-02T23:20:44.044 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-prometheus-alerts-2:16.0.0-316.gcbb84f7.el8 34/127 2020-04-02T23:20:44.044 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : automake-1.16.1-6.el8.noarch 35/127 2020-04-02T23:20:44.044 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : bison-3.0.4-10.el8.x86_64 36/127 2020-04-02T23:20:44.044 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : flex-2.6.1-9.el8.x86_64 37/127 2020-04-02T23:20:44.045 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : jq-1.5-12.el8.x86_64 38/127 2020-04-02T23:20:44.045 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 39/127 2020-04-02T23:20:44.045 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 40/127 2020-04-02T23:20:44.045 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 41/127 2020-04-02T23:20:44.045 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : oniguruma-6.8.2-1.el8.x86_64 42/127 2020-04-02T23:20:44.045 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openblas-0.3.3-2.el8.x86_64 43/127 2020-04-02T23:20:44.046 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openblas-threads-0.3.3-2.el8.x86_64 44/127 2020-04-02T23:20:44.046 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 45/127 2020-04-02T23:20:44.064 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 46/127 2020-04-02T23:20:44.064 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 47/127 2020-04-02T23:20:44.064 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-lxml-4.2.3-1.el8.x86_64 48/127 2020-04-02T23:20:44.065 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 49/127 2020-04-02T23:20:44.065 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 50/127 2020-04-02T23:20:44.065 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 51/127 2020-04-02T23:20:44.065 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 52/127 2020-04-02T23:20:44.065 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 53/127 2020-04-02T23:20:44.065 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 54/127 2020-04-02T23:20:44.066 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 55/127 2020-04-02T23:20:44.066 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 56/127 2020-04-02T23:20:44.066 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-scipy-1.0.0-20.module_el8.1.0+245+c39af4 57/127 2020-04-02T23:20:44.066 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 58/127 2020-04-02T23:20:44.066 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 59/127 2020-04-02T23:20:44.066 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : socat-1.7.3.2-6.el8.x86_64 60/127 2020-04-02T23:20:44.066 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : elfutils-libelf-devel-0.176-5.el8.x86_64 61/127 2020-04-02T23:20:44.066 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 62/127 2020-04-02T23:20:44.067 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : fuse-common-3.2.1-12.el8.x86_64 63/127 2020-04-02T23:20:44.067 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 64/127 2020-04-02T23:20:44.067 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : krb5-devel-1.17-9.el8.x86_64 65/127 2020-04-02T23:20:44.067 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 66/127 2020-04-02T23:20:44.067 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libcom_err-devel-1.44.6-3.el8.x86_64 67/127 2020-04-02T23:20:44.067 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libgfortran-8.3.1-4.5.el8.x86_64 68/127 2020-04-02T23:20:44.067 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libquadmath-8.3.1-4.5.el8.x86_64 69/127 2020-04-02T23:20:44.068 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librabbitmq-0.9.0-1.el8.x86_64 70/127 2020-04-02T23:20:44.068 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libselinux-devel-2.9-2.1.el8.x86_64 71/127 2020-04-02T23:20:44.068 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libsepol-devel-2.9-1.el8.x86_64 72/127 2020-04-02T23:20:44.068 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libuuid-devel-2.32.1-17.el8.x86_64 73/127 2020-04-02T23:20:44.068 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 74/127 2020-04-02T23:20:44.068 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libxslt-1.1.32-3.el8.x86_64 75/127 2020-04-02T23:20:44.068 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openssl-devel-1:1.1.1c-2.el8.x86_64 76/127 2020-04-02T23:20:44.069 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : pcre2-devel-10.32-1.el8.x86_64 77/127 2020-04-02T23:20:44.069 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : pcre2-utf16-10.32-1.el8.x86_64 78/127 2020-04-02T23:20:44.069 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : pcre2-utf32-10.32-1.el8.x86_64 79/127 2020-04-02T23:20:44.069 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-chardet-3.0.4-7.el8.noarch 80/127 2020-04-02T23:20:44.069 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 81/127 2020-04-02T23:20:44.069 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 82/127 2020-04-02T23:20:44.069 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pysocks-1.6.8-3.el8.noarch 83/127 2020-04-02T23:20:44.070 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-requests-2.20.0-2.1.el8_1.noarch 84/127 2020-04-02T23:20:44.070 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 85/127 2020-04-02T23:20:44.070 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-urllib3-1.24.2-2.el8.noarch 86/127 2020-04-02T23:20:44.070 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : xfsprogs-devel-5.0.0-1.el8.x86_64 87/127 2020-04-02T23:20:44.070 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : zlib-devel-1.2.11-10.el8.x86_64 88/127 2020-04-02T23:20:44.070 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cheroot-8.2.1-1.el8.noarch 89/127 2020-04-02T23:20:44.070 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 90/127 2020-04-02T23:20:44.070 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-execnet-1.7.1-1.el8.2.noarch 91/127 2020-04-02T23:20:44.071 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 92/127 2020-04-02T23:20:44.071 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 93/127 2020-04-02T23:20:44.071 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 94/127 2020-04-02T23:20:44.071 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-more-itertools-7.2.0-4.el8.noarch 95/127 2020-04-02T23:20:44.071 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 96/127 2020-04-02T23:20:44.071 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-portend-2.6-1.el8.noarch 97/127 2020-04-02T23:20:44.071 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-remoto-1.1.4-4.el8.noarch 98/127 2020-04-02T23:20:44.071 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 99/127 2020-04-02T23:20:44.072 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 100/127 2020-04-02T23:20:44.072 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 101/127 2020-04-02T23:20:44.072 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 102/127 2020-04-02T23:20:44.072 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 103/127 2020-04-02T23:20:44.072 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-trustme-0.5.2-4.el8.noarch 104/127 2020-04-02T23:20:44.072 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 105/127 2020-04-02T23:20:44.072 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : gperftools-libs-2.7-6.el8.x86_64 106/127 2020-04-02T23:20:44.073 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 107/127 2020-04-02T23:20:44.073 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 108/127 2020-04-02T23:20:44.073 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 109/127 2020-04-02T23:20:44.073 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 110/127 2020-04-02T23:20:44.073 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 111/127 2020-04-02T23:20:44.073 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 112/127 2020-04-02T23:20:44.073 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 113/127 2020-04-02T23:20:44.074 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 114/127 2020-04-02T23:20:44.074 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 115/127 2020-04-02T23:20:44.074 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-kubernetes-10.0.1-2.el8.noarch 116/127 2020-04-02T23:20:44.074 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-rsa-3.4.2-12.el8.noarch 117/127 2020-04-02T23:20:44.074 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 118/127 2020-04-02T23:20:44.074 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 119/127 2020-04-02T23:20:44.074 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 120/127 2020-04-02T23:20:44.075 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 121/127 2020-04-02T23:20:44.075 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 122/127 2020-04-02T23:20:44.075 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : leveldb-1.21-2.el8.x86_64 123/127 2020-04-02T23:20:44.075 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librados2-2:16.0.0-316.gcbb84f7.el8.x86_64 124/127 2020-04-02T23:20:44.075 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 125/127 2020-04-02T23:20:44.075 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librbd1-2:16.0.0-316.gcbb84f7.el8.x86_64 126/127 2020-04-02T23:20:44.226 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-test-2:16.0.0-316.gcbb84f7.el8.x86_64 113/127 2020-04-02T23:20:44.413 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libtool-2.4.6-25.el8.x86_64 114/127 2020-04-02T23:20:44.476 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 114/127 2020-04-02T23:20:45.382 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-fuse-2:16.0.0-316.gcbb84f7.el8.x86_64 115/127 2020-04-02T23:20:45.649 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : openssl-devel-1:1.1.1c-2.el8.x86_64 116/127 2020-04-02T23:20:45.658 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 127/127 2020-04-02T23:20:45.659 INFO:teuthology.orchestra.run.smithi174.stdout: 2020-04-02T23:20:45.659 INFO:teuthology.orchestra.run.smithi174.stdout:Upgraded: 2020-04-02T23:20:45.659 INFO:teuthology.orchestra.run.smithi174.stdout: librados2-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:20:45.659 INFO:teuthology.orchestra.run.smithi174.stdout: librbd1-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:20:45.659 INFO:teuthology.orchestra.run.smithi174.stdout: 2020-04-02T23:20:45.659 INFO:teuthology.orchestra.run.smithi174.stdout:Installed: 2020-04-02T23:20:45.659 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:20:45.660 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-base-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:20:45.660 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-fuse-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:20:45.660 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-immutable-object-cache-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:20:45.660 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:20:45.660 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-radosgw-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:20:45.660 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-test-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:20:45.660 INFO:teuthology.orchestra.run.smithi174.stdout: cephadm-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:20:45.661 INFO:teuthology.orchestra.run.smithi174.stdout: libcephfs-devel-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:20:45.661 INFO:teuthology.orchestra.run.smithi174.stdout: libcephfs2-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:20:45.661 INFO:teuthology.orchestra.run.smithi174.stdout: librados-devel-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:20:45.661 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cephfs-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:20:45.661 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rados-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:20:45.661 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rbd-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:20:45.661 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rgw-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:20:45.662 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-fuse-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:20:45.662 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-mirror-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:20:45.662 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-nbd-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:20:45.662 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-cephadm-2:16.0.0-316.gcbb84f7.el8.noarch 2020-04-02T23:20:45.662 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-dashboard-2:16.0.0-316.gcbb84f7.el8.noarch 2020-04-02T23:20:45.662 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-diskprediction-local-2:16.0.0-316.gcbb84f7.el8.noarch 2020-04-02T23:20:45.662 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-rook-2:16.0.0-316.gcbb84f7.el8.noarch 2020-04-02T23:20:45.663 INFO:teuthology.orchestra.run.smithi174.stdout: bison-3.0.4-10.el8.x86_64 2020-04-02T23:20:45.663 INFO:teuthology.orchestra.run.smithi174.stdout: flex-2.6.1-9.el8.x86_64 2020-04-02T23:20:45.663 INFO:teuthology.orchestra.run.smithi174.stdout: libtool-2.4.6-25.el8.x86_64 2020-04-02T23:20:45.663 INFO:teuthology.orchestra.run.smithi174.stdout: elfutils-libelf-devel-0.176-5.el8.x86_64 2020-04-02T23:20:45.663 INFO:teuthology.orchestra.run.smithi174.stdout: libaio-devel-0.3.112-1.el8.x86_64 2020-04-02T23:20:45.663 INFO:teuthology.orchestra.run.smithi174.stdout: libuuid-devel-2.32.1-17.el8.x86_64 2020-04-02T23:20:45.663 INFO:teuthology.orchestra.run.smithi174.stdout: openssl-devel-1:1.1.1c-2.el8.x86_64 2020-04-02T23:20:45.664 INFO:teuthology.orchestra.run.smithi174.stdout: xfsprogs-devel-5.0.0-1.el8.x86_64 2020-04-02T23:20:45.664 INFO:teuthology.orchestra.run.smithi174.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2020-04-02T23:20:45.664 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cssselect-0.9.2-10.el8.noarch 2020-04-02T23:20:45.664 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-common-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:20:45.664 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mds-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:20:45.664 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mon-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:20:45.664 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-osd-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:20:45.665 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-selinux-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:20:45.665 INFO:teuthology.orchestra.run.smithi174.stdout: libradosstriper1-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:20:45.665 INFO:teuthology.orchestra.run.smithi174.stdout: librgw2-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:20:45.665 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ceph-argparse-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:20:45.665 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ceph-common-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:20:45.666 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-grafana-dashboards-2:16.0.0-316.gcbb84f7.el8.noarch 2020-04-02T23:20:45.666 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-modules-core-2:16.0.0-316.gcbb84f7.el8.noarch 2020-04-02T23:20:45.666 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-prometheus-alerts-2:16.0.0-316.gcbb84f7.el8.noarch 2020-04-02T23:20:45.666 INFO:teuthology.orchestra.run.smithi174.stdout: automake-1.16.1-6.el8.noarch 2020-04-02T23:20:45.666 INFO:teuthology.orchestra.run.smithi174.stdout: jq-1.5-12.el8.x86_64 2020-04-02T23:20:45.666 INFO:teuthology.orchestra.run.smithi174.stdout: librdkafka-0.11.4-1.el8.x86_64 2020-04-02T23:20:45.667 INFO:teuthology.orchestra.run.smithi174.stdout: lttng-ust-2.8.1-11.el8.x86_64 2020-04-02T23:20:45.667 INFO:teuthology.orchestra.run.smithi174.stdout: oniguruma-6.8.2-1.el8.x86_64 2020-04-02T23:20:45.667 INFO:teuthology.orchestra.run.smithi174.stdout: openblas-0.3.3-2.el8.x86_64 2020-04-02T23:20:45.667 INFO:teuthology.orchestra.run.smithi174.stdout: openblas-threads-0.3.3-2.el8.x86_64 2020-04-02T23:20:45.667 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jsonpatch-1.21-2.el8.noarch 2020-04-02T23:20:45.667 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jsonpointer-1.10-11.el8.noarch 2020-04-02T23:20:45.667 INFO:teuthology.orchestra.run.smithi174.stdout: python3-lxml-4.2.3-1.el8.x86_64 2020-04-02T23:20:45.667 INFO:teuthology.orchestra.run.smithi174.stdout: python3-mako-1.0.6-13.el8.noarch 2020-04-02T23:20:45.668 INFO:teuthology.orchestra.run.smithi174.stdout: python3-markupsafe-0.23-19.el8.x86_64 2020-04-02T23:20:45.668 INFO:teuthology.orchestra.run.smithi174.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2020-04-02T23:20:45.668 INFO:teuthology.orchestra.run.smithi174.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2020-04-02T23:20:45.668 INFO:teuthology.orchestra.run.smithi174.stdout: python3-prettytable-0.7.2-14.el8.noarch 2020-04-02T23:20:45.668 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2020-04-02T23:20:45.668 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2020-04-02T23:20:45.668 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pytz-2017.2-9.el8.noarch 2020-04-02T23:20:45.669 INFO:teuthology.orchestra.run.smithi174.stdout: python3-scipy-1.0.0-20.module_el8.1.0+245+c39af44f.x86_64 2020-04-02T23:20:45.669 INFO:teuthology.orchestra.run.smithi174.stdout: python3-webencodings-0.5.1-6.el8.noarch 2020-04-02T23:20:45.669 INFO:teuthology.orchestra.run.smithi174.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2020-04-02T23:20:45.669 INFO:teuthology.orchestra.run.smithi174.stdout: socat-1.7.3.2-6.el8.x86_64 2020-04-02T23:20:45.669 INFO:teuthology.orchestra.run.smithi174.stdout: fuse-2.9.7-12.el8.x86_64 2020-04-02T23:20:45.669 INFO:teuthology.orchestra.run.smithi174.stdout: fuse-common-3.2.1-12.el8.x86_64 2020-04-02T23:20:45.669 INFO:teuthology.orchestra.run.smithi174.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2020-04-02T23:20:45.670 INFO:teuthology.orchestra.run.smithi174.stdout: krb5-devel-1.17-9.el8.x86_64 2020-04-02T23:20:45.670 INFO:teuthology.orchestra.run.smithi174.stdout: libcom_err-devel-1.44.6-3.el8.x86_64 2020-04-02T23:20:45.670 INFO:teuthology.orchestra.run.smithi174.stdout: libgfortran-8.3.1-4.5.el8.x86_64 2020-04-02T23:20:45.670 INFO:teuthology.orchestra.run.smithi174.stdout: libquadmath-8.3.1-4.5.el8.x86_64 2020-04-02T23:20:45.670 INFO:teuthology.orchestra.run.smithi174.stdout: librabbitmq-0.9.0-1.el8.x86_64 2020-04-02T23:20:45.670 INFO:teuthology.orchestra.run.smithi174.stdout: libselinux-devel-2.9-2.1.el8.x86_64 2020-04-02T23:20:45.670 INFO:teuthology.orchestra.run.smithi174.stdout: libsepol-devel-2.9-1.el8.x86_64 2020-04-02T23:20:45.671 INFO:teuthology.orchestra.run.smithi174.stdout: libverto-devel-0.3.0-5.el8.x86_64 2020-04-02T23:20:45.671 INFO:teuthology.orchestra.run.smithi174.stdout: libxslt-1.1.32-3.el8.x86_64 2020-04-02T23:20:45.671 INFO:teuthology.orchestra.run.smithi174.stdout: pcre2-devel-10.32-1.el8.x86_64 2020-04-02T23:20:45.671 INFO:teuthology.orchestra.run.smithi174.stdout: pcre2-utf16-10.32-1.el8.x86_64 2020-04-02T23:20:45.671 INFO:teuthology.orchestra.run.smithi174.stdout: pcre2-utf32-10.32-1.el8.x86_64 2020-04-02T23:20:45.671 INFO:teuthology.orchestra.run.smithi174.stdout: python3-chardet-3.0.4-7.el8.noarch 2020-04-02T23:20:45.671 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jwt-1.6.1-2.el8.noarch 2020-04-02T23:20:45.671 INFO:teuthology.orchestra.run.smithi174.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2020-04-02T23:20:45.672 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pysocks-1.6.8-3.el8.noarch 2020-04-02T23:20:45.672 INFO:teuthology.orchestra.run.smithi174.stdout: python3-requests-2.20.0-2.1.el8_1.noarch 2020-04-02T23:20:45.672 INFO:teuthology.orchestra.run.smithi174.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2020-04-02T23:20:45.672 INFO:teuthology.orchestra.run.smithi174.stdout: python3-urllib3-1.24.2-2.el8.noarch 2020-04-02T23:20:45.672 INFO:teuthology.orchestra.run.smithi174.stdout: zlib-devel-1.2.11-10.el8.x86_64 2020-04-02T23:20:45.672 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cheroot-8.2.1-1.el8.noarch 2020-04-02T23:20:45.672 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2020-04-02T23:20:45.673 INFO:teuthology.orchestra.run.smithi174.stdout: python3-execnet-1.7.1-1.el8.2.noarch 2020-04-02T23:20:45.673 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-6.2-6.el8.noarch 2020-04-02T23:20:45.673 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2020-04-02T23:20:45.673 INFO:teuthology.orchestra.run.smithi174.stdout: python3-logutils-0.3.5-11.el8.noarch 2020-04-02T23:20:45.673 INFO:teuthology.orchestra.run.smithi174.stdout: python3-more-itertools-7.2.0-4.el8.noarch 2020-04-02T23:20:45.673 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pecan-1.3.2-9.el8.noarch 2020-04-02T23:20:45.673 INFO:teuthology.orchestra.run.smithi174.stdout: python3-portend-2.6-1.el8.noarch 2020-04-02T23:20:45.674 INFO:teuthology.orchestra.run.smithi174.stdout: python3-remoto-1.1.4-4.el8.noarch 2020-04-02T23:20:45.674 INFO:teuthology.orchestra.run.smithi174.stdout: python3-repoze-lru-0.7-6.el8.noarch 2020-04-02T23:20:45.674 INFO:teuthology.orchestra.run.smithi174.stdout: python3-routes-2.4.1-12.el8.noarch 2020-04-02T23:20:45.674 INFO:teuthology.orchestra.run.smithi174.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2020-04-02T23:20:45.674 INFO:teuthology.orchestra.run.smithi174.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2020-04-02T23:20:45.674 INFO:teuthology.orchestra.run.smithi174.stdout: python3-tempora-1.14.1-5.el8.noarch 2020-04-02T23:20:45.674 INFO:teuthology.orchestra.run.smithi174.stdout: python3-trustme-0.5.2-4.el8.noarch 2020-04-02T23:20:45.675 INFO:teuthology.orchestra.run.smithi174.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2020-04-02T23:20:45.675 INFO:teuthology.orchestra.run.smithi174.stdout: gperftools-libs-2.7-6.el8.x86_64 2020-04-02T23:20:45.675 INFO:teuthology.orchestra.run.smithi174.stdout: liboath-2.6.2-3.el8.x86_64 2020-04-02T23:20:45.675 INFO:teuthology.orchestra.run.smithi174.stdout: libunwind-1.3.1-3.el8.x86_64 2020-04-02T23:20:45.675 INFO:teuthology.orchestra.run.smithi174.stdout: python3-apipkg-1.5-6.el8.noarch 2020-04-02T23:20:45.675 INFO:teuthology.orchestra.run.smithi174.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2020-04-02T23:20:45.675 INFO:teuthology.orchestra.run.smithi174.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2020-04-02T23:20:45.675 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cachetools-3.1.1-4.el8.noarch 2020-04-02T23:20:45.676 INFO:teuthology.orchestra.run.smithi174.stdout: python3-certifi-2018.10.15-7.el8.noarch 2020-04-02T23:20:45.676 INFO:teuthology.orchestra.run.smithi174.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2020-04-02T23:20:45.676 INFO:teuthology.orchestra.run.smithi174.stdout: python3-kubernetes-10.0.1-2.el8.noarch 2020-04-02T23:20:45.676 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rsa-3.4.2-12.el8.noarch 2020-04-02T23:20:45.676 INFO:teuthology.orchestra.run.smithi174.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2020-04-02T23:20:45.677 INFO:teuthology.orchestra.run.smithi174.stdout: python3-webob-1.8.5-1.el8.1.noarch 2020-04-02T23:20:45.677 INFO:teuthology.orchestra.run.smithi174.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2020-04-02T23:20:45.677 INFO:teuthology.orchestra.run.smithi174.stdout: python3-webtest-2.0.33-1.el8.noarch 2020-04-02T23:20:45.677 INFO:teuthology.orchestra.run.smithi174.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2020-04-02T23:20:45.677 INFO:teuthology.orchestra.run.smithi174.stdout: leveldb-1.21-2.el8.x86_64 2020-04-02T23:20:45.677 INFO:teuthology.orchestra.run.smithi174.stdout: 2020-04-02T23:20:45.678 INFO:teuthology.orchestra.run.smithi174.stdout:Complete! 2020-04-02T23:20:45.792 DEBUG:teuthology.parallel:result is None 2020-04-02T23:20:45.799 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : xfsprogs-devel-5.0.0-1.el8.x86_64 117/127 2020-04-02T23:20:45.966 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libcephfs-devel-2:16.0.0-316.gcbb84f7.el8.x86_64 118/127 2020-04-02T23:20:46.103 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : elfutils-libelf-devel-0.176-5.el8.x86_64 119/127 2020-04-02T23:20:46.309 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : rbd-fuse-2:16.0.0-316.gcbb84f7.el8.x86_64 120/127 2020-04-02T23:20:46.516 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : rbd-nbd-2:16.0.0-316.gcbb84f7.el8.x86_64 121/127 2020-04-02T23:20:46.705 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-immutable-object-cache-2:16.0.0-316.gcbb84f 122/127 2020-04-02T23:20:46.730 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.0.0-316.gcbb84f 122/127 2020-04-02T23:20:46.922 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 123/127 2020-04-02T23:20:47.131 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : flex-2.6.1-9.el8.x86_64 124/127 2020-04-02T23:20:47.219 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 124/127 2020-04-02T23:20:47.430 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : bison-3.0.4-10.el8.x86_64 125/127 2020-04-02T23:20:47.444 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 125/127 2020-04-02T23:20:47.444 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 126/127 2020-04-02T23:20:47.691 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 126/127 2020-04-02T23:20:47.691 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 127/127 2020-04-02T23:20:48.525 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 127/127 2020-04-02T23:20:48.526 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-2:16.0.0-316.gcbb84f7.el8.x86_64 1/127 2020-04-02T23:20:48.526 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-base-2:16.0.0-316.gcbb84f7.el8.x86_64 2/127 2020-04-02T23:20:48.526 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-common-2:16.0.0-316.gcbb84f7.el8.x86_64 3/127 2020-04-02T23:20:48.526 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-fuse-2:16.0.0-316.gcbb84f7.el8.x86_64 4/127 2020-04-02T23:20:48.526 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-immutable-object-cache-2:16.0.0-316.gcbb84f 5/127 2020-04-02T23:20:48.526 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mds-2:16.0.0-316.gcbb84f7.el8.x86_64 6/127 2020-04-02T23:20:48.526 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mgr-2:16.0.0-316.gcbb84f7.el8.x86_64 7/127 2020-04-02T23:20:48.526 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mon-2:16.0.0-316.gcbb84f7.el8.x86_64 8/127 2020-04-02T23:20:48.527 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-osd-2:16.0.0-316.gcbb84f7.el8.x86_64 9/127 2020-04-02T23:20:48.527 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-radosgw-2:16.0.0-316.gcbb84f7.el8.x86_64 10/127 2020-04-02T23:20:48.527 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-selinux-2:16.0.0-316.gcbb84f7.el8.x86_64 11/127 2020-04-02T23:20:48.527 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-test-2:16.0.0-316.gcbb84f7.el8.x86_64 12/127 2020-04-02T23:20:48.527 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : cephadm-2:16.0.0-316.gcbb84f7.el8.x86_64 13/127 2020-04-02T23:20:48.527 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libcephfs-devel-2:16.0.0-316.gcbb84f7.el8.x86_64 14/127 2020-04-02T23:20:48.527 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libcephfs2-2:16.0.0-316.gcbb84f7.el8.x86_64 15/127 2020-04-02T23:20:48.527 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librados-devel-2:16.0.0-316.gcbb84f7.el8.x86_64 16/127 2020-04-02T23:20:48.528 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libradosstriper1-2:16.0.0-316.gcbb84f7.el8.x86_6 17/127 2020-04-02T23:20:48.528 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librgw2-2:16.0.0-316.gcbb84f7.el8.x86_64 18/127 2020-04-02T23:20:48.529 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-ceph-argparse-2:16.0.0-316.gcbb84f7.el8. 19/127 2020-04-02T23:20:48.529 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-ceph-common-2:16.0.0-316.gcbb84f7.el8.x8 20/127 2020-04-02T23:20:48.529 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-cephfs-2:16.0.0-316.gcbb84f7.el8.x86_64 21/127 2020-04-02T23:20:48.530 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-rados-2:16.0.0-316.gcbb84f7.el8.x86_64 22/127 2020-04-02T23:20:48.530 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-rbd-2:16.0.0-316.gcbb84f7.el8.x86_64 23/127 2020-04-02T23:20:48.530 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-rgw-2:16.0.0-316.gcbb84f7.el8.x86_64 24/127 2020-04-02T23:20:48.530 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : rbd-fuse-2:16.0.0-316.gcbb84f7.el8.x86_64 25/127 2020-04-02T23:20:48.530 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : rbd-mirror-2:16.0.0-316.gcbb84f7.el8.x86_64 26/127 2020-04-02T23:20:48.530 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : rbd-nbd-2:16.0.0-316.gcbb84f7.el8.x86_64 27/127 2020-04-02T23:20:48.530 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-grafana-dashboards-2:16.0.0-316.gcbb84f7.el 28/127 2020-04-02T23:20:48.539 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mgr-cephadm-2:16.0.0-316.gcbb84f7.el8.noarc 29/127 2020-04-02T23:20:48.539 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mgr-dashboard-2:16.0.0-316.gcbb84f7.el8.noa 30/127 2020-04-02T23:20:48.540 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.0.0-316.gcbb8 31/127 2020-04-02T23:20:48.540 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mgr-modules-core-2:16.0.0-316.gcbb84f7.el8. 32/127 2020-04-02T23:20:48.540 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mgr-rook-2:16.0.0-316.gcbb84f7.el8.noarch 33/127 2020-04-02T23:20:48.540 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-prometheus-alerts-2:16.0.0-316.gcbb84f7.el8 34/127 2020-04-02T23:20:48.540 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : automake-1.16.1-6.el8.noarch 35/127 2020-04-02T23:20:48.540 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : bison-3.0.4-10.el8.x86_64 36/127 2020-04-02T23:20:48.540 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : flex-2.6.1-9.el8.x86_64 37/127 2020-04-02T23:20:48.540 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : jq-1.5-12.el8.x86_64 38/127 2020-04-02T23:20:48.541 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 39/127 2020-04-02T23:20:48.541 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 40/127 2020-04-02T23:20:48.541 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 41/127 2020-04-02T23:20:48.541 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : oniguruma-6.8.2-1.el8.x86_64 42/127 2020-04-02T23:20:48.541 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : openblas-0.3.3-2.el8.x86_64 43/127 2020-04-02T23:20:48.541 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : openblas-threads-0.3.3-2.el8.x86_64 44/127 2020-04-02T23:20:48.541 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 45/127 2020-04-02T23:20:48.541 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 46/127 2020-04-02T23:20:48.542 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 47/127 2020-04-02T23:20:48.542 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-lxml-4.2.3-1.el8.x86_64 48/127 2020-04-02T23:20:48.542 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 49/127 2020-04-02T23:20:48.542 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 50/127 2020-04-02T23:20:48.542 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 51/127 2020-04-02T23:20:48.542 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 52/127 2020-04-02T23:20:48.542 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 53/127 2020-04-02T23:20:48.542 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 54/127 2020-04-02T23:20:48.543 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 55/127 2020-04-02T23:20:48.543 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 56/127 2020-04-02T23:20:48.543 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-scipy-1.0.0-20.module_el8.1.0+245+c39af4 57/127 2020-04-02T23:20:48.543 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 58/127 2020-04-02T23:20:48.543 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 59/127 2020-04-02T23:20:48.543 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : socat-1.7.3.2-6.el8.x86_64 60/127 2020-04-02T23:20:48.543 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : elfutils-libelf-devel-0.176-5.el8.x86_64 61/127 2020-04-02T23:20:48.544 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 62/127 2020-04-02T23:20:48.544 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : fuse-common-3.2.1-12.el8.x86_64 63/127 2020-04-02T23:20:48.544 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 64/127 2020-04-02T23:20:48.544 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : krb5-devel-1.17-9.el8.x86_64 65/127 2020-04-02T23:20:48.544 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 66/127 2020-04-02T23:20:48.544 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libcom_err-devel-1.44.6-3.el8.x86_64 67/127 2020-04-02T23:20:48.544 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libgfortran-8.3.1-4.5.el8.x86_64 68/127 2020-04-02T23:20:48.544 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libquadmath-8.3.1-4.5.el8.x86_64 69/127 2020-04-02T23:20:48.545 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librabbitmq-0.9.0-1.el8.x86_64 70/127 2020-04-02T23:20:48.545 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libselinux-devel-2.9-2.1.el8.x86_64 71/127 2020-04-02T23:20:48.545 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libsepol-devel-2.9-1.el8.x86_64 72/127 2020-04-02T23:20:48.545 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libuuid-devel-2.32.1-17.el8.x86_64 73/127 2020-04-02T23:20:48.545 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 74/127 2020-04-02T23:20:48.545 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libxslt-1.1.32-3.el8.x86_64 75/127 2020-04-02T23:20:48.546 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : openssl-devel-1:1.1.1c-2.el8.x86_64 76/127 2020-04-02T23:20:48.546 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : pcre2-devel-10.32-1.el8.x86_64 77/127 2020-04-02T23:20:48.546 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : pcre2-utf16-10.32-1.el8.x86_64 78/127 2020-04-02T23:20:48.546 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : pcre2-utf32-10.32-1.el8.x86_64 79/127 2020-04-02T23:20:48.546 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-chardet-3.0.4-7.el8.noarch 80/127 2020-04-02T23:20:48.546 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 81/127 2020-04-02T23:20:48.546 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 82/127 2020-04-02T23:20:48.546 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-pysocks-1.6.8-3.el8.noarch 83/127 2020-04-02T23:20:48.547 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-requests-2.20.0-2.1.el8_1.noarch 84/127 2020-04-02T23:20:48.547 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 85/127 2020-04-02T23:20:48.547 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-urllib3-1.24.2-2.el8.noarch 86/127 2020-04-02T23:20:48.547 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : xfsprogs-devel-5.0.0-1.el8.x86_64 87/127 2020-04-02T23:20:48.548 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : zlib-devel-1.2.11-10.el8.x86_64 88/127 2020-04-02T23:20:48.548 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-cheroot-8.2.1-1.el8.noarch 89/127 2020-04-02T23:20:48.548 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 90/127 2020-04-02T23:20:48.548 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-execnet-1.7.1-1.el8.2.noarch 91/127 2020-04-02T23:20:48.548 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 92/127 2020-04-02T23:20:48.548 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 93/127 2020-04-02T23:20:48.549 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 94/127 2020-04-02T23:20:48.549 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-more-itertools-7.2.0-4.el8.noarch 95/127 2020-04-02T23:20:48.549 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 96/127 2020-04-02T23:20:48.549 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-portend-2.6-1.el8.noarch 97/127 2020-04-02T23:20:48.549 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-remoto-1.1.4-4.el8.noarch 98/127 2020-04-02T23:20:48.549 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 99/127 2020-04-02T23:20:48.550 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 100/127 2020-04-02T23:20:48.550 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 101/127 2020-04-02T23:20:48.550 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 102/127 2020-04-02T23:20:48.550 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 103/127 2020-04-02T23:20:48.550 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-trustme-0.5.2-4.el8.noarch 104/127 2020-04-02T23:20:48.550 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 105/127 2020-04-02T23:20:48.550 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : gperftools-libs-2.7-6.el8.x86_64 106/127 2020-04-02T23:20:48.550 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 107/127 2020-04-02T23:20:48.551 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 108/127 2020-04-02T23:20:48.551 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 109/127 2020-04-02T23:20:48.551 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 110/127 2020-04-02T23:20:48.551 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 111/127 2020-04-02T23:20:48.551 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 112/127 2020-04-02T23:20:48.551 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 113/127 2020-04-02T23:20:48.551 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 114/127 2020-04-02T23:20:48.551 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 115/127 2020-04-02T23:20:48.552 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-kubernetes-10.0.1-2.el8.noarch 116/127 2020-04-02T23:20:48.552 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-rsa-3.4.2-12.el8.noarch 117/127 2020-04-02T23:20:48.552 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 118/127 2020-04-02T23:20:48.552 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 119/127 2020-04-02T23:20:48.552 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 120/127 2020-04-02T23:20:48.552 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 121/127 2020-04-02T23:20:48.552 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 122/127 2020-04-02T23:20:48.553 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : leveldb-1.21-2.el8.x86_64 123/127 2020-04-02T23:20:48.553 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librados2-2:16.0.0-316.gcbb84f7.el8.x86_64 124/127 2020-04-02T23:20:48.553 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 125/127 2020-04-02T23:20:48.553 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librbd1-2:16.0.0-316.gcbb84f7.el8.x86_64 126/127 2020-04-02T23:20:50.225 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 127/127 2020-04-02T23:20:50.226 INFO:teuthology.orchestra.run.smithi196.stdout: 2020-04-02T23:20:50.226 INFO:teuthology.orchestra.run.smithi196.stdout:Upgraded: 2020-04-02T23:20:50.226 INFO:teuthology.orchestra.run.smithi196.stdout: librados2-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:20:50.226 INFO:teuthology.orchestra.run.smithi196.stdout: librbd1-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:20:50.226 INFO:teuthology.orchestra.run.smithi196.stdout: 2020-04-02T23:20:50.226 INFO:teuthology.orchestra.run.smithi196.stdout:Installed: 2020-04-02T23:20:50.226 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:20:50.227 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-base-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:20:50.227 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-fuse-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:20:50.227 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-immutable-object-cache-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:20:50.227 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:20:50.227 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-radosgw-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:20:50.227 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-test-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:20:50.227 INFO:teuthology.orchestra.run.smithi196.stdout: cephadm-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:20:50.228 INFO:teuthology.orchestra.run.smithi196.stdout: libcephfs-devel-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:20:50.228 INFO:teuthology.orchestra.run.smithi196.stdout: libcephfs2-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:20:50.228 INFO:teuthology.orchestra.run.smithi196.stdout: librados-devel-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:20:50.228 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cephfs-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:20:50.228 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rados-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:20:50.228 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rbd-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:20:50.228 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rgw-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:20:50.228 INFO:teuthology.orchestra.run.smithi196.stdout: rbd-fuse-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:20:50.229 INFO:teuthology.orchestra.run.smithi196.stdout: rbd-mirror-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:20:50.229 INFO:teuthology.orchestra.run.smithi196.stdout: rbd-nbd-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:20:50.229 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-cephadm-2:16.0.0-316.gcbb84f7.el8.noarch 2020-04-02T23:20:50.229 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-dashboard-2:16.0.0-316.gcbb84f7.el8.noarch 2020-04-02T23:20:50.229 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-diskprediction-local-2:16.0.0-316.gcbb84f7.el8.noarch 2020-04-02T23:20:50.229 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-rook-2:16.0.0-316.gcbb84f7.el8.noarch 2020-04-02T23:20:50.229 INFO:teuthology.orchestra.run.smithi196.stdout: bison-3.0.4-10.el8.x86_64 2020-04-02T23:20:50.230 INFO:teuthology.orchestra.run.smithi196.stdout: flex-2.6.1-9.el8.x86_64 2020-04-02T23:20:50.230 INFO:teuthology.orchestra.run.smithi196.stdout: libtool-2.4.6-25.el8.x86_64 2020-04-02T23:20:50.230 INFO:teuthology.orchestra.run.smithi196.stdout: elfutils-libelf-devel-0.176-5.el8.x86_64 2020-04-02T23:20:50.230 INFO:teuthology.orchestra.run.smithi196.stdout: libaio-devel-0.3.112-1.el8.x86_64 2020-04-02T23:20:50.230 INFO:teuthology.orchestra.run.smithi196.stdout: libuuid-devel-2.32.1-17.el8.x86_64 2020-04-02T23:20:50.230 INFO:teuthology.orchestra.run.smithi196.stdout: openssl-devel-1:1.1.1c-2.el8.x86_64 2020-04-02T23:20:50.230 INFO:teuthology.orchestra.run.smithi196.stdout: xfsprogs-devel-5.0.0-1.el8.x86_64 2020-04-02T23:20:50.230 INFO:teuthology.orchestra.run.smithi196.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2020-04-02T23:20:50.231 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cssselect-0.9.2-10.el8.noarch 2020-04-02T23:20:50.231 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-common-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:20:50.231 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mds-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:20:50.231 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mon-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:20:50.231 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-osd-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:20:50.231 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-selinux-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:20:50.231 INFO:teuthology.orchestra.run.smithi196.stdout: libradosstriper1-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:20:50.232 INFO:teuthology.orchestra.run.smithi196.stdout: librgw2-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:20:50.232 INFO:teuthology.orchestra.run.smithi196.stdout: python3-ceph-argparse-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:20:50.232 INFO:teuthology.orchestra.run.smithi196.stdout: python3-ceph-common-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:20:50.232 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-grafana-dashboards-2:16.0.0-316.gcbb84f7.el8.noarch 2020-04-02T23:20:50.232 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-modules-core-2:16.0.0-316.gcbb84f7.el8.noarch 2020-04-02T23:20:50.232 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-prometheus-alerts-2:16.0.0-316.gcbb84f7.el8.noarch 2020-04-02T23:20:50.232 INFO:teuthology.orchestra.run.smithi196.stdout: automake-1.16.1-6.el8.noarch 2020-04-02T23:20:50.232 INFO:teuthology.orchestra.run.smithi196.stdout: jq-1.5-12.el8.x86_64 2020-04-02T23:20:50.233 INFO:teuthology.orchestra.run.smithi196.stdout: librdkafka-0.11.4-1.el8.x86_64 2020-04-02T23:20:50.233 INFO:teuthology.orchestra.run.smithi196.stdout: lttng-ust-2.8.1-11.el8.x86_64 2020-04-02T23:20:50.233 INFO:teuthology.orchestra.run.smithi196.stdout: oniguruma-6.8.2-1.el8.x86_64 2020-04-02T23:20:50.233 INFO:teuthology.orchestra.run.smithi196.stdout: openblas-0.3.3-2.el8.x86_64 2020-04-02T23:20:50.233 INFO:teuthology.orchestra.run.smithi196.stdout: openblas-threads-0.3.3-2.el8.x86_64 2020-04-02T23:20:50.233 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jsonpatch-1.21-2.el8.noarch 2020-04-02T23:20:50.233 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jsonpointer-1.10-11.el8.noarch 2020-04-02T23:20:50.234 INFO:teuthology.orchestra.run.smithi196.stdout: python3-lxml-4.2.3-1.el8.x86_64 2020-04-02T23:20:50.234 INFO:teuthology.orchestra.run.smithi196.stdout: python3-mako-1.0.6-13.el8.noarch 2020-04-02T23:20:50.234 INFO:teuthology.orchestra.run.smithi196.stdout: python3-markupsafe-0.23-19.el8.x86_64 2020-04-02T23:20:50.234 INFO:teuthology.orchestra.run.smithi196.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2020-04-02T23:20:50.234 INFO:teuthology.orchestra.run.smithi196.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2020-04-02T23:20:50.234 INFO:teuthology.orchestra.run.smithi196.stdout: python3-prettytable-0.7.2-14.el8.noarch 2020-04-02T23:20:50.234 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2020-04-02T23:20:50.234 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2020-04-02T23:20:50.235 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pytz-2017.2-9.el8.noarch 2020-04-02T23:20:50.235 INFO:teuthology.orchestra.run.smithi196.stdout: python3-scipy-1.0.0-20.module_el8.1.0+245+c39af44f.x86_64 2020-04-02T23:20:50.235 INFO:teuthology.orchestra.run.smithi196.stdout: python3-webencodings-0.5.1-6.el8.noarch 2020-04-02T23:20:50.235 INFO:teuthology.orchestra.run.smithi196.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2020-04-02T23:20:50.235 INFO:teuthology.orchestra.run.smithi196.stdout: socat-1.7.3.2-6.el8.x86_64 2020-04-02T23:20:50.235 INFO:teuthology.orchestra.run.smithi196.stdout: fuse-2.9.7-12.el8.x86_64 2020-04-02T23:20:50.235 INFO:teuthology.orchestra.run.smithi196.stdout: fuse-common-3.2.1-12.el8.x86_64 2020-04-02T23:20:50.235 INFO:teuthology.orchestra.run.smithi196.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2020-04-02T23:20:50.236 INFO:teuthology.orchestra.run.smithi196.stdout: krb5-devel-1.17-9.el8.x86_64 2020-04-02T23:20:50.236 INFO:teuthology.orchestra.run.smithi196.stdout: libcom_err-devel-1.44.6-3.el8.x86_64 2020-04-02T23:20:50.236 INFO:teuthology.orchestra.run.smithi196.stdout: libgfortran-8.3.1-4.5.el8.x86_64 2020-04-02T23:20:50.236 INFO:teuthology.orchestra.run.smithi196.stdout: libquadmath-8.3.1-4.5.el8.x86_64 2020-04-02T23:20:50.236 INFO:teuthology.orchestra.run.smithi196.stdout: librabbitmq-0.9.0-1.el8.x86_64 2020-04-02T23:20:50.236 INFO:teuthology.orchestra.run.smithi196.stdout: libselinux-devel-2.9-2.1.el8.x86_64 2020-04-02T23:20:50.236 INFO:teuthology.orchestra.run.smithi196.stdout: libsepol-devel-2.9-1.el8.x86_64 2020-04-02T23:20:50.237 INFO:teuthology.orchestra.run.smithi196.stdout: libverto-devel-0.3.0-5.el8.x86_64 2020-04-02T23:20:50.237 INFO:teuthology.orchestra.run.smithi196.stdout: libxslt-1.1.32-3.el8.x86_64 2020-04-02T23:20:50.237 INFO:teuthology.orchestra.run.smithi196.stdout: pcre2-devel-10.32-1.el8.x86_64 2020-04-02T23:20:50.237 INFO:teuthology.orchestra.run.smithi196.stdout: pcre2-utf16-10.32-1.el8.x86_64 2020-04-02T23:20:50.237 INFO:teuthology.orchestra.run.smithi196.stdout: pcre2-utf32-10.32-1.el8.x86_64 2020-04-02T23:20:50.237 INFO:teuthology.orchestra.run.smithi196.stdout: python3-chardet-3.0.4-7.el8.noarch 2020-04-02T23:20:50.237 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jwt-1.6.1-2.el8.noarch 2020-04-02T23:20:50.237 INFO:teuthology.orchestra.run.smithi196.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2020-04-02T23:20:50.238 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pysocks-1.6.8-3.el8.noarch 2020-04-02T23:20:50.238 INFO:teuthology.orchestra.run.smithi196.stdout: python3-requests-2.20.0-2.1.el8_1.noarch 2020-04-02T23:20:50.238 INFO:teuthology.orchestra.run.smithi196.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2020-04-02T23:20:50.238 INFO:teuthology.orchestra.run.smithi196.stdout: python3-urllib3-1.24.2-2.el8.noarch 2020-04-02T23:20:50.238 INFO:teuthology.orchestra.run.smithi196.stdout: zlib-devel-1.2.11-10.el8.x86_64 2020-04-02T23:20:50.238 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cheroot-8.2.1-1.el8.noarch 2020-04-02T23:20:50.238 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2020-04-02T23:20:50.238 INFO:teuthology.orchestra.run.smithi196.stdout: python3-execnet-1.7.1-1.el8.2.noarch 2020-04-02T23:20:50.239 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-6.2-6.el8.noarch 2020-04-02T23:20:50.239 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2020-04-02T23:20:50.239 INFO:teuthology.orchestra.run.smithi196.stdout: python3-logutils-0.3.5-11.el8.noarch 2020-04-02T23:20:50.239 INFO:teuthology.orchestra.run.smithi196.stdout: python3-more-itertools-7.2.0-4.el8.noarch 2020-04-02T23:20:50.239 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pecan-1.3.2-9.el8.noarch 2020-04-02T23:20:50.239 INFO:teuthology.orchestra.run.smithi196.stdout: python3-portend-2.6-1.el8.noarch 2020-04-02T23:20:50.239 INFO:teuthology.orchestra.run.smithi196.stdout: python3-remoto-1.1.4-4.el8.noarch 2020-04-02T23:20:50.240 INFO:teuthology.orchestra.run.smithi196.stdout: python3-repoze-lru-0.7-6.el8.noarch 2020-04-02T23:20:50.240 INFO:teuthology.orchestra.run.smithi196.stdout: python3-routes-2.4.1-12.el8.noarch 2020-04-02T23:20:50.240 INFO:teuthology.orchestra.run.smithi196.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2020-04-02T23:20:50.240 INFO:teuthology.orchestra.run.smithi196.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2020-04-02T23:20:50.240 INFO:teuthology.orchestra.run.smithi196.stdout: python3-tempora-1.14.1-5.el8.noarch 2020-04-02T23:20:50.240 INFO:teuthology.orchestra.run.smithi196.stdout: python3-trustme-0.5.2-4.el8.noarch 2020-04-02T23:20:50.240 INFO:teuthology.orchestra.run.smithi196.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2020-04-02T23:20:50.240 INFO:teuthology.orchestra.run.smithi196.stdout: gperftools-libs-2.7-6.el8.x86_64 2020-04-02T23:20:50.241 INFO:teuthology.orchestra.run.smithi196.stdout: liboath-2.6.2-3.el8.x86_64 2020-04-02T23:20:50.241 INFO:teuthology.orchestra.run.smithi196.stdout: libunwind-1.3.1-3.el8.x86_64 2020-04-02T23:20:50.241 INFO:teuthology.orchestra.run.smithi196.stdout: python3-apipkg-1.5-6.el8.noarch 2020-04-02T23:20:50.241 INFO:teuthology.orchestra.run.smithi196.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2020-04-02T23:20:50.241 INFO:teuthology.orchestra.run.smithi196.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2020-04-02T23:20:50.241 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cachetools-3.1.1-4.el8.noarch 2020-04-02T23:20:50.241 INFO:teuthology.orchestra.run.smithi196.stdout: python3-certifi-2018.10.15-7.el8.noarch 2020-04-02T23:20:50.241 INFO:teuthology.orchestra.run.smithi196.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2020-04-02T23:20:50.242 INFO:teuthology.orchestra.run.smithi196.stdout: python3-kubernetes-10.0.1-2.el8.noarch 2020-04-02T23:20:50.242 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rsa-3.4.2-12.el8.noarch 2020-04-02T23:20:50.242 INFO:teuthology.orchestra.run.smithi196.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2020-04-02T23:20:50.242 INFO:teuthology.orchestra.run.smithi196.stdout: python3-webob-1.8.5-1.el8.1.noarch 2020-04-02T23:20:50.242 INFO:teuthology.orchestra.run.smithi196.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2020-04-02T23:20:50.242 INFO:teuthology.orchestra.run.smithi196.stdout: python3-webtest-2.0.33-1.el8.noarch 2020-04-02T23:20:50.242 INFO:teuthology.orchestra.run.smithi196.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2020-04-02T23:20:50.243 INFO:teuthology.orchestra.run.smithi196.stdout: leveldb-1.21-2.el8.x86_64 2020-04-02T23:20:50.243 INFO:teuthology.orchestra.run.smithi196.stdout: 2020-04-02T23:20:50.243 INFO:teuthology.orchestra.run.smithi196.stdout:Complete! 2020-04-02T23:20:50.409 DEBUG:teuthology.parallel:result is None 2020-04-02T23:20:50.409 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:20:50.426 INFO:teuthology.orchestra.run.smithi196:> sudo lsb_release -is 2020-04-02T23:20:50.512 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS 2020-04-02T23:20:50.513 DEBUG:teuthology.misc:System to be installed: CentOS 2020-04-02T23:20:50.514 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=cbb84f71d70460f911296715ab61ac09c6962b17 2020-04-02T23:20:50.770 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:20:50.786 INFO:teuthology.orchestra.run.smithi196:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2020-04-02T23:20:50.844 INFO:teuthology.orchestra.run.smithi196.stdout:16.0.0-316.gcbb84f7.el8 2020-04-02T23:20:50.845 INFO:teuthology.packaging:The installed version of ceph is 16.0.0-316.gcbb84f7.el8 2020-04-02T23:20:50.845 INFO:teuthology.task.install:The correct ceph version 16.0.0-316.gcbb84f7 is installed. 2020-04-02T23:20:50.845 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:20:50.864 INFO:teuthology.orchestra.run.smithi174:> sudo lsb_release -is 2020-04-02T23:20:50.955 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS 2020-04-02T23:20:50.956 DEBUG:teuthology.misc:System to be installed: CentOS 2020-04-02T23:20:50.957 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=cbb84f71d70460f911296715ab61ac09c6962b17 2020-04-02T23:20:51.191 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:20:51.206 INFO:teuthology.orchestra.run.smithi174:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2020-04-02T23:20:51.267 INFO:teuthology.orchestra.run.smithi174.stdout:16.0.0-316.gcbb84f7.el8 2020-04-02T23:20:51.268 INFO:teuthology.packaging:The installed version of ceph is 16.0.0-316.gcbb84f7.el8 2020-04-02T23:20:51.268 INFO:teuthology.task.install:The correct ceph version 16.0.0-316.gcbb84f7 is installed. 2020-04-02T23:20:51.268 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2020-04-02T23:20:51.268 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:20:51.282 INFO:teuthology.orchestra.run.smithi196:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2020-04-02T23:20:51.352 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:20:51.368 INFO:teuthology.orchestra.run.smithi174:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2020-04-02T23:20:51.439 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2020-04-02T23:20:51.439 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:20:51.452 INFO:teuthology.orchestra.run.smithi196:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2020-04-02T23:20:51.520 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:20:51.574 INFO:teuthology.orchestra.run.smithi196:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-04-02T23:20:51.641 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:20:51.658 INFO:teuthology.orchestra.run.smithi174:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2020-04-02T23:20:51.732 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:20:51.787 INFO:teuthology.orchestra.run.smithi174:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-04-02T23:20:51.856 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2020-04-02T23:20:51.857 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:20:51.870 INFO:teuthology.orchestra.run.smithi196:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2020-04-02T23:20:51.955 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:20:52.008 INFO:teuthology.orchestra.run.smithi196:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-04-02T23:20:52.075 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:20:52.090 INFO:teuthology.orchestra.run.smithi174:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2020-04-02T23:20:52.176 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:20:52.232 INFO:teuthology.orchestra.run.smithi174:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-04-02T23:20:52.300 INFO:teuthology.run_tasks:Running task ceph... 2020-04-02T23:20:52.372 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2020-04-02T23:20:52.373 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:20:52.387 INFO:teuthology.orchestra.run.smithi174:> sudo chmod 777 /var/log/ceph 2020-04-02T23:20:52.429 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:20:52.443 INFO:teuthology.orchestra.run.smithi196:> sudo chmod 777 /var/log/ceph 2020-04-02T23:20:52.529 INFO:tasks.ceph:Disabling ceph logrotate... 2020-04-02T23:20:52.530 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:20:52.544 INFO:teuthology.orchestra.run.smithi174:> sudo rm -f -- /etc/logrotate.d/ceph 2020-04-02T23:20:52.587 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:20:52.600 INFO:teuthology.orchestra.run.smithi196:> sudo rm -f -- /etc/logrotate.d/ceph 2020-04-02T23:20:52.667 INFO:tasks.ceph:Creating extra log directories... 2020-04-02T23:20:52.668 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:20:52.681 INFO:teuthology.orchestra.run.smithi174:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2020-04-02T23:20:52.723 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:20:52.737 INFO:teuthology.orchestra.run.smithi196:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2020-04-02T23:20:52.804 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2020-04-02T23:20:52.804 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2020-04-02T23:20:52.804 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2020-04-02T23:20:52.805 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:20:52.857 INFO:teuthology.orchestra.run.smithi196:> cat > /home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-04-02T23:20:52.941 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:20:52.995 INFO:teuthology.orchestra.run.smithi196:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2020-04-02T23:20:53.106 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:20:53.119 INFO:teuthology.orchestra.run.smithi196:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2020-04-02T23:20:53.190 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:20:53.207 INFO:teuthology.orchestra.run.smithi174:> cat > /home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-04-02T23:20:53.295 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:20:53.352 INFO:teuthology.orchestra.run.smithi174:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2020-04-02T23:20:53.466 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:20:53.482 INFO:teuthology.orchestra.run.smithi174:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2020-04-02T23:20:53.550 INFO:tasks.ceph:Creating ceph cluster ceph... 2020-04-02T23:20:53.550 INFO:tasks.ceph:config {'mon_bind_addrvec': True, 'fs': 'xfs', 'log_whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'skip_mgr_daemons': False, 'cpu_profile': set([]), 'mkfs_options': None, 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mount_options': None, 'conf': {'mds': {'mds debug frag': True, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds inject traceless reply probability': 0.5, 'debug mds': 20, 'mds bal merge size': 5, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds op complaint time': 180, 'mds debug scatterstat': True, 'osd op complaint time': 180, 'mds verify scatter': True}, 'client': {'debug ms': 1, 'debug client': 20, 'client mount timeout': 600}, 'mon': {'debug mon': 20, 'debug paxos': 20, 'mon op complaint time': 120, 'debug ms': 1}, 'osd': {'debug ms': 1, 'debug journal': 20, 'debug osd': 25, 'debug filestore': 20, 'osd objectstore': 'filestore', 'osd op complaint time': 180, 'osd sloppy crc': True}}} 2020-04-02T23:20:53.551 INFO:tasks.ceph:ctx.config {'kernel': {'sha1': 'distro', 'kdb': True}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.lock_machines': (2, 'smithi')}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'sha1': 'distro', 'kdb': True}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'dump', 'indent'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel']}, 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'sha1': 'cbb84f71d70460f911296715ab61ac09c6962b17'}}, {'ceph': None}, {'ceph-fuse': None}, {'workunit': {'clients': {'all': ['suites/dbench.sh']}}}], 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_wip-greg-testing-42/qa', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/worker.smithi.2737', 'owner': 'scheduled_gregf@teuthology', 'openstack': [{'volumes': {'count': 4, 'size': 30}}, {'machine': {'disk': 200}}], 'targets': {'smithi174.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3gyiXBNua9BUaupXpimYbFZF1YsGffMnTNJ5pqivIgcUvIHBuCDfWhLnqqm32vIQGqMqC2T47cW/crbZPMIVlqqXSWpSes4M6mcpOQlKa2rq4JLSC4maNAv1Xr00wbjiDg79rL56GBYvkjc9QEv5UFzTlwpSOLNhxjybSr5S/3aQ3nJjAlhONrvYFveoV8L6HI1aIJLSxDf1JnLwY4syYDRbz9OJt2XXKppQlewOuHaDuidid2hTmyy1Wwsg0LvCU2RfQnlEUNwRzG+dNmXaMpBm32mt/K3K9+aVVkBxpuEfO6XTEzeclmrnMdDiSp31vX1EgaKlXoVX7tPwZ/FdL6KOlsmylQAeo3ijO/Q8s5S3ehuBlCJzp82vDDHTYTiBMLn0dg867rDUq8r0Yz7PO9CpEk1exys49LnBkIU8RUKthKS0BGF8Gws3xA1YiDDZ8sRKUBGYlR0w4JabWkPaHpY3KB6UfYAmk8phGkSpzFO6iskPtytaiPyLqWVLXGp0=', 'smithi196.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDQ0fJavLFzLyzKQgESiHP74aFoU6LuuiVdZd45PJPAkxsgOoex2xWlxsJb13NgVOJmcae0VUsgQdSJCG7gz/IfhEP0gxDtxU2YXBI4IenAui6MTYpEszNOoVP/VIZvBdfLdisNDA8a/TiPQn3FgHtqYMUe1CtGBuZCBKQWZ3dHH4j42GKoGG1980m2RBAxyj0PUD4Nrwg9eXqFQBL8gq0WhqsXqZWeQJu0B9+ncIR23HLXrtLM407DdWeYiz8DsRkpo7IY2upM3jjXUg7Ou1+32bWVTl9Hooi3yDBimRHeXU0OQ+yqLOKYD+ceI1FvLXO+7NEWZ4Zk988Ur57r8zDGoQR+76ACcNb5aPJfolrAxMwPqIRty44ohmE8YYRUR2zRKS0hQ5ljCY3LnNkhX784vvGUt8WTOawcTaXLOpbparZ13h+k3/4LfmSYLzqONEaur0T5KYjY33xXNHIrr4IC9WB+q2KxLjZ6W4j/N1KAMmm1Ov1HoZ9xgf9TmwGVCYE='}, 'job_id': '4919105', 'tube': 'smithi', 'suite_branch': 'wip-greg-testing-42', 'priority': 101, 'os_version': '8.1', 'first_in_suite': False, 'branch': 'wip-greg-testing-42', 'suite': 'fs', 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'email': 'gfarnum@redhat.com', 'archive_path': '/home/teuthworker/archive/gregf-2020-04-02_17:05:44-fs-wip-greg-testing-42-distro-basic-smithi/4919105', 'description': 'fs/traceless/{begin.yaml clusters/fixed-2-ucephfs.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{centos_8.yaml} tasks/cfuse_workunit_suites_dbench.yaml traceless/50pc.yaml}', 'nuke-on-error': True, 'repo': 'git://git.ceph.com/ceph-ci.git', 'last_in_suite': False, 'machine_type': 'smithi', 'teuthology_branch': 'master', 'sha1': 'cbb84f71d70460f911296715ab61ac09c6962b17', 'name': 'gregf-2020-04-02_17:05:44-fs-wip-greg-testing-42-distro-basic-smithi', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'overrides': {'ceph': {'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'conf': {'mds': {'mds debug frag': True, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds inject traceless reply probability': 0.5, 'debug mds': 20, 'mds bal merge size': 5, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds op complaint time': 180, 'mds debug scatterstat': True, 'osd op complaint time': 180, 'mds verify scatter': True}, 'client': {'debug ms': 1, 'debug client': 20, 'client mount timeout': 600}, 'mon': {'debug mon': 20, 'debug paxos': 20, 'mon op complaint time': 120, 'debug ms': 1}, 'osd': {'debug ms': 1, 'debug journal': 20, 'debug osd': 25, 'debug filestore': 20, 'osd objectstore': 'filestore', 'osd op complaint time': 180, 'osd sloppy crc': True}}, 'fs': 'xfs', 'sha1': 'cbb84f71d70460f911296715ab61ac09c6962b17'}, 'ceph-deploy': {'fs': 'xfs', 'filestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'osd sloppy crc': True, 'osd objectstore': 'filestore'}}}, 'install': {'ceph': {'sha1': 'cbb84f71d70460f911296715ab61ac09c6962b17'}}, 'admin_socket': {'branch': 'wip-greg-testing-42'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'workunit': {'sha1': 'cbb84f71d70460f911296715ab61ac09c6962b17', 'branch': 'wip-greg-testing-42'}}, 'os_type': 'centos', 'suite_sha1': 'cbb84f71d70460f911296715ab61ac09c6962b17'} 2020-04-02T23:20:53.551 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:20:53.604 INFO:teuthology.orchestra.run.smithi174:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2020-04-02T23:20:53.646 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:20:53.660 INFO:teuthology.orchestra.run.smithi196:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2020-04-02T23:20:53.715 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:20:53.729 INFO:teuthology.orchestra.run.smithi174:> sudo install -d -m0777 -- /var/run/ceph 2020-04-02T23:20:53.772 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:20:53.786 INFO:teuthology.orchestra.run.smithi196:> sudo install -d -m0777 -- /var/run/ceph 2020-04-02T23:20:53.909 DEBUG:teuthology.orchestra.remote:smithi196:/scratch_devs is 72B 2020-04-02T23:20:53.959 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2020-04-02T23:20:53.959 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:20:53.972 INFO:teuthology.orchestra.run.smithi196:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2020-04-02T23:20:54.025 INFO:teuthology.orchestra.run.smithi196.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-1 2020-04-02T23:20:54.025 INFO:teuthology.orchestra.run.smithi196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-04-02T23:20:54.026 INFO:teuthology.orchestra.run.smithi196.stdout:Device: 6h/6d Inode: 61741 Links: 1 2020-04-02T23:20:54.026 INFO:teuthology.orchestra.run.smithi196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-04-02T23:20:54.026 INFO:teuthology.orchestra.run.smithi196.stdout:Context: system_u:object_r:device_t:s0 2020-04-02T23:20:54.026 INFO:teuthology.orchestra.run.smithi196.stdout:Access: 2020-04-02 23:20:48.165978846 +0000 2020-04-02T23:20:54.026 INFO:teuthology.orchestra.run.smithi196.stdout:Modify: 2020-04-02 23:19:03.257231130 +0000 2020-04-02T23:20:54.026 INFO:teuthology.orchestra.run.smithi196.stdout:Change: 2020-04-02 23:19:03.257231130 +0000 2020-04-02T23:20:54.027 INFO:teuthology.orchestra.run.smithi196.stdout: Birth: - 2020-04-02T23:20:54.038 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records in 2020-04-02T23:20:54.038 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records out 2020-04-02T23:20:54.038 INFO:teuthology.orchestra.run.smithi196.stderr:512 bytes copied, 0.00021239 s, 2.4 MB/s 2020-04-02T23:20:54.041 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:20:54.093 INFO:teuthology.orchestra.run.smithi196:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2020-04-02T23:20:54.147 INFO:teuthology.orchestra.run.smithi196.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2020-04-02T23:20:54.147 INFO:teuthology.orchestra.run.smithi196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-04-02T23:20:54.148 INFO:teuthology.orchestra.run.smithi196.stdout:Device: 6h/6d Inode: 55069 Links: 1 2020-04-02T23:20:54.148 INFO:teuthology.orchestra.run.smithi196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-04-02T23:20:54.148 INFO:teuthology.orchestra.run.smithi196.stdout:Context: system_u:object_r:device_t:s0 2020-04-02T23:20:54.148 INFO:teuthology.orchestra.run.smithi196.stdout:Access: 2020-04-02 23:20:48.165978846 +0000 2020-04-02T23:20:54.148 INFO:teuthology.orchestra.run.smithi196.stdout:Modify: 2020-04-02 23:19:03.613223318 +0000 2020-04-02T23:20:54.148 INFO:teuthology.orchestra.run.smithi196.stdout:Change: 2020-04-02 23:19:03.613223318 +0000 2020-04-02T23:20:54.148 INFO:teuthology.orchestra.run.smithi196.stdout: Birth: - 2020-04-02T23:20:54.160 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records in 2020-04-02T23:20:54.161 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records out 2020-04-02T23:20:54.161 INFO:teuthology.orchestra.run.smithi196.stderr:512 bytes copied, 0.000175594 s, 2.9 MB/s 2020-04-02T23:20:54.164 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:20:54.218 INFO:teuthology.orchestra.run.smithi196:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2020-04-02T23:20:54.272 INFO:teuthology.orchestra.run.smithi196.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-3 2020-04-02T23:20:54.273 INFO:teuthology.orchestra.run.smithi196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-04-02T23:20:54.273 INFO:teuthology.orchestra.run.smithi196.stdout:Device: 6h/6d Inode: 55130 Links: 1 2020-04-02T23:20:54.273 INFO:teuthology.orchestra.run.smithi196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-04-02T23:20:54.273 INFO:teuthology.orchestra.run.smithi196.stdout:Context: system_u:object_r:device_t:s0 2020-04-02T23:20:54.273 INFO:teuthology.orchestra.run.smithi196.stdout:Access: 2020-04-02 23:20:48.165978846 +0000 2020-04-02T23:20:54.273 INFO:teuthology.orchestra.run.smithi196.stdout:Modify: 2020-04-02 23:19:03.971215463 +0000 2020-04-02T23:20:54.273 INFO:teuthology.orchestra.run.smithi196.stdout:Change: 2020-04-02 23:19:03.971215463 +0000 2020-04-02T23:20:54.273 INFO:teuthology.orchestra.run.smithi196.stdout: Birth: - 2020-04-02T23:20:54.285 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records in 2020-04-02T23:20:54.286 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records out 2020-04-02T23:20:54.286 INFO:teuthology.orchestra.run.smithi196.stderr:512 bytes copied, 0.000216608 s, 2.4 MB/s 2020-04-02T23:20:54.288 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:20:54.341 INFO:teuthology.orchestra.run.smithi196:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2020-04-02T23:20:54.395 INFO:teuthology.orchestra.run.smithi196.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-4 2020-04-02T23:20:54.395 INFO:teuthology.orchestra.run.smithi196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-04-02T23:20:54.395 INFO:teuthology.orchestra.run.smithi196.stdout:Device: 6h/6d Inode: 59284 Links: 1 2020-04-02T23:20:54.396 INFO:teuthology.orchestra.run.smithi196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-04-02T23:20:54.396 INFO:teuthology.orchestra.run.smithi196.stdout:Context: system_u:object_r:device_t:s0 2020-04-02T23:20:54.396 INFO:teuthology.orchestra.run.smithi196.stdout:Access: 2020-04-02 23:20:48.165978846 +0000 2020-04-02T23:20:54.396 INFO:teuthology.orchestra.run.smithi196.stdout:Modify: 2020-04-02 23:19:04.325207695 +0000 2020-04-02T23:20:54.396 INFO:teuthology.orchestra.run.smithi196.stdout:Change: 2020-04-02 23:19:04.325207695 +0000 2020-04-02T23:20:54.396 INFO:teuthology.orchestra.run.smithi196.stdout: Birth: - 2020-04-02T23:20:54.408 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records in 2020-04-02T23:20:54.409 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records out 2020-04-02T23:20:54.409 INFO:teuthology.orchestra.run.smithi196.stderr:512 bytes copied, 0.000191016 s, 2.7 MB/s 2020-04-02T23:20:54.411 INFO:tasks.ceph:osd dev map: {'osd.5': '/dev/vg_nvme/lv_3', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2'} 2020-04-02T23:20:54.433 DEBUG:teuthology.orchestra.remote:smithi174:/scratch_devs is 72B 2020-04-02T23:20:54.481 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2020-04-02T23:20:54.481 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:20:54.495 INFO:teuthology.orchestra.run.smithi174:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2020-04-02T23:20:54.550 INFO:teuthology.orchestra.run.smithi174.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-1 2020-04-02T23:20:54.550 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-04-02T23:20:54.550 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 6h/6d Inode: 59665 Links: 1 2020-04-02T23:20:54.550 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-04-02T23:20:54.550 INFO:teuthology.orchestra.run.smithi174.stdout:Context: system_u:object_r:device_t:s0 2020-04-02T23:20:54.550 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 2020-04-02 23:20:43.395779073 +0000 2020-04-02T23:20:54.551 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2020-04-02 23:19:03.288090227 +0000 2020-04-02T23:20:54.551 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2020-04-02 23:19:03.288090227 +0000 2020-04-02T23:20:54.551 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: - 2020-04-02T23:20:54.564 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records in 2020-04-02T23:20:54.564 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records out 2020-04-02T23:20:54.564 INFO:teuthology.orchestra.run.smithi174.stderr:512 bytes copied, 0.000219636 s, 2.3 MB/s 2020-04-02T23:20:54.567 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:20:54.621 INFO:teuthology.orchestra.run.smithi174:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2020-04-02T23:20:54.676 INFO:teuthology.orchestra.run.smithi174.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2020-04-02T23:20:54.676 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-04-02T23:20:54.676 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 6h/6d Inode: 59718 Links: 1 2020-04-02T23:20:54.676 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-04-02T23:20:54.676 INFO:teuthology.orchestra.run.smithi174.stdout:Context: system_u:object_r:device_t:s0 2020-04-02T23:20:54.677 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 2020-04-02 23:20:43.395779073 +0000 2020-04-02T23:20:54.677 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2020-04-02 23:19:03.651085174 +0000 2020-04-02T23:20:54.677 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2020-04-02 23:19:03.651085174 +0000 2020-04-02T23:20:54.677 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: - 2020-04-02T23:20:54.689 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records in 2020-04-02T23:20:54.690 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records out 2020-04-02T23:20:54.690 INFO:teuthology.orchestra.run.smithi174.stderr:512 bytes copied, 0.000188576 s, 2.7 MB/s 2020-04-02T23:20:54.692 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:20:54.746 INFO:teuthology.orchestra.run.smithi174:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2020-04-02T23:20:54.800 INFO:teuthology.orchestra.run.smithi174.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-3 2020-04-02T23:20:54.800 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-04-02T23:20:54.800 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 6h/6d Inode: 59771 Links: 1 2020-04-02T23:20:54.801 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-04-02T23:20:54.801 INFO:teuthology.orchestra.run.smithi174.stdout:Context: system_u:object_r:device_t:s0 2020-04-02T23:20:54.801 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 2020-04-02 23:20:43.395779073 +0000 2020-04-02T23:20:54.801 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2020-04-02 23:19:04.026079954 +0000 2020-04-02T23:20:54.801 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2020-04-02 23:19:04.026079954 +0000 2020-04-02T23:20:54.801 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: - 2020-04-02T23:20:54.813 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records in 2020-04-02T23:20:54.814 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records out 2020-04-02T23:20:54.814 INFO:teuthology.orchestra.run.smithi174.stderr:512 bytes copied, 0.000219213 s, 2.3 MB/s 2020-04-02T23:20:54.825 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:20:54.878 INFO:teuthology.orchestra.run.smithi174:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2020-04-02T23:20:54.932 INFO:teuthology.orchestra.run.smithi174.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-4 2020-04-02T23:20:54.932 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-04-02T23:20:54.932 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 6h/6d Inode: 61613 Links: 1 2020-04-02T23:20:54.932 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-04-02T23:20:54.932 INFO:teuthology.orchestra.run.smithi174.stdout:Context: system_u:object_r:device_t:s0 2020-04-02T23:20:54.933 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 2020-04-02 23:20:43.395779073 +0000 2020-04-02T23:20:54.933 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2020-04-02 23:19:04.398074775 +0000 2020-04-02T23:20:54.938 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2020-04-02 23:19:04.398074775 +0000 2020-04-02T23:20:54.938 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: - 2020-04-02T23:20:54.945 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records in 2020-04-02T23:20:54.945 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records out 2020-04-02T23:20:54.945 INFO:teuthology.orchestra.run.smithi174.stderr:512 bytes copied, 0.000226139 s, 2.3 MB/s 2020-04-02T23:20:54.947 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_3', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2'} 2020-04-02T23:20:54.947 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi196.front.sepia.ceph.com'): {'osd.5': '/dev/vg_nvme/lv_3', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi174.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_3', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2'}} 2020-04-02T23:20:54.948 INFO:tasks.ceph:Generating config... 2020-04-02T23:20:54.949 INFO:tasks.ceph:[mds] mds debug frag = True 2020-04-02T23:20:54.949 INFO:tasks.ceph:[mds] mds bal split bits = 3 2020-04-02T23:20:54.949 INFO:tasks.ceph:[mds] mds bal split size = 100 2020-04-02T23:20:54.949 INFO:tasks.ceph:[mds] mds inject traceless reply probability = 0.5 2020-04-02T23:20:54.949 INFO:tasks.ceph:[mds] debug mds = 20 2020-04-02T23:20:54.950 INFO:tasks.ceph:[mds] mds bal merge size = 5 2020-04-02T23:20:54.950 INFO:tasks.ceph:[mds] debug ms = 1 2020-04-02T23:20:54.950 INFO:tasks.ceph:[mds] mds bal frag = True 2020-04-02T23:20:54.950 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2020-04-02T23:20:54.950 INFO:tasks.ceph:[mds] mds op complaint time = 180 2020-04-02T23:20:54.950 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2020-04-02T23:20:54.951 INFO:tasks.ceph:[mds] osd op complaint time = 180 2020-04-02T23:20:54.951 INFO:tasks.ceph:[mds] mds verify scatter = True 2020-04-02T23:20:54.951 INFO:tasks.ceph:[client] debug ms = 1 2020-04-02T23:20:54.951 INFO:tasks.ceph:[client] debug client = 20 2020-04-02T23:20:54.951 INFO:tasks.ceph:[client] client mount timeout = 600 2020-04-02T23:20:54.951 INFO:tasks.ceph:[mon] debug mon = 20 2020-04-02T23:20:54.951 INFO:tasks.ceph:[mon] debug paxos = 20 2020-04-02T23:20:54.951 INFO:tasks.ceph:[mon] mon op complaint time = 120 2020-04-02T23:20:54.952 INFO:tasks.ceph:[mon] debug ms = 1 2020-04-02T23:20:54.952 INFO:tasks.ceph:[osd] debug ms = 1 2020-04-02T23:20:54.952 INFO:tasks.ceph:[osd] debug journal = 20 2020-04-02T23:20:54.952 INFO:tasks.ceph:[osd] debug osd = 25 2020-04-02T23:20:54.952 INFO:tasks.ceph:[osd] debug filestore = 20 2020-04-02T23:20:54.952 INFO:tasks.ceph:[osd] osd objectstore = filestore 2020-04-02T23:20:54.952 INFO:tasks.ceph:[osd] osd op complaint time = 180 2020-04-02T23:20:54.952 INFO:tasks.ceph:[osd] osd sloppy crc = True 2020-04-02T23:20:54.953 INFO:tasks.ceph:Setting up mon.a... 2020-04-02T23:20:54.953 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:20:55.006 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2020-04-02T23:20:55.117 INFO:teuthology.orchestra.run.smithi174.stdout:creating /etc/ceph/ceph.keyring 2020-04-02T23:20:55.119 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:20:55.132 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2020-04-02T23:20:55.220 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:20:55.273 INFO:teuthology.orchestra.run.smithi174:> sudo chmod 0644 /etc/ceph/ceph.keyring 2020-04-02T23:20:55.349 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.174'), ('mon.c', '[v2:172.21.15.196:3301,v1:172.21.15.196:6790]'), ('mon.b', '172.21.15.196')] 2020-04-02T23:20:55.349 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:20:55.402 INFO:teuthology.orchestra.run.smithi174:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool --create --clobber --enable-all-features --add a 172.21.15.174 --addv c '[v2:172.21.15.196:3301,v1:172.21.15.196:6790]' --add b 172.21.15.196 --print /home/ubuntu/cephtest/ceph.monmap 2020-04-02T23:20:55.478 INFO:teuthology.orchestra.run.smithi174.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2020-04-02T23:20:55.478 INFO:teuthology.orchestra.run.smithi174.stdout:monmaptool: generated fsid 06504ece-4284-40ba-b298-58864abc4224 2020-04-02T23:20:55.478 INFO:teuthology.orchestra.run.smithi174.stdout:epoch 0 2020-04-02T23:20:55.479 INFO:teuthology.orchestra.run.smithi174.stdout:fsid 06504ece-4284-40ba-b298-58864abc4224 2020-04-02T23:20:55.479 INFO:teuthology.orchestra.run.smithi174.stdout:last_changed 2020-04-02T23:20:55.477125+0000 2020-04-02T23:20:55.479 INFO:teuthology.orchestra.run.smithi174.stdout:created 2020-04-02T23:20:55.477125+0000 2020-04-02T23:20:55.479 INFO:teuthology.orchestra.run.smithi174.stdout:min_mon_release 0 (unknown) 2020-04-02T23:20:55.479 INFO:teuthology.orchestra.run.smithi174.stdout:0: [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] mon.a 2020-04-02T23:20:55.479 INFO:teuthology.orchestra.run.smithi174.stdout:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2020-04-02T23:20:55.479 INFO:teuthology.orchestra.run.smithi174.stdout:2: [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] mon.c 2020-04-02T23:20:55.480 INFO:teuthology.orchestra.run.smithi174.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2020-04-02T23:20:55.481 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 06504ece-4284-40ba-b298-58864abc4224... 2020-04-02T23:20:55.482 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:20:55.534 INFO:teuthology.orchestra.run.smithi174:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-04-02T23:20:55.575 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:20:55.591 INFO:teuthology.orchestra.run.smithi196:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-04-02T23:20:55.635 INFO:teuthology.orchestra.run.smithi174.stdout:[global] 2020-04-02T23:20:55.635 INFO:teuthology.orchestra.run.smithi174.stdout: chdir = "" 2020-04-02T23:20:55.635 INFO:teuthology.orchestra.run.smithi174.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-04-02T23:20:55.636 INFO:teuthology.orchestra.run.smithi174.stdout: auth supported = cephx 2020-04-02T23:20:55.636 INFO:teuthology.orchestra.run.smithi174.stdout: 2020-04-02T23:20:55.636 INFO:teuthology.orchestra.run.smithi174.stdout: filestore xattr use omap = true 2020-04-02T23:20:55.636 INFO:teuthology.orchestra.run.smithi174.stdout: 2020-04-02T23:20:55.636 INFO:teuthology.orchestra.run.smithi174.stdout: mon clock drift allowed = 1.000 2020-04-02T23:20:55.636 INFO:teuthology.orchestra.run.smithi174.stdout: 2020-04-02T23:20:55.636 INFO:teuthology.orchestra.run.smithi174.stdout: osd crush chooseleaf type = 0 2020-04-02T23:20:55.637 INFO:teuthology.orchestra.run.smithi174.stdout: auth debug = true 2020-04-02T23:20:55.637 INFO:teuthology.orchestra.run.smithi174.stdout: 2020-04-02T23:20:55.637 INFO:teuthology.orchestra.run.smithi174.stdout: ms die on old message = true 2020-04-02T23:20:55.637 INFO:teuthology.orchestra.run.smithi174.stdout: ms die on bug = true 2020-04-02T23:20:55.637 INFO:teuthology.orchestra.run.smithi174.stdout: 2020-04-02T23:20:55.637 INFO:teuthology.orchestra.run.smithi174.stdout: mon max pg per osd = 10000 # >= luminous 2020-04-02T23:20:55.637 INFO:teuthology.orchestra.run.smithi174.stdout: mon pg warn max object skew = 0 2020-04-02T23:20:55.638 INFO:teuthology.orchestra.run.smithi174.stdout: 2020-04-02T23:20:55.638 INFO:teuthology.orchestra.run.smithi174.stdout: # disable pg_autoscaler by default for new pools 2020-04-02T23:20:55.638 INFO:teuthology.orchestra.run.smithi174.stdout: osd_pool_default_pg_autoscale_mode = off 2020-04-02T23:20:55.638 INFO:teuthology.orchestra.run.smithi174.stdout: 2020-04-02T23:20:55.638 INFO:teuthology.orchestra.run.smithi174.stdout: osd pool default size = 2 2020-04-02T23:20:55.639 INFO:teuthology.orchestra.run.smithi174.stdout: 2020-04-02T23:20:55.639 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd allow primary affinity = true 2020-04-02T23:20:55.639 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd allow pg remap = true 2020-04-02T23:20:55.639 INFO:teuthology.orchestra.run.smithi174.stdout: mon warn on legacy crush tunables = false 2020-04-02T23:20:55.639 INFO:teuthology.orchestra.run.smithi174.stdout: mon warn on crush straw calc version zero = false 2020-04-02T23:20:55.639 INFO:teuthology.orchestra.run.smithi174.stdout: mon warn on no sortbitwise = false 2020-04-02T23:20:55.639 INFO:teuthology.orchestra.run.smithi174.stdout: mon warn on osd down out interval zero = false 2020-04-02T23:20:55.639 INFO:teuthology.orchestra.run.smithi174.stdout: mon warn on too few osds = false 2020-04-02T23:20:55.640 INFO:teuthology.orchestra.run.smithi174.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-04-02T23:20:55.640 INFO:teuthology.orchestra.run.smithi174.stdout: mon_warn_on_pool_no_redundancy = false 2020-04-02T23:20:55.640 INFO:teuthology.orchestra.run.smithi174.stdout: mon_allow_pool_size_one = true 2020-04-02T23:20:55.640 INFO:teuthology.orchestra.run.smithi174.stdout: 2020-04-02T23:20:55.640 INFO:teuthology.orchestra.run.smithi174.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-04-02T23:20:55.640 INFO:teuthology.orchestra.run.smithi174.stdout: 2020-04-02T23:20:55.641 INFO:teuthology.orchestra.run.smithi174.stdout: osd default data pool replay window = 5 2020-04-02T23:20:55.641 INFO:teuthology.orchestra.run.smithi174.stdout: 2020-04-02T23:20:55.641 INFO:teuthology.orchestra.run.smithi174.stdout: mon allow pool delete = true 2020-04-02T23:20:55.641 INFO:teuthology.orchestra.run.smithi174.stdout: 2020-04-02T23:20:55.641 INFO:teuthology.orchestra.run.smithi174.stdout: mon cluster log file level = debug 2020-04-02T23:20:55.641 INFO:teuthology.orchestra.run.smithi174.stdout: debug asserts on shutdown = true 2020-04-02T23:20:55.641 INFO:teuthology.orchestra.run.smithi174.stdout: mon host = "172.21.15.174,[v2:172.21.15.196:3301,v1:172.21.15.196:6790],172.21.15.196" 2020-04-02T23:20:55.642 INFO:teuthology.orchestra.run.smithi174.stdout: fsid = 06504ece-4284-40ba-b298-58864abc4224 2020-04-02T23:20:55.642 INFO:teuthology.orchestra.run.smithi174.stdout: 2020-04-02T23:20:55.642 INFO:teuthology.orchestra.run.smithi174.stdout:[osd] 2020-04-02T23:20:55.642 INFO:teuthology.orchestra.run.smithi174.stdout: osd journal size = 100 2020-04-02T23:20:55.642 INFO:teuthology.orchestra.run.smithi174.stdout: 2020-04-02T23:20:55.642 INFO:teuthology.orchestra.run.smithi174.stdout: osd scrub load threshold = 5.0 2020-04-02T23:20:55.642 INFO:teuthology.orchestra.run.smithi174.stdout: osd scrub max interval = 600 2020-04-02T23:20:55.642 INFO:teuthology.orchestra.run.smithi174.stdout: 2020-04-02T23:20:55.643 INFO:teuthology.orchestra.run.smithi174.stdout: osd recover clone overlap = true 2020-04-02T23:20:55.643 INFO:teuthology.orchestra.run.smithi174.stdout: osd recovery max chunk = 1048576 2020-04-02T23:20:55.643 INFO:teuthology.orchestra.run.smithi174.stdout: 2020-04-02T23:20:55.643 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug shutdown = true 2020-04-02T23:20:55.643 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug op order = true 2020-04-02T23:20:55.643 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug verify stray on activate = true 2020-04-02T23:20:55.643 INFO:teuthology.orchestra.run.smithi174.stdout: 2020-04-02T23:20:55.643 INFO:teuthology.orchestra.run.smithi174.stdout: osd open classes on start = true 2020-04-02T23:20:55.644 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug pg log writeout = true 2020-04-02T23:20:55.644 INFO:teuthology.orchestra.run.smithi174.stdout: 2020-04-02T23:20:55.644 INFO:teuthology.orchestra.run.smithi174.stdout: osd deep scrub update digest min age = 30 2020-04-02T23:20:55.644 INFO:teuthology.orchestra.run.smithi174.stdout: 2020-04-02T23:20:55.644 INFO:teuthology.orchestra.run.smithi174.stdout: osd map max advance = 10 2020-04-02T23:20:55.644 INFO:teuthology.orchestra.run.smithi174.stdout: 2020-04-02T23:20:55.645 INFO:teuthology.orchestra.run.smithi174.stdout: journal zero on create = true 2020-04-02T23:20:55.645 INFO:teuthology.orchestra.run.smithi174.stdout: 2020-04-02T23:20:55.645 INFO:teuthology.orchestra.run.smithi174.stdout: filestore ondisk finisher threads = 3 2020-04-02T23:20:55.645 INFO:teuthology.orchestra.run.smithi174.stdout: filestore apply finisher threads = 3 2020-04-02T23:20:55.645 INFO:teuthology.orchestra.run.smithi174.stdout: 2020-04-02T23:20:55.645 INFO:teuthology.orchestra.run.smithi174.stdout: bdev debug aio = true 2020-04-02T23:20:55.645 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug misdirected ops = true 2020-04-02T23:20:55.645 INFO:teuthology.orchestra.run.smithi174.stdout: debug ms = 1 2020-04-02T23:20:55.646 INFO:teuthology.orchestra.run.smithi174.stdout: debug journal = 20 2020-04-02T23:20:55.646 INFO:teuthology.orchestra.run.smithi174.stdout: debug osd = 25 2020-04-02T23:20:55.646 INFO:teuthology.orchestra.run.smithi174.stdout: debug filestore = 20 2020-04-02T23:20:55.646 INFO:teuthology.orchestra.run.smithi174.stdout: osd objectstore = filestore 2020-04-02T23:20:55.646 INFO:teuthology.orchestra.run.smithi174.stdout: osd op complaint time = 180 2020-04-02T23:20:55.646 INFO:teuthology.orchestra.run.smithi174.stdout: osd sloppy crc = True 2020-04-02T23:20:55.646 INFO:teuthology.orchestra.run.smithi174.stdout: 2020-04-02T23:20:55.647 INFO:teuthology.orchestra.run.smithi174.stdout:[mgr] 2020-04-02T23:20:55.647 INFO:teuthology.orchestra.run.smithi174.stdout: debug ms = 1 2020-04-02T23:20:55.647 INFO:teuthology.orchestra.run.smithi174.stdout: debug mgr = 20 2020-04-02T23:20:55.647 INFO:teuthology.orchestra.run.smithi174.stdout: debug mon = 20 2020-04-02T23:20:55.647 INFO:teuthology.orchestra.run.smithi174.stdout: debug auth = 20 2020-04-02T23:20:55.647 INFO:teuthology.orchestra.run.smithi174.stdout: mon reweight min pgs per osd = 4 2020-04-02T23:20:55.647 INFO:teuthology.orchestra.run.smithi174.stdout: mon reweight min bytes per osd = 10 2020-04-02T23:20:55.648 INFO:teuthology.orchestra.run.smithi174.stdout: mgr/telemetry/nag = false 2020-04-02T23:20:55.648 INFO:teuthology.orchestra.run.smithi174.stdout: 2020-04-02T23:20:55.648 INFO:teuthology.orchestra.run.smithi174.stdout:[mon] 2020-04-02T23:20:55.648 INFO:teuthology.orchestra.run.smithi174.stdout: debug ms = 1 2020-04-02T23:20:55.649 INFO:teuthology.orchestra.run.smithi174.stdout: debug mon = 20 2020-04-02T23:20:55.649 INFO:teuthology.orchestra.run.smithi174.stdout: debug paxos = 20 2020-04-02T23:20:55.649 INFO:teuthology.orchestra.run.smithi174.stdout: debug auth = 20 2020-04-02T23:20:55.649 INFO:teuthology.orchestra.run.smithi174.stdout: mon data avail warn = 5 2020-04-02T23:20:55.649 INFO:teuthology.orchestra.run.smithi174.stdout: mon mgr mkfs grace = 240 2020-04-02T23:20:55.649 INFO:teuthology.orchestra.run.smithi174.stdout: mon reweight min pgs per osd = 4 2020-04-02T23:20:55.649 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd reporter subtree level = osd 2020-04-02T23:20:55.650 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd prime pg temp = true 2020-04-02T23:20:55.650 INFO:teuthology.orchestra.run.smithi174.stdout: mon reweight min bytes per osd = 10 2020-04-02T23:20:55.650 INFO:teuthology.orchestra.run.smithi174.stdout: mon op complaint time = 120 2020-04-02T23:20:55.650 INFO:teuthology.orchestra.run.smithi174.stdout: 2020-04-02T23:20:55.650 INFO:teuthology.orchestra.run.smithi174.stdout:[client] 2020-04-02T23:20:55.650 INFO:teuthology.orchestra.run.smithi174.stdout: rgw cache enabled = true 2020-04-02T23:20:55.651 INFO:teuthology.orchestra.run.smithi174.stdout: rgw enable ops log = true 2020-04-02T23:20:55.651 INFO:teuthology.orchestra.run.smithi174.stdout: rgw enable usage log = true 2020-04-02T23:20:55.651 INFO:teuthology.orchestra.run.smithi174.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-04-02T23:20:55.651 INFO:teuthology.orchestra.run.smithi174.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-04-02T23:20:55.651 INFO:teuthology.orchestra.run.smithi174.stdout: debug ms = 1 2020-04-02T23:20:55.651 INFO:teuthology.orchestra.run.smithi174.stdout: debug client = 20 2020-04-02T23:20:55.651 INFO:teuthology.orchestra.run.smithi174.stdout: client mount timeout = 600 2020-04-02T23:20:55.651 INFO:teuthology.orchestra.run.smithi174.stdout:[mon.a] 2020-04-02T23:20:55.652 INFO:teuthology.orchestra.run.smithi174.stdout:[mon.c] 2020-04-02T23:20:55.652 INFO:teuthology.orchestra.run.smithi174.stdout:[mon.b] 2020-04-02T23:20:55.652 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.b] 2020-04-02T23:20:55.652 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.a] 2020-04-02T23:20:55.652 INFO:teuthology.orchestra.run.smithi174.stdout:[mds] 2020-04-02T23:20:55.653 INFO:teuthology.orchestra.run.smithi174.stdout: mds debug frag = True 2020-04-02T23:20:55.653 INFO:teuthology.orchestra.run.smithi174.stdout: mds bal split bits = 3 2020-04-02T23:20:55.653 INFO:teuthology.orchestra.run.smithi174.stdout: mds bal split size = 100 2020-04-02T23:20:55.653 INFO:teuthology.orchestra.run.smithi174.stdout: mds inject traceless reply probability = 0.5 2020-04-02T23:20:55.653 INFO:teuthology.orchestra.run.smithi174.stdout: debug mds = 20 2020-04-02T23:20:55.653 INFO:teuthology.orchestra.run.smithi174.stdout: mds bal merge size = 5 2020-04-02T23:20:55.653 INFO:teuthology.orchestra.run.smithi174.stdout: debug ms = 1 2020-04-02T23:20:55.654 INFO:teuthology.orchestra.run.smithi174.stdout: mds bal frag = True 2020-04-02T23:20:55.654 INFO:teuthology.orchestra.run.smithi174.stdout: mds bal fragment size max = 10000 2020-04-02T23:20:55.654 INFO:teuthology.orchestra.run.smithi174.stdout: mds op complaint time = 180 2020-04-02T23:20:55.654 INFO:teuthology.orchestra.run.smithi174.stdout: mds debug scatterstat = True 2020-04-02T23:20:55.654 INFO:teuthology.orchestra.run.smithi174.stdout: osd op complaint time = 180 2020-04-02T23:20:55.655 INFO:teuthology.orchestra.run.smithi174.stdout: mds verify scatter = True 2020-04-02T23:20:55.690 INFO:teuthology.orchestra.run.smithi196.stdout:[global] 2020-04-02T23:20:55.690 INFO:teuthology.orchestra.run.smithi196.stdout: chdir = "" 2020-04-02T23:20:55.690 INFO:teuthology.orchestra.run.smithi196.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-04-02T23:20:55.691 INFO:teuthology.orchestra.run.smithi196.stdout: auth supported = cephx 2020-04-02T23:20:55.691 INFO:teuthology.orchestra.run.smithi196.stdout: 2020-04-02T23:20:55.691 INFO:teuthology.orchestra.run.smithi196.stdout: filestore xattr use omap = true 2020-04-02T23:20:55.691 INFO:teuthology.orchestra.run.smithi196.stdout: 2020-04-02T23:20:55.691 INFO:teuthology.orchestra.run.smithi196.stdout: mon clock drift allowed = 1.000 2020-04-02T23:20:55.691 INFO:teuthology.orchestra.run.smithi196.stdout: 2020-04-02T23:20:55.691 INFO:teuthology.orchestra.run.smithi196.stdout: osd crush chooseleaf type = 0 2020-04-02T23:20:55.691 INFO:teuthology.orchestra.run.smithi196.stdout: auth debug = true 2020-04-02T23:20:55.692 INFO:teuthology.orchestra.run.smithi196.stdout: 2020-04-02T23:20:55.692 INFO:teuthology.orchestra.run.smithi196.stdout: ms die on old message = true 2020-04-02T23:20:55.692 INFO:teuthology.orchestra.run.smithi196.stdout: ms die on bug = true 2020-04-02T23:20:55.692 INFO:teuthology.orchestra.run.smithi196.stdout: 2020-04-02T23:20:55.692 INFO:teuthology.orchestra.run.smithi196.stdout: mon max pg per osd = 10000 # >= luminous 2020-04-02T23:20:55.692 INFO:teuthology.orchestra.run.smithi196.stdout: mon pg warn max object skew = 0 2020-04-02T23:20:55.692 INFO:teuthology.orchestra.run.smithi196.stdout: 2020-04-02T23:20:55.693 INFO:teuthology.orchestra.run.smithi196.stdout: # disable pg_autoscaler by default for new pools 2020-04-02T23:20:55.693 INFO:teuthology.orchestra.run.smithi196.stdout: osd_pool_default_pg_autoscale_mode = off 2020-04-02T23:20:55.693 INFO:teuthology.orchestra.run.smithi196.stdout: 2020-04-02T23:20:55.693 INFO:teuthology.orchestra.run.smithi196.stdout: osd pool default size = 2 2020-04-02T23:20:55.693 INFO:teuthology.orchestra.run.smithi196.stdout: 2020-04-02T23:20:55.693 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd allow primary affinity = true 2020-04-02T23:20:55.693 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd allow pg remap = true 2020-04-02T23:20:55.693 INFO:teuthology.orchestra.run.smithi196.stdout: mon warn on legacy crush tunables = false 2020-04-02T23:20:55.694 INFO:teuthology.orchestra.run.smithi196.stdout: mon warn on crush straw calc version zero = false 2020-04-02T23:20:55.694 INFO:teuthology.orchestra.run.smithi196.stdout: mon warn on no sortbitwise = false 2020-04-02T23:20:55.694 INFO:teuthology.orchestra.run.smithi196.stdout: mon warn on osd down out interval zero = false 2020-04-02T23:20:55.694 INFO:teuthology.orchestra.run.smithi196.stdout: mon warn on too few osds = false 2020-04-02T23:20:55.694 INFO:teuthology.orchestra.run.smithi196.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-04-02T23:20:55.694 INFO:teuthology.orchestra.run.smithi196.stdout: mon_warn_on_pool_no_redundancy = false 2020-04-02T23:20:55.694 INFO:teuthology.orchestra.run.smithi196.stdout: mon_allow_pool_size_one = true 2020-04-02T23:20:55.694 INFO:teuthology.orchestra.run.smithi196.stdout: 2020-04-02T23:20:55.695 INFO:teuthology.orchestra.run.smithi196.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-04-02T23:20:55.695 INFO:teuthology.orchestra.run.smithi196.stdout: 2020-04-02T23:20:55.695 INFO:teuthology.orchestra.run.smithi196.stdout: osd default data pool replay window = 5 2020-04-02T23:20:55.695 INFO:teuthology.orchestra.run.smithi196.stdout: 2020-04-02T23:20:55.695 INFO:teuthology.orchestra.run.smithi196.stdout: mon allow pool delete = true 2020-04-02T23:20:55.695 INFO:teuthology.orchestra.run.smithi196.stdout: 2020-04-02T23:20:55.695 INFO:teuthology.orchestra.run.smithi196.stdout: mon cluster log file level = debug 2020-04-02T23:20:55.696 INFO:teuthology.orchestra.run.smithi196.stdout: debug asserts on shutdown = true 2020-04-02T23:20:55.696 INFO:teuthology.orchestra.run.smithi196.stdout: mon host = "172.21.15.174,[v2:172.21.15.196:3301,v1:172.21.15.196:6790],172.21.15.196" 2020-04-02T23:20:55.696 INFO:teuthology.orchestra.run.smithi196.stdout: fsid = 06504ece-4284-40ba-b298-58864abc4224 2020-04-02T23:20:55.696 INFO:teuthology.orchestra.run.smithi196.stdout: 2020-04-02T23:20:55.696 INFO:teuthology.orchestra.run.smithi196.stdout:[osd] 2020-04-02T23:20:55.696 INFO:teuthology.orchestra.run.smithi196.stdout: osd journal size = 100 2020-04-02T23:20:55.696 INFO:teuthology.orchestra.run.smithi196.stdout: 2020-04-02T23:20:55.696 INFO:teuthology.orchestra.run.smithi196.stdout: osd scrub load threshold = 5.0 2020-04-02T23:20:55.697 INFO:teuthology.orchestra.run.smithi196.stdout: osd scrub max interval = 600 2020-04-02T23:20:55.697 INFO:teuthology.orchestra.run.smithi196.stdout: 2020-04-02T23:20:55.697 INFO:teuthology.orchestra.run.smithi196.stdout: osd recover clone overlap = true 2020-04-02T23:20:55.697 INFO:teuthology.orchestra.run.smithi196.stdout: osd recovery max chunk = 1048576 2020-04-02T23:20:55.697 INFO:teuthology.orchestra.run.smithi196.stdout: 2020-04-02T23:20:55.697 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug shutdown = true 2020-04-02T23:20:55.697 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug op order = true 2020-04-02T23:20:55.697 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug verify stray on activate = true 2020-04-02T23:20:55.698 INFO:teuthology.orchestra.run.smithi196.stdout: 2020-04-02T23:20:55.698 INFO:teuthology.orchestra.run.smithi196.stdout: osd open classes on start = true 2020-04-02T23:20:55.698 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug pg log writeout = true 2020-04-02T23:20:55.698 INFO:teuthology.orchestra.run.smithi196.stdout: 2020-04-02T23:20:55.698 INFO:teuthology.orchestra.run.smithi196.stdout: osd deep scrub update digest min age = 30 2020-04-02T23:20:55.698 INFO:teuthology.orchestra.run.smithi196.stdout: 2020-04-02T23:20:55.698 INFO:teuthology.orchestra.run.smithi196.stdout: osd map max advance = 10 2020-04-02T23:20:55.698 INFO:teuthology.orchestra.run.smithi196.stdout: 2020-04-02T23:20:55.699 INFO:teuthology.orchestra.run.smithi196.stdout: journal zero on create = true 2020-04-02T23:20:55.699 INFO:teuthology.orchestra.run.smithi196.stdout: 2020-04-02T23:20:55.699 INFO:teuthology.orchestra.run.smithi196.stdout: filestore ondisk finisher threads = 3 2020-04-02T23:20:55.699 INFO:teuthology.orchestra.run.smithi196.stdout: filestore apply finisher threads = 3 2020-04-02T23:20:55.699 INFO:teuthology.orchestra.run.smithi196.stdout: 2020-04-02T23:20:55.699 INFO:teuthology.orchestra.run.smithi196.stdout: bdev debug aio = true 2020-04-02T23:20:55.699 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug misdirected ops = true 2020-04-02T23:20:55.700 INFO:teuthology.orchestra.run.smithi196.stdout: debug ms = 1 2020-04-02T23:20:55.700 INFO:teuthology.orchestra.run.smithi196.stdout: debug journal = 20 2020-04-02T23:20:55.700 INFO:teuthology.orchestra.run.smithi196.stdout: debug osd = 25 2020-04-02T23:20:55.701 INFO:teuthology.orchestra.run.smithi196.stdout: debug filestore = 20 2020-04-02T23:20:55.701 INFO:teuthology.orchestra.run.smithi196.stdout: osd objectstore = filestore 2020-04-02T23:20:55.701 INFO:teuthology.orchestra.run.smithi196.stdout: osd op complaint time = 180 2020-04-02T23:20:55.701 INFO:teuthology.orchestra.run.smithi196.stdout: osd sloppy crc = True 2020-04-02T23:20:55.701 INFO:teuthology.orchestra.run.smithi196.stdout: 2020-04-02T23:20:55.701 INFO:teuthology.orchestra.run.smithi196.stdout:[mgr] 2020-04-02T23:20:55.701 INFO:teuthology.orchestra.run.smithi196.stdout: debug ms = 1 2020-04-02T23:20:55.701 INFO:teuthology.orchestra.run.smithi196.stdout: debug mgr = 20 2020-04-02T23:20:55.702 INFO:teuthology.orchestra.run.smithi196.stdout: debug mon = 20 2020-04-02T23:20:55.702 INFO:teuthology.orchestra.run.smithi196.stdout: debug auth = 20 2020-04-02T23:20:55.702 INFO:teuthology.orchestra.run.smithi196.stdout: mon reweight min pgs per osd = 4 2020-04-02T23:20:55.702 INFO:teuthology.orchestra.run.smithi196.stdout: mon reweight min bytes per osd = 10 2020-04-02T23:20:55.702 INFO:teuthology.orchestra.run.smithi196.stdout: mgr/telemetry/nag = false 2020-04-02T23:20:55.702 INFO:teuthology.orchestra.run.smithi196.stdout: 2020-04-02T23:20:55.702 INFO:teuthology.orchestra.run.smithi196.stdout:[mon] 2020-04-02T23:20:55.702 INFO:teuthology.orchestra.run.smithi196.stdout: debug ms = 1 2020-04-02T23:20:55.703 INFO:teuthology.orchestra.run.smithi196.stdout: debug mon = 20 2020-04-02T23:20:55.703 INFO:teuthology.orchestra.run.smithi196.stdout: debug paxos = 20 2020-04-02T23:20:55.703 INFO:teuthology.orchestra.run.smithi196.stdout: debug auth = 20 2020-04-02T23:20:55.703 INFO:teuthology.orchestra.run.smithi196.stdout: mon data avail warn = 5 2020-04-02T23:20:55.703 INFO:teuthology.orchestra.run.smithi196.stdout: mon mgr mkfs grace = 240 2020-04-02T23:20:55.703 INFO:teuthology.orchestra.run.smithi196.stdout: mon reweight min pgs per osd = 4 2020-04-02T23:20:55.703 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd reporter subtree level = osd 2020-04-02T23:20:55.703 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd prime pg temp = true 2020-04-02T23:20:55.704 INFO:teuthology.orchestra.run.smithi196.stdout: mon reweight min bytes per osd = 10 2020-04-02T23:20:55.704 INFO:teuthology.orchestra.run.smithi196.stdout: mon op complaint time = 120 2020-04-02T23:20:55.704 INFO:teuthology.orchestra.run.smithi196.stdout: 2020-04-02T23:20:55.704 INFO:teuthology.orchestra.run.smithi196.stdout:[client] 2020-04-02T23:20:55.704 INFO:teuthology.orchestra.run.smithi196.stdout: rgw cache enabled = true 2020-04-02T23:20:55.704 INFO:teuthology.orchestra.run.smithi196.stdout: rgw enable ops log = true 2020-04-02T23:20:55.704 INFO:teuthology.orchestra.run.smithi196.stdout: rgw enable usage log = true 2020-04-02T23:20:55.704 INFO:teuthology.orchestra.run.smithi196.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-04-02T23:20:55.705 INFO:teuthology.orchestra.run.smithi196.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-04-02T23:20:55.705 INFO:teuthology.orchestra.run.smithi196.stdout: debug ms = 1 2020-04-02T23:20:55.705 INFO:teuthology.orchestra.run.smithi196.stdout: debug client = 20 2020-04-02T23:20:55.705 INFO:teuthology.orchestra.run.smithi196.stdout: client mount timeout = 600 2020-04-02T23:20:55.705 INFO:teuthology.orchestra.run.smithi196.stdout:[mon.a] 2020-04-02T23:20:55.705 INFO:teuthology.orchestra.run.smithi196.stdout:[mon.c] 2020-04-02T23:20:55.705 INFO:teuthology.orchestra.run.smithi196.stdout:[mon.b] 2020-04-02T23:20:55.705 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.b] 2020-04-02T23:20:55.706 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.a] 2020-04-02T23:20:55.706 INFO:teuthology.orchestra.run.smithi196.stdout:[mds] 2020-04-02T23:20:55.706 INFO:teuthology.orchestra.run.smithi196.stdout: mds debug frag = True 2020-04-02T23:20:55.706 INFO:teuthology.orchestra.run.smithi196.stdout: mds bal split bits = 3 2020-04-02T23:20:55.706 INFO:teuthology.orchestra.run.smithi196.stdout: mds bal split size = 100 2020-04-02T23:20:55.706 INFO:teuthology.orchestra.run.smithi196.stdout: mds inject traceless reply probability = 0.5 2020-04-02T23:20:55.706 INFO:teuthology.orchestra.run.smithi196.stdout: debug mds = 20 2020-04-02T23:20:55.706 INFO:teuthology.orchestra.run.smithi196.stdout: mds bal merge size = 5 2020-04-02T23:20:55.707 INFO:teuthology.orchestra.run.smithi196.stdout: debug ms = 1 2020-04-02T23:20:55.707 INFO:teuthology.orchestra.run.smithi196.stdout: mds bal frag = True 2020-04-02T23:20:55.707 INFO:teuthology.orchestra.run.smithi196.stdout: mds bal fragment size max = 10000 2020-04-02T23:20:55.707 INFO:teuthology.orchestra.run.smithi196.stdout: mds op complaint time = 180 2020-04-02T23:20:55.707 INFO:teuthology.orchestra.run.smithi196.stdout: mds debug scatterstat = True 2020-04-02T23:20:55.707 INFO:teuthology.orchestra.run.smithi196.stdout: osd op complaint time = 180 2020-04-02T23:20:55.707 INFO:teuthology.orchestra.run.smithi196.stdout: mds verify scatter = True 2020-04-02T23:20:55.708 INFO:tasks.ceph:Creating admin key on mon.a... 2020-04-02T23:20:55.709 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:20:55.722 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2020-04-02T23:20:55.813 INFO:tasks.ceph:Copying monmap to all nodes... 2020-04-02T23:20:55.830 DEBUG:teuthology.orchestra.remote:smithi174:/etc/ceph/ceph.keyring is 206B 2020-04-02T23:20:55.925 DEBUG:teuthology.orchestra.remote:smithi174:/home/ubuntu/cephtest/ceph.monmap is 379B 2020-04-02T23:20:55.973 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi196.front.sepia.ceph.com 2020-04-02T23:20:55.973 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:20:55.988 INFO:teuthology.orchestra.run.smithi196:> sudo sh -c 'cat > /etc/ceph/ceph.keyring' && sudo chmod 0644 /etc/ceph/ceph.keyring 2020-04-02T23:20:56.087 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:20:56.142 INFO:teuthology.orchestra.run.smithi196:> cat > /home/ubuntu/cephtest/ceph.monmap 2020-04-02T23:20:56.230 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi174.front.sepia.ceph.com 2020-04-02T23:20:56.231 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:20:56.244 INFO:teuthology.orchestra.run.smithi174:> sudo sh -c 'cat > /etc/ceph/ceph.keyring' && sudo chmod 0644 /etc/ceph/ceph.keyring 2020-04-02T23:20:56.343 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:20:56.396 INFO:teuthology.orchestra.run.smithi174:> cat > /home/ubuntu/cephtest/ceph.monmap 2020-04-02T23:20:56.480 INFO:tasks.ceph:Setting up mon nodes... 2020-04-02T23:20:56.480 INFO:tasks.ceph:Setting up mgr nodes... 2020-04-02T23:20:56.480 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:20:56.498 INFO:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2020-04-02T23:20:56.650 INFO:teuthology.orchestra.run.smithi196.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2020-04-02T23:20:56.652 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:20:56.669 INFO:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2020-04-02T23:20:56.761 INFO:teuthology.orchestra.run.smithi174.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2020-04-02T23:20:56.763 INFO:tasks.ceph:Setting up mds nodes... 2020-04-02T23:20:56.764 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:20:56.779 INFO:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2020-04-02T23:20:56.874 INFO:teuthology.orchestra.run.smithi196.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2020-04-02T23:20:56.876 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:20:56.890 INFO:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2020-04-02T23:20:56.957 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:20:56.971 INFO:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2020-04-02T23:20:57.063 INFO:teuthology.orchestra.run.smithi174.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2020-04-02T23:20:57.065 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:20:57.078 INFO:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2020-04-02T23:20:57.145 INFO:tasks.ceph_client:Setting up client nodes... 2020-04-02T23:20:57.145 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:20:57.198 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2020-04-02T23:20:57.277 INFO:teuthology.orchestra.run.smithi174.stdout:creating /etc/ceph/ceph.client.0.keyring 2020-04-02T23:20:57.293 INFO:tasks.ceph:Running mkfs on osd nodes... 2020-04-02T23:20:57.293 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi196.front.sepia.ceph.com'): {'osd.5': '/dev/vg_nvme/lv_3', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi174.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_3', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2'}} 2020-04-02T23:20:57.293 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:20:57.320 INFO:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2020-04-02T23:20:57.389 INFO:tasks.ceph:roles_to_devs: {'osd.5': '/dev/vg_nvme/lv_3', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2'} 2020-04-02T23:20:57.389 INFO:tasks.ceph:role: osd.4 2020-04-02T23:20:57.389 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi196.front.sepia.ceph.com 2020-04-02T23:20:57.389 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:20:57.442 INFO:teuthology.orchestra.run.smithi196:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2020-04-02T23:20:57.979 INFO:teuthology.orchestra.run.smithi196.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2020-04-02T23:20:57.979 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 attr=2, projid32bit=1 2020-04-02T23:20:57.979 INFO:teuthology.orchestra.run.smithi196.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-04-02T23:20:57.979 INFO:teuthology.orchestra.run.smithi196.stdout: = reflink=1 2020-04-02T23:20:57.979 INFO:teuthology.orchestra.run.smithi196.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-04-02T23:20:57.980 INFO:teuthology.orchestra.run.smithi196.stdout: = sunit=0 swidth=0 blks 2020-04-02T23:20:57.981 INFO:teuthology.orchestra.run.smithi196.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-04-02T23:20:57.981 INFO:teuthology.orchestra.run.smithi196.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-04-02T23:20:57.981 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-04-02T23:20:57.981 INFO:teuthology.orchestra.run.smithi196.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-04-02T23:20:57.982 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi196.front.sepia.ceph.com -o noatime 2020-04-02T23:20:57.982 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:20:57.999 INFO:teuthology.orchestra.run.smithi196:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-4 2020-04-02T23:20:58.170 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:20:58.185 INFO:teuthology.orchestra.run.smithi196:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2020-04-02T23:20:58.256 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:20:58.309 INFO:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2020-04-02T23:20:58.375 INFO:tasks.ceph:roles_to_devs: {'osd.5': '/dev/vg_nvme/lv_3', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2'} 2020-04-02T23:20:58.375 INFO:tasks.ceph:role: osd.5 2020-04-02T23:20:58.375 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi196.front.sepia.ceph.com 2020-04-02T23:20:58.375 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:20:58.433 INFO:teuthology.orchestra.run.smithi196:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2020-04-02T23:20:58.958 INFO:teuthology.orchestra.run.smithi196.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2020-04-02T23:20:58.959 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 attr=2, projid32bit=1 2020-04-02T23:20:58.959 INFO:teuthology.orchestra.run.smithi196.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-04-02T23:20:58.959 INFO:teuthology.orchestra.run.smithi196.stdout: = reflink=1 2020-04-02T23:20:58.960 INFO:teuthology.orchestra.run.smithi196.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-04-02T23:20:58.960 INFO:teuthology.orchestra.run.smithi196.stdout: = sunit=0 swidth=0 blks 2020-04-02T23:20:58.960 INFO:teuthology.orchestra.run.smithi196.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-04-02T23:20:58.960 INFO:teuthology.orchestra.run.smithi196.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-04-02T23:20:58.960 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-04-02T23:20:58.960 INFO:teuthology.orchestra.run.smithi196.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-04-02T23:20:58.961 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi196.front.sepia.ceph.com -o noatime 2020-04-02T23:20:58.961 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:20:58.975 INFO:teuthology.orchestra.run.smithi196:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-5 2020-04-02T23:20:59.082 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:20:59.095 INFO:teuthology.orchestra.run.smithi196:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2020-04-02T23:20:59.165 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:20:59.219 INFO:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2020-04-02T23:20:59.288 INFO:tasks.ceph:roles_to_devs: {'osd.5': '/dev/vg_nvme/lv_3', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2'} 2020-04-02T23:20:59.289 INFO:tasks.ceph:role: osd.6 2020-04-02T23:20:59.289 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi196.front.sepia.ceph.com 2020-04-02T23:20:59.289 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:20:59.342 INFO:teuthology.orchestra.run.smithi196:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2020-04-02T23:20:59.892 INFO:teuthology.orchestra.run.smithi196.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2020-04-02T23:20:59.892 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 attr=2, projid32bit=1 2020-04-02T23:20:59.892 INFO:teuthology.orchestra.run.smithi196.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-04-02T23:20:59.892 INFO:teuthology.orchestra.run.smithi196.stdout: = reflink=1 2020-04-02T23:20:59.893 INFO:teuthology.orchestra.run.smithi196.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-04-02T23:20:59.893 INFO:teuthology.orchestra.run.smithi196.stdout: = sunit=0 swidth=0 blks 2020-04-02T23:20:59.893 INFO:teuthology.orchestra.run.smithi196.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-04-02T23:20:59.893 INFO:teuthology.orchestra.run.smithi196.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-04-02T23:20:59.893 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-04-02T23:20:59.893 INFO:teuthology.orchestra.run.smithi196.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-04-02T23:20:59.894 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi196.front.sepia.ceph.com -o noatime 2020-04-02T23:20:59.894 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:20:59.908 INFO:teuthology.orchestra.run.smithi196:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-6 2020-04-02T23:21:00.067 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:00.081 INFO:teuthology.orchestra.run.smithi196:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2020-04-02T23:21:00.151 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:00.205 INFO:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2020-04-02T23:21:00.272 INFO:tasks.ceph:roles_to_devs: {'osd.5': '/dev/vg_nvme/lv_3', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2'} 2020-04-02T23:21:00.273 INFO:tasks.ceph:role: osd.7 2020-04-02T23:21:00.273 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi196.front.sepia.ceph.com 2020-04-02T23:21:00.273 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:00.326 INFO:teuthology.orchestra.run.smithi196:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2020-04-02T23:21:00.830 INFO:teuthology.orchestra.run.smithi196.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2020-04-02T23:21:00.830 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 attr=2, projid32bit=1 2020-04-02T23:21:00.831 INFO:teuthology.orchestra.run.smithi196.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-04-02T23:21:00.831 INFO:teuthology.orchestra.run.smithi196.stdout: = reflink=1 2020-04-02T23:21:00.831 INFO:teuthology.orchestra.run.smithi196.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-04-02T23:21:00.831 INFO:teuthology.orchestra.run.smithi196.stdout: = sunit=0 swidth=0 blks 2020-04-02T23:21:00.831 INFO:teuthology.orchestra.run.smithi196.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-04-02T23:21:00.831 INFO:teuthology.orchestra.run.smithi196.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-04-02T23:21:00.831 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-04-02T23:21:00.832 INFO:teuthology.orchestra.run.smithi196.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-04-02T23:21:00.832 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi196.front.sepia.ceph.com -o noatime 2020-04-02T23:21:00.833 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:00.846 INFO:teuthology.orchestra.run.smithi196:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-7 2020-04-02T23:21:00.959 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:00.972 INFO:teuthology.orchestra.run.smithi196:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2020-04-02T23:21:01.041 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:01.095 INFO:teuthology.orchestra.run.smithi196:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-04-02T23:21:01.193 INFO:teuthology.orchestra.run.smithi196.stderr:2020-04-02T23:21:01.190+0000 7f869cb89ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2020-04-02T23:21:01.195 INFO:teuthology.orchestra.run.smithi196.stderr:2020-04-02T23:21:01.192+0000 7f869cb89ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2020-04-02T23:21:01.205 INFO:teuthology.orchestra.run.smithi196.stderr:2020-04-02T23:21:01.202+0000 7f869cb89ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-04-02T23:21:01.208 INFO:teuthology.orchestra.run.smithi196.stderr:2020-04-02T23:21:01.205+0000 7f869cb89ec0 -1 journal FileJournal::_open_file : zeroing journal 2020-04-02T23:21:01.450 INFO:teuthology.orchestra.run.smithi196.stderr:2020-04-02T23:21:01.447+0000 7f869cb89ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-04-02T23:21:01.452 INFO:teuthology.orchestra.run.smithi196.stderr:2020-04-02T23:21:01.450+0000 7f869cb89ec0 -1 journal do_read_entry(4096): bad header magic 2020-04-02T23:21:01.453 INFO:teuthology.orchestra.run.smithi196.stderr:2020-04-02T23:21:01.450+0000 7f869cb89ec0 -1 journal do_read_entry(4096): bad header magic 2020-04-02T23:21:01.472 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:01.486 INFO:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2020-04-02T23:21:01.552 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:01.605 INFO:teuthology.orchestra.run.smithi196:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-04-02T23:21:01.688 INFO:teuthology.orchestra.run.smithi196.stderr:2020-04-02T23:21:01.685+0000 7ff71b4ceec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2020-04-02T23:21:01.692 INFO:teuthology.orchestra.run.smithi196.stderr:2020-04-02T23:21:01.689+0000 7ff71b4ceec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2020-04-02T23:21:01.710 INFO:teuthology.orchestra.run.smithi196.stderr:2020-04-02T23:21:01.708+0000 7ff71b4ceec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-04-02T23:21:01.711 INFO:teuthology.orchestra.run.smithi196.stderr:2020-04-02T23:21:01.709+0000 7ff71b4ceec0 -1 journal FileJournal::_open_file : zeroing journal 2020-04-02T23:21:01.953 INFO:teuthology.orchestra.run.smithi196.stderr:2020-04-02T23:21:01.950+0000 7ff71b4ceec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-04-02T23:21:01.953 INFO:teuthology.orchestra.run.smithi196.stderr:2020-04-02T23:21:01.950+0000 7ff71b4ceec0 -1 journal do_read_entry(4096): bad header magic 2020-04-02T23:21:01.953 INFO:teuthology.orchestra.run.smithi196.stderr:2020-04-02T23:21:01.950+0000 7ff71b4ceec0 -1 journal do_read_entry(4096): bad header magic 2020-04-02T23:21:01.973 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:02.026 INFO:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2020-04-02T23:21:02.094 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:02.147 INFO:teuthology.orchestra.run.smithi196:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-04-02T23:21:02.230 INFO:teuthology.orchestra.run.smithi196.stderr:2020-04-02T23:21:02.227+0000 7f31d7cacec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2020-04-02T23:21:02.230 INFO:teuthology.orchestra.run.smithi196.stderr:2020-04-02T23:21:02.227+0000 7f31d7cacec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2020-04-02T23:21:02.235 INFO:teuthology.orchestra.run.smithi196.stderr:2020-04-02T23:21:02.233+0000 7f31d7cacec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-04-02T23:21:02.236 INFO:teuthology.orchestra.run.smithi196.stderr:2020-04-02T23:21:02.233+0000 7f31d7cacec0 -1 journal FileJournal::_open_file : zeroing journal 2020-04-02T23:21:02.374 INFO:teuthology.orchestra.run.smithi196.stderr:2020-04-02T23:21:02.372+0000 7f31d7cacec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-04-02T23:21:02.375 INFO:teuthology.orchestra.run.smithi196.stderr:2020-04-02T23:21:02.372+0000 7f31d7cacec0 -1 journal do_read_entry(4096): bad header magic 2020-04-02T23:21:02.375 INFO:teuthology.orchestra.run.smithi196.stderr:2020-04-02T23:21:02.372+0000 7f31d7cacec0 -1 journal do_read_entry(4096): bad header magic 2020-04-02T23:21:02.381 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:02.434 INFO:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2020-04-02T23:21:02.500 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:02.554 INFO:teuthology.orchestra.run.smithi196:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-04-02T23:21:02.637 INFO:teuthology.orchestra.run.smithi196.stderr:2020-04-02T23:21:02.634+0000 7fd2d3667ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2020-04-02T23:21:02.637 INFO:teuthology.orchestra.run.smithi196.stderr:2020-04-02T23:21:02.634+0000 7fd2d3667ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2020-04-02T23:21:02.641 INFO:teuthology.orchestra.run.smithi196.stderr:2020-04-02T23:21:02.638+0000 7fd2d3667ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-04-02T23:21:02.641 INFO:teuthology.orchestra.run.smithi196.stderr:2020-04-02T23:21:02.638+0000 7fd2d3667ec0 -1 journal FileJournal::_open_file : zeroing journal 2020-04-02T23:21:02.777 INFO:teuthology.orchestra.run.smithi196.stderr:2020-04-02T23:21:02.774+0000 7fd2d3667ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-04-02T23:21:02.777 INFO:teuthology.orchestra.run.smithi196.stderr:2020-04-02T23:21:02.774+0000 7fd2d3667ec0 -1 journal do_read_entry(4096): bad header magic 2020-04-02T23:21:02.778 INFO:teuthology.orchestra.run.smithi196.stderr:2020-04-02T23:21:02.774+0000 7fd2d3667ec0 -1 journal do_read_entry(4096): bad header magic 2020-04-02T23:21:02.786 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:02.840 INFO:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2020-04-02T23:21:02.907 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:02.923 INFO:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2020-04-02T23:21:02.995 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_3', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2'} 2020-04-02T23:21:02.995 INFO:tasks.ceph:role: osd.0 2020-04-02T23:21:02.995 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi174.front.sepia.ceph.com 2020-04-02T23:21:02.995 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:03.050 INFO:teuthology.orchestra.run.smithi174:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2020-04-02T23:21:03.608 INFO:teuthology.orchestra.run.smithi174.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2020-04-02T23:21:03.608 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 attr=2, projid32bit=1 2020-04-02T23:21:03.608 INFO:teuthology.orchestra.run.smithi174.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-04-02T23:21:03.608 INFO:teuthology.orchestra.run.smithi174.stdout: = reflink=1 2020-04-02T23:21:03.608 INFO:teuthology.orchestra.run.smithi174.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-04-02T23:21:03.609 INFO:teuthology.orchestra.run.smithi174.stdout: = sunit=0 swidth=0 blks 2020-04-02T23:21:03.609 INFO:teuthology.orchestra.run.smithi174.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-04-02T23:21:03.609 INFO:teuthology.orchestra.run.smithi174.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-04-02T23:21:03.609 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-04-02T23:21:03.609 INFO:teuthology.orchestra.run.smithi174.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-04-02T23:21:03.610 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi174.front.sepia.ceph.com -o noatime 2020-04-02T23:21:03.610 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:03.627 INFO:teuthology.orchestra.run.smithi174:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0 2020-04-02T23:21:03.792 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:03.807 INFO:teuthology.orchestra.run.smithi174:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2020-04-02T23:21:03.880 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:03.934 INFO:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2020-04-02T23:21:04.003 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_3', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2'} 2020-04-02T23:21:04.003 INFO:tasks.ceph:role: osd.1 2020-04-02T23:21:04.003 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi174.front.sepia.ceph.com 2020-04-02T23:21:04.004 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:04.057 INFO:teuthology.orchestra.run.smithi174:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2020-04-02T23:21:04.613 INFO:teuthology.orchestra.run.smithi174.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2020-04-02T23:21:04.614 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 attr=2, projid32bit=1 2020-04-02T23:21:04.614 INFO:teuthology.orchestra.run.smithi174.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-04-02T23:21:04.614 INFO:teuthology.orchestra.run.smithi174.stdout: = reflink=1 2020-04-02T23:21:04.614 INFO:teuthology.orchestra.run.smithi174.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-04-02T23:21:04.615 INFO:teuthology.orchestra.run.smithi174.stdout: = sunit=0 swidth=0 blks 2020-04-02T23:21:04.615 INFO:teuthology.orchestra.run.smithi174.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-04-02T23:21:04.615 INFO:teuthology.orchestra.run.smithi174.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-04-02T23:21:04.615 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-04-02T23:21:04.616 INFO:teuthology.orchestra.run.smithi174.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-04-02T23:21:04.617 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi174.front.sepia.ceph.com -o noatime 2020-04-02T23:21:04.617 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:04.632 INFO:teuthology.orchestra.run.smithi174:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-1 2020-04-02T23:21:04.743 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:04.773 INFO:teuthology.orchestra.run.smithi174:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2020-04-02T23:21:04.842 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:04.895 INFO:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2020-04-02T23:21:04.962 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_3', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2'} 2020-04-02T23:21:04.962 INFO:tasks.ceph:role: osd.2 2020-04-02T23:21:04.962 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi174.front.sepia.ceph.com 2020-04-02T23:21:04.963 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:05.015 INFO:teuthology.orchestra.run.smithi174:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2020-04-02T23:21:05.560 INFO:teuthology.orchestra.run.smithi174.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2020-04-02T23:21:05.560 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 attr=2, projid32bit=1 2020-04-02T23:21:05.560 INFO:teuthology.orchestra.run.smithi174.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-04-02T23:21:05.561 INFO:teuthology.orchestra.run.smithi174.stdout: = reflink=1 2020-04-02T23:21:05.561 INFO:teuthology.orchestra.run.smithi174.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-04-02T23:21:05.561 INFO:teuthology.orchestra.run.smithi174.stdout: = sunit=0 swidth=0 blks 2020-04-02T23:21:05.561 INFO:teuthology.orchestra.run.smithi174.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-04-02T23:21:05.561 INFO:teuthology.orchestra.run.smithi174.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-04-02T23:21:05.562 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-04-02T23:21:05.562 INFO:teuthology.orchestra.run.smithi174.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-04-02T23:21:05.564 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi174.front.sepia.ceph.com -o noatime 2020-04-02T23:21:05.564 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:05.581 INFO:teuthology.orchestra.run.smithi174:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2020-04-02T23:21:05.748 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:05.762 INFO:teuthology.orchestra.run.smithi174:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2020-04-02T23:21:05.835 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:05.889 INFO:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2020-04-02T23:21:05.957 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_3', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2'} 2020-04-02T23:21:05.958 INFO:tasks.ceph:role: osd.3 2020-04-02T23:21:05.958 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi174.front.sepia.ceph.com 2020-04-02T23:21:05.958 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:06.011 INFO:teuthology.orchestra.run.smithi174:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2020-04-02T23:21:06.551 INFO:teuthology.orchestra.run.smithi174.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2020-04-02T23:21:06.552 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 attr=2, projid32bit=1 2020-04-02T23:21:06.552 INFO:teuthology.orchestra.run.smithi174.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-04-02T23:21:06.552 INFO:teuthology.orchestra.run.smithi174.stdout: = reflink=1 2020-04-02T23:21:06.552 INFO:teuthology.orchestra.run.smithi174.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-04-02T23:21:06.552 INFO:teuthology.orchestra.run.smithi174.stdout: = sunit=0 swidth=0 blks 2020-04-02T23:21:06.552 INFO:teuthology.orchestra.run.smithi174.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-04-02T23:21:06.553 INFO:teuthology.orchestra.run.smithi174.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-04-02T23:21:06.553 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-04-02T23:21:06.553 INFO:teuthology.orchestra.run.smithi174.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-04-02T23:21:06.556 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi174.front.sepia.ceph.com -o noatime 2020-04-02T23:21:06.557 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:06.572 INFO:teuthology.orchestra.run.smithi174:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3 2020-04-02T23:21:06.700 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:06.722 INFO:teuthology.orchestra.run.smithi174:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2020-04-02T23:21:06.795 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:06.850 INFO:teuthology.orchestra.run.smithi174:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-04-02T23:21:07.335 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:07.333+0000 7f11527dcec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2020-04-02T23:21:07.336 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:07.334+0000 7f11527dcec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2020-04-02T23:21:07.365 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:07.362+0000 7f11527dcec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-04-02T23:21:07.366 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:07.364+0000 7f11527dcec0 -1 journal FileJournal::_open_file : zeroing journal 2020-04-02T23:21:07.595 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:07.593+0000 7f11527dcec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-04-02T23:21:07.597 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:07.595+0000 7f11527dcec0 -1 journal do_read_entry(4096): bad header magic 2020-04-02T23:21:07.597 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:07.595+0000 7f11527dcec0 -1 journal do_read_entry(4096): bad header magic 2020-04-02T23:21:07.612 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:07.627 INFO:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2020-04-02T23:21:07.696 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:07.750 INFO:teuthology.orchestra.run.smithi174:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-04-02T23:21:07.835 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:07.833+0000 7f912efb9ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2020-04-02T23:21:07.835 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:07.833+0000 7f912efb9ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2020-04-02T23:21:07.839 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:07.837+0000 7f912efb9ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-04-02T23:21:07.840 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:07.837+0000 7f912efb9ec0 -1 journal FileJournal::_open_file : zeroing journal 2020-04-02T23:21:07.986 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:07.983+0000 7f912efb9ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-04-02T23:21:07.986 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:07.983+0000 7f912efb9ec0 -1 journal do_read_entry(4096): bad header magic 2020-04-02T23:21:07.986 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:07.983+0000 7f912efb9ec0 -1 journal do_read_entry(4096): bad header magic 2020-04-02T23:21:07.993 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:08.046 INFO:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2020-04-02T23:21:08.113 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:08.166 INFO:teuthology.orchestra.run.smithi174:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-04-02T23:21:08.249 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:08.246+0000 7fd0d9fb1ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2020-04-02T23:21:08.249 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:08.246+0000 7fd0d9fb1ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2020-04-02T23:21:08.253 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:08.250+0000 7fd0d9fb1ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-04-02T23:21:08.253 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:08.250+0000 7fd0d9fb1ec0 -1 journal FileJournal::_open_file : zeroing journal 2020-04-02T23:21:08.387 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:08.384+0000 7fd0d9fb1ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-04-02T23:21:08.387 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:08.384+0000 7fd0d9fb1ec0 -1 journal do_read_entry(4096): bad header magic 2020-04-02T23:21:08.387 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:08.384+0000 7fd0d9fb1ec0 -1 journal do_read_entry(4096): bad header magic 2020-04-02T23:21:08.394 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:08.448 INFO:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2020-04-02T23:21:08.515 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:08.568 INFO:teuthology.orchestra.run.smithi174:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-04-02T23:21:08.651 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:08.649+0000 7f45a6a77ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2020-04-02T23:21:08.651 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:08.649+0000 7f45a6a77ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2020-04-02T23:21:08.656 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:08.653+0000 7f45a6a77ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-04-02T23:21:08.657 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:08.653+0000 7f45a6a77ec0 -1 journal FileJournal::_open_file : zeroing journal 2020-04-02T23:21:08.771 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:08.769+0000 7f45a6a77ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-04-02T23:21:08.774 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:08.771+0000 7f45a6a77ec0 -1 journal do_read_entry(4096): bad header magic 2020-04-02T23:21:08.774 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:08.771+0000 7f45a6a77ec0 -1 journal do_read_entry(4096): bad header magic 2020-04-02T23:21:08.783 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:08.837 INFO:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2020-04-02T23:21:08.903 INFO:tasks.ceph:Reading keys from all nodes... 2020-04-02T23:21:08.903 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:08.920 INFO:teuthology.orchestra.run.smithi196:> mktemp 2020-04-02T23:21:08.976 INFO:teuthology.orchestra.run.smithi196.stdout:/tmp/tmp.1M72Bmi80T 2020-04-02T23:21:08.976 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:09.032 INFO:teuthology.orchestra.run.smithi196:> sudo cp /var/lib/ceph/mgr/ceph-x/keyring /tmp/tmp.1M72Bmi80T 2020-04-02T23:21:09.103 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:09.159 INFO:teuthology.orchestra.run.smithi196:> sudo chmod 0666 /tmp/tmp.1M72Bmi80T 2020-04-02T23:21:09.286 DEBUG:teuthology.orchestra.remote:smithi196:/tmp/tmp.1M72Bmi80T is 56B 2020-04-02T23:21:09.334 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:09.348 INFO:teuthology.orchestra.run.smithi196:> rm -fr /tmp/tmp.1M72Bmi80T 2020-04-02T23:21:09.402 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:09.457 INFO:teuthology.orchestra.run.smithi196:> mktemp 2020-04-02T23:21:09.525 INFO:teuthology.orchestra.run.smithi196.stdout:/tmp/tmp.WpFJYIDjPo 2020-04-02T23:21:09.526 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:09.582 INFO:teuthology.orchestra.run.smithi196:> sudo cp /var/lib/ceph/mds/ceph-b/keyring /tmp/tmp.WpFJYIDjPo 2020-04-02T23:21:09.651 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:09.706 INFO:teuthology.orchestra.run.smithi196:> sudo chmod 0666 /tmp/tmp.WpFJYIDjPo 2020-04-02T23:21:09.829 DEBUG:teuthology.orchestra.remote:smithi196:/tmp/tmp.WpFJYIDjPo is 56B 2020-04-02T23:21:09.879 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:09.892 INFO:teuthology.orchestra.run.smithi196:> rm -fr /tmp/tmp.WpFJYIDjPo 2020-04-02T23:21:09.945 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:09.999 INFO:teuthology.orchestra.run.smithi196:> mktemp 2020-04-02T23:21:10.059 INFO:teuthology.orchestra.run.smithi196.stdout:/tmp/tmp.GIkqSYuqvk 2020-04-02T23:21:10.059 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:10.112 INFO:teuthology.orchestra.run.smithi196:> sudo cp /var/lib/ceph/osd/ceph-4/keyring /tmp/tmp.GIkqSYuqvk 2020-04-02T23:21:10.180 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:10.233 INFO:teuthology.orchestra.run.smithi196:> sudo chmod 0666 /tmp/tmp.GIkqSYuqvk 2020-04-02T23:21:10.357 DEBUG:teuthology.orchestra.remote:smithi196:/tmp/tmp.GIkqSYuqvk is 56B 2020-04-02T23:21:10.405 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:10.417 INFO:teuthology.orchestra.run.smithi196:> rm -fr /tmp/tmp.GIkqSYuqvk 2020-04-02T23:21:10.472 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:10.525 INFO:teuthology.orchestra.run.smithi196:> mktemp 2020-04-02T23:21:10.579 INFO:teuthology.orchestra.run.smithi196.stdout:/tmp/tmp.VKg4Xv1WTB 2020-04-02T23:21:10.580 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:10.632 INFO:teuthology.orchestra.run.smithi196:> sudo cp /var/lib/ceph/osd/ceph-5/keyring /tmp/tmp.VKg4Xv1WTB 2020-04-02T23:21:10.699 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:10.752 INFO:teuthology.orchestra.run.smithi196:> sudo chmod 0666 /tmp/tmp.VKg4Xv1WTB 2020-04-02T23:21:10.876 DEBUG:teuthology.orchestra.remote:smithi196:/tmp/tmp.VKg4Xv1WTB is 56B 2020-04-02T23:21:10.924 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:10.937 INFO:teuthology.orchestra.run.smithi196:> rm -fr /tmp/tmp.VKg4Xv1WTB 2020-04-02T23:21:10.990 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:11.043 INFO:teuthology.orchestra.run.smithi196:> mktemp 2020-04-02T23:21:11.098 INFO:teuthology.orchestra.run.smithi196.stdout:/tmp/tmp.iecJq7gJti 2020-04-02T23:21:11.098 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:11.151 INFO:teuthology.orchestra.run.smithi196:> sudo cp /var/lib/ceph/osd/ceph-6/keyring /tmp/tmp.iecJq7gJti 2020-04-02T23:21:11.217 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:11.281 INFO:teuthology.orchestra.run.smithi196:> sudo chmod 0666 /tmp/tmp.iecJq7gJti 2020-04-02T23:21:11.406 DEBUG:teuthology.orchestra.remote:smithi196:/tmp/tmp.iecJq7gJti is 56B 2020-04-02T23:21:11.459 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:11.473 INFO:teuthology.orchestra.run.smithi196:> rm -fr /tmp/tmp.iecJq7gJti 2020-04-02T23:21:11.525 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:11.578 INFO:teuthology.orchestra.run.smithi196:> mktemp 2020-04-02T23:21:11.631 INFO:teuthology.orchestra.run.smithi196.stdout:/tmp/tmp.JD1z0ybA11 2020-04-02T23:21:11.631 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:11.685 INFO:teuthology.orchestra.run.smithi196:> sudo cp /var/lib/ceph/osd/ceph-7/keyring /tmp/tmp.JD1z0ybA11 2020-04-02T23:21:11.805 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:11.818 INFO:teuthology.orchestra.run.smithi196:> sudo chmod 0666 /tmp/tmp.JD1z0ybA11 2020-04-02T23:21:11.949 DEBUG:teuthology.orchestra.remote:smithi196:/tmp/tmp.JD1z0ybA11 is 56B 2020-04-02T23:21:12.024 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:12.037 INFO:teuthology.orchestra.run.smithi196:> rm -fr /tmp/tmp.JD1z0ybA11 2020-04-02T23:21:12.094 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:12.110 INFO:teuthology.orchestra.run.smithi174:> mktemp 2020-04-02T23:21:12.167 INFO:teuthology.orchestra.run.smithi174.stdout:/tmp/tmp.op6EgorEqt 2020-04-02T23:21:12.168 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:12.227 INFO:teuthology.orchestra.run.smithi174:> sudo cp /var/lib/ceph/mgr/ceph-y/keyring /tmp/tmp.op6EgorEqt 2020-04-02T23:21:12.300 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:12.360 INFO:teuthology.orchestra.run.smithi174:> sudo chmod 0666 /tmp/tmp.op6EgorEqt 2020-04-02T23:21:12.494 DEBUG:teuthology.orchestra.remote:smithi174:/tmp/tmp.op6EgorEqt is 56B 2020-04-02T23:21:12.542 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:12.562 INFO:teuthology.orchestra.run.smithi174:> rm -fr /tmp/tmp.op6EgorEqt 2020-04-02T23:21:12.611 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:12.665 INFO:teuthology.orchestra.run.smithi174:> mktemp 2020-04-02T23:21:12.721 INFO:teuthology.orchestra.run.smithi174.stdout:/tmp/tmp.CgtvwnMkrB 2020-04-02T23:21:12.722 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:12.775 INFO:teuthology.orchestra.run.smithi174:> sudo cp /var/lib/ceph/mds/ceph-a/keyring /tmp/tmp.CgtvwnMkrB 2020-04-02T23:21:12.891 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:12.909 INFO:teuthology.orchestra.run.smithi174:> sudo chmod 0666 /tmp/tmp.CgtvwnMkrB 2020-04-02T23:21:13.039 DEBUG:teuthology.orchestra.remote:smithi174:/tmp/tmp.CgtvwnMkrB is 56B 2020-04-02T23:21:13.113 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:13.127 INFO:teuthology.orchestra.run.smithi174:> rm -fr /tmp/tmp.CgtvwnMkrB 2020-04-02T23:21:13.180 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:13.233 INFO:teuthology.orchestra.run.smithi174:> mktemp 2020-04-02T23:21:13.287 INFO:teuthology.orchestra.run.smithi174.stdout:/tmp/tmp.YUeMSBnGPb 2020-04-02T23:21:13.288 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:13.342 INFO:teuthology.orchestra.run.smithi174:> sudo cp /var/lib/ceph/osd/ceph-0/keyring /tmp/tmp.YUeMSBnGPb 2020-04-02T23:21:13.410 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:13.463 INFO:teuthology.orchestra.run.smithi174:> sudo chmod 0666 /tmp/tmp.YUeMSBnGPb 2020-04-02T23:21:13.588 DEBUG:teuthology.orchestra.remote:smithi174:/tmp/tmp.YUeMSBnGPb is 56B 2020-04-02T23:21:13.638 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:13.651 INFO:teuthology.orchestra.run.smithi174:> rm -fr /tmp/tmp.YUeMSBnGPb 2020-04-02T23:21:13.704 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:13.758 INFO:teuthology.orchestra.run.smithi174:> mktemp 2020-04-02T23:21:13.811 INFO:teuthology.orchestra.run.smithi174.stdout:/tmp/tmp.SK6EmKmpqj 2020-04-02T23:21:13.812 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:13.864 INFO:teuthology.orchestra.run.smithi174:> sudo cp /var/lib/ceph/osd/ceph-1/keyring /tmp/tmp.SK6EmKmpqj 2020-04-02T23:21:13.935 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:13.989 INFO:teuthology.orchestra.run.smithi174:> sudo chmod 0666 /tmp/tmp.SK6EmKmpqj 2020-04-02T23:21:14.117 DEBUG:teuthology.orchestra.remote:smithi174:/tmp/tmp.SK6EmKmpqj is 56B 2020-04-02T23:21:14.175 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:14.188 INFO:teuthology.orchestra.run.smithi174:> rm -fr /tmp/tmp.SK6EmKmpqj 2020-04-02T23:21:14.246 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:14.298 INFO:teuthology.orchestra.run.smithi174:> mktemp 2020-04-02T23:21:14.351 INFO:teuthology.orchestra.run.smithi174.stdout:/tmp/tmp.rHsx0qjJ0P 2020-04-02T23:21:14.351 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:14.404 INFO:teuthology.orchestra.run.smithi174:> sudo cp /var/lib/ceph/osd/ceph-2/keyring /tmp/tmp.rHsx0qjJ0P 2020-04-02T23:21:14.475 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:14.528 INFO:teuthology.orchestra.run.smithi174:> sudo chmod 0666 /tmp/tmp.rHsx0qjJ0P 2020-04-02T23:21:14.652 DEBUG:teuthology.orchestra.remote:smithi174:/tmp/tmp.rHsx0qjJ0P is 56B 2020-04-02T23:21:14.703 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:14.716 INFO:teuthology.orchestra.run.smithi174:> rm -fr /tmp/tmp.rHsx0qjJ0P 2020-04-02T23:21:14.769 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:14.822 INFO:teuthology.orchestra.run.smithi174:> mktemp 2020-04-02T23:21:14.877 INFO:teuthology.orchestra.run.smithi174.stdout:/tmp/tmp.RjJmsG5IA6 2020-04-02T23:21:14.878 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:14.930 INFO:teuthology.orchestra.run.smithi174:> sudo cp /var/lib/ceph/osd/ceph-3/keyring /tmp/tmp.RjJmsG5IA6 2020-04-02T23:21:14.997 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:15.051 INFO:teuthology.orchestra.run.smithi174:> sudo chmod 0666 /tmp/tmp.RjJmsG5IA6 2020-04-02T23:21:15.174 DEBUG:teuthology.orchestra.remote:smithi174:/tmp/tmp.RjJmsG5IA6 is 56B 2020-04-02T23:21:15.221 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:15.234 INFO:teuthology.orchestra.run.smithi174:> rm -fr /tmp/tmp.RjJmsG5IA6 2020-04-02T23:21:15.344 DEBUG:teuthology.orchestra.remote:smithi174:/etc/ceph/ceph.client.0.keyring is 59B 2020-04-02T23:21:15.393 INFO:tasks.ceph:Adding keys to all mons... 2020-04-02T23:21:15.393 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:15.406 INFO:teuthology.orchestra.run.smithi174:> sudo tee -a /etc/ceph/ceph.keyring 2020-04-02T23:21:15.447 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:15.464 INFO:teuthology.orchestra.run.smithi196:> sudo tee -a /etc/ceph/ceph.keyring 2020-04-02T23:21:15.507 INFO:teuthology.orchestra.run.smithi174.stdout:[mgr.x] 2020-04-02T23:21:15.507 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQBYc4ZeDcqxJhAAQAlHrfSGoh9TZq6cYr4IqQ== 2020-04-02T23:21:15.507 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.b] 2020-04-02T23:21:15.507 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQBYc4ZefYMKNBAAzUBa7LV3jCJiOmI/NpiYPw== 2020-04-02T23:21:15.507 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.4] 2020-04-02T23:21:15.508 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQBdc4ZeoL5sCxAA7H8/FufYzYo2aZXTidnNfw== 2020-04-02T23:21:15.508 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.5] 2020-04-02T23:21:15.508 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQBdc4ZeHez0KBAAO/hPb5DQxVGscdASB55XVg== 2020-04-02T23:21:15.508 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.6] 2020-04-02T23:21:15.508 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQBec4ZeMT6hDRAAtSq11rHmp8oKQq5sXoURFg== 2020-04-02T23:21:15.508 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.7] 2020-04-02T23:21:15.508 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQBec4Ze8JviJRAA8ox+0B9enHtbc7gfXypUbQ== 2020-04-02T23:21:15.508 INFO:teuthology.orchestra.run.smithi174.stdout:[mgr.y] 2020-04-02T23:21:15.509 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQBYc4ZeDJNWLRAAEVDAFNFL4FVB8RGKMy7t3g== 2020-04-02T23:21:15.509 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.a] 2020-04-02T23:21:15.509 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQBZc4ZejZm8AxAARBpT1XfwxG7STuc4vXgFkA== 2020-04-02T23:21:15.509 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.0] 2020-04-02T23:21:15.509 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQBjc4ZeN27xExAAvEMOPaGcR8YqDjKOfOf8jA== 2020-04-02T23:21:15.509 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.1] 2020-04-02T23:21:15.509 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQBjc4Zef2S4MRAAAflagmCbXHslyyzxNwQvSw== 2020-04-02T23:21:15.510 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.2] 2020-04-02T23:21:15.510 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQBkc4ZeyNnFDhAA56wqexCKV9yTpD6ymjO+9g== 2020-04-02T23:21:15.510 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.3] 2020-04-02T23:21:15.510 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQBkc4Zev9fBJhAA7CfA5ZURgcMFKnAqHOHsMw== 2020-04-02T23:21:15.513 INFO:teuthology.orchestra.run.smithi174.stdout:[client.0] 2020-04-02T23:21:15.513 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQBZc4ZeZRt4EBAAqfO2bEAqZJFV7yvD0AVtoQ== 2020-04-02T23:21:15.533 INFO:teuthology.orchestra.run.smithi196.stdout:[mgr.x] 2020-04-02T23:21:15.533 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQBYc4ZeDcqxJhAAQAlHrfSGoh9TZq6cYr4IqQ== 2020-04-02T23:21:15.533 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.b] 2020-04-02T23:21:15.534 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQBYc4ZefYMKNBAAzUBa7LV3jCJiOmI/NpiYPw== 2020-04-02T23:21:15.534 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.4] 2020-04-02T23:21:15.534 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQBdc4ZeoL5sCxAA7H8/FufYzYo2aZXTidnNfw== 2020-04-02T23:21:15.534 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.5] 2020-04-02T23:21:15.535 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQBdc4ZeHez0KBAAO/hPb5DQxVGscdASB55XVg== 2020-04-02T23:21:15.535 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.6] 2020-04-02T23:21:15.535 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQBec4ZeMT6hDRAAtSq11rHmp8oKQq5sXoURFg== 2020-04-02T23:21:15.535 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.7] 2020-04-02T23:21:15.536 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQBec4Ze8JviJRAA8ox+0B9enHtbc7gfXypUbQ== 2020-04-02T23:21:15.536 INFO:teuthology.orchestra.run.smithi196.stdout:[mgr.y] 2020-04-02T23:21:15.536 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQBYc4ZeDJNWLRAAEVDAFNFL4FVB8RGKMy7t3g== 2020-04-02T23:21:15.536 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.a] 2020-04-02T23:21:15.537 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQBZc4ZejZm8AxAARBpT1XfwxG7STuc4vXgFkA== 2020-04-02T23:21:15.537 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.0] 2020-04-02T23:21:15.537 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQBjc4ZeN27xExAAvEMOPaGcR8YqDjKOfOf8jA== 2020-04-02T23:21:15.537 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.1] 2020-04-02T23:21:15.537 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQBjc4Zef2S4MRAAAflagmCbXHslyyzxNwQvSw== 2020-04-02T23:21:15.538 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.2] 2020-04-02T23:21:15.538 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQBkc4ZeyNnFDhAA56wqexCKV9yTpD6ymjO+9g== 2020-04-02T23:21:15.538 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.3] 2020-04-02T23:21:15.538 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQBkc4Zev9fBJhAA7CfA5ZURgcMFKnAqHOHsMw== 2020-04-02T23:21:15.539 INFO:teuthology.orchestra.run.smithi196.stdout:[client.0] 2020-04-02T23:21:15.539 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQBZc4ZeZRt4EBAAqfO2bEAqZJFV7yvD0AVtoQ== 2020-04-02T23:21:15.540 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:15.567 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2020-04-02T23:21:15.610 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:15.626 INFO:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2020-04-02T23:21:15.717 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:15.731 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mds allow --cap osd 'allow *' --cap mgr 'allow *' --cap mon 'allow *' 2020-04-02T23:21:15.774 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:15.788 INFO:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mds allow --cap osd 'allow *' --cap mgr 'allow *' --cap mon 'allow *' 2020-04-02T23:21:15.881 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:15.912 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-02T23:21:15.954 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:15.968 INFO:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-02T23:21:16.057 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:16.071 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-02T23:21:16.113 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:16.126 INFO:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-02T23:21:16.215 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:16.228 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-02T23:21:16.270 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:16.283 INFO:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-02T23:21:16.371 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:16.384 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-02T23:21:16.428 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:16.441 INFO:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-02T23:21:16.529 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:16.543 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2020-04-02T23:21:16.586 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:16.600 INFO:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2020-04-02T23:21:16.688 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:16.702 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mds allow --cap osd 'allow *' --cap mgr 'allow *' --cap mon 'allow *' 2020-04-02T23:21:16.744 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:16.762 INFO:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mds allow --cap osd 'allow *' --cap mgr 'allow *' --cap mon 'allow *' 2020-04-02T23:21:16.852 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:16.870 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-02T23:21:16.912 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:16.925 INFO:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-02T23:21:17.013 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:17.028 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-02T23:21:17.070 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:17.084 INFO:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-02T23:21:17.172 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:17.185 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-02T23:21:17.228 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:17.242 INFO:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-02T23:21:17.329 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:17.344 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-02T23:21:17.389 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:17.403 INFO:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-02T23:21:17.492 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:17.505 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2020-04-02T23:21:17.548 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:17.562 INFO:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2020-04-02T23:21:17.653 INFO:tasks.ceph:Running mkfs on mon nodes... 2020-04-02T23:21:17.654 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:17.667 INFO:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2020-04-02T23:21:17.734 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:17.787 INFO:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-04-02T23:21:17.880 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:17.893 INFO:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2020-04-02T23:21:17.960 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:18.015 INFO:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2020-04-02T23:21:18.090 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:18.144 INFO:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-04-02T23:21:18.239 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:18.252 INFO:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2020-04-02T23:21:18.319 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:18.336 INFO:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2020-04-02T23:21:18.405 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:18.459 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-04-02T23:21:18.554 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:18.568 INFO:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2020-04-02T23:21:18.636 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:18.706 INFO:teuthology.orchestra.run.smithi174:> rm -- /home/ubuntu/cephtest/ceph.monmap 2020-04-02T23:21:18.749 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:18.766 INFO:teuthology.orchestra.run.smithi196:> rm -- /home/ubuntu/cephtest/ceph.monmap 2020-04-02T23:21:18.819 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2020-04-02T23:21:18.820 INFO:tasks.ceph.mon.b:Restarting daemon 2020-04-02T23:21:18.820 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:18.873 INFO:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2020-04-02T23:21:18.916 INFO:tasks.ceph.mon.b:Started 2020-04-02T23:21:18.916 INFO:tasks.ceph.mon.c:Restarting daemon 2020-04-02T23:21:18.916 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:18.930 INFO:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2020-04-02T23:21:18.972 INFO:tasks.ceph.mon.c:Started 2020-04-02T23:21:18.972 INFO:tasks.ceph.mon.a:Restarting daemon 2020-04-02T23:21:18.972 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:18.986 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2020-04-02T23:21:19.030 INFO:tasks.ceph.mon.a:Started 2020-04-02T23:21:19.031 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2020-04-02T23:21:19.031 INFO:tasks.ceph.mgr.x:Restarting daemon 2020-04-02T23:21:19.031 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:19.051 INFO:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2020-04-02T23:21:19.094 INFO:tasks.ceph.mgr.x:Started 2020-04-02T23:21:19.094 INFO:tasks.ceph.mgr.y:Restarting daemon 2020-04-02T23:21:19.094 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:19.108 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2020-04-02T23:21:19.151 INFO:tasks.ceph.mgr.y:Started 2020-04-02T23:21:19.151 INFO:tasks.ceph:Setting crush tunables to default 2020-04-02T23:21:19.151 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:19.171 INFO:teuthology.orchestra.run.smithi174:> sudo ceph --cluster ceph osd crush tunables default 2020-04-02T23:21:19.325 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:19.316+0000 7f585b463700 1 Processor -- start 2020-04-02T23:21:19.325 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:19.316+0000 7f585b463700 1 -- start start 2020-04-02T23:21:19.325 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:19.317+0000 7f585b463700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f585414e4b0 0x7f58541508a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:19.326 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:19.317+0000 7f585b463700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58540a39a0 con 0x7f585414a9a0 2020-04-02T23:21:19.326 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:19.317+0000 7f585b463700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58540a6440 con 0x7f585405bdd0 2020-04-02T23:21:19.326 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:19.317+0000 7f585b463700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58540a66e0 con 0x7f585414e4b0 2020-04-02T23:21:19.326 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:19.317+0000 7f58591ff700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f585414a9a0 0x7f585414cd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:44116/0 (socket says 172.21.15.174:44116) 2020-04-02T23:21:19.326 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:19.317+0000 7f58591ff700 1 -- 172.21.15.174:0/2544443431 learned_addr learned my addr 172.21.15.174:0/2544443431 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:21:19.326 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:19.317+0000 7f585a201700 1 --2- 172.21.15.174:0/2544443431 >> v2:172.21.15.174:3300/0 conn(0x7f585414e4b0 0x7f58541508a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:19.326 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:19.318+0000 7f58589fe700 1 -- 172.21.15.174:0/2544443431 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3021648447 0 0) 0x7f58540a39a0 con 0x7f585414a9a0 2020-04-02T23:21:19.327 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:19.318+0000 7f58589fe700 1 -- 172.21.15.174:0/2544443431 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5840003230 con 0x7f585414a9a0 2020-04-02T23:21:19.327 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:19.318+0000 7f58589fe700 1 -- 172.21.15.174:0/2544443431 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 686879690 0 0) 0x7f58540a6440 con 0x7f585405bdd0 2020-04-02T23:21:19.327 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:19.318+0000 7f58589fe700 1 -- 172.21.15.174:0/2544443431 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58540a39a0 con 0x7f585405bdd0 2020-04-02T23:21:19.327 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:19.318+0000 7f585a201700 1 -- 172.21.15.174:0/2544443431 >> v1:172.21.15.196:6789/0 conn(0x7f585405bdd0 legacy=0x7f58540a3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:19.327 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:19.318+0000 7f585a201700 1 -- 172.21.15.174:0/2544443431 >> v1:172.21.15.174:6789/0 conn(0x7f585414a9a0 legacy=0x7f585414cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:19.327 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:19.318+0000 7f585a201700 1 -- 172.21.15.174:0/2544443431 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58540a6980 con 0x7f585414e4b0 2020-04-02T23:21:19.327 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:19.318+0000 7f585a201700 1 --2- 172.21.15.174:0/2544443431 >> v2:172.21.15.174:3300/0 conn(0x7f585414e4b0 0x7f58541508a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f58540a3ce0 tx=0x7f584c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:19.328 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:19.318+0000 7f585a201700 1 --2- 172.21.15.174:0/2544443431 >> v2:172.21.15.174:3300/0 conn(0x7f585414e4b0 0x7f58541508a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f58540a3ce0 tx=0x7f584c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:19.328 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:19.318+0000 7f585a201700 1 --2- 172.21.15.174:0/2544443431 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f585414e4b0 0x7f58541508a0 secure :-1 s=READY pgs=6 cs=0 l=1 rx=0x7f58540a3ce0 tx=0x7f584c008c60).ready entity=mon.0 client_cookie=4be3b96c77b7734e server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:19.328 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:19.318+0000 7f585a201700 1 --2- 172.21.15.174:0/2544443431 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f585414e4b0 0x7f58541508a0 secure :-1 s=THROTTLE_DONE pgs=6 cs=0 l=1 rx=0x7f58540a3ce0 tx=0x7f584c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:19.328 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:19.318+0000 7f58589fe700 1 -- 172.21.15.174:0/2544443431 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f584c011d70 con 0x7f585414e4b0 2020-04-02T23:21:19.328 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:19.318+0000 7f585a201700 1 --2- 172.21.15.174:0/2544443431 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f585414e4b0 0x7f58541508a0 secure :-1 s=THROTTLE_DONE pgs=6 cs=0 l=1 rx=0x7f58540a3ce0 tx=0x7f584c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:19.328 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:19.318+0000 7f585a201700 1 --2- 172.21.15.174:0/2544443431 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f585414e4b0 0x7f58541508a0 secure :-1 s=THROTTLE_DONE pgs=6 cs=0 l=1 rx=0x7f58540a3ce0 tx=0x7f584c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:19.328 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:19.318+0000 7f58589fe700 1 -- 172.21.15.174:0/2544443431 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f584c00a160 con 0x7f585414e4b0 2020-04-02T23:21:19.329 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:19.318+0000 7f58589fe700 1 -- 172.21.15.174:0/2544443431 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f584c00a500 con 0x7f585414e4b0 2020-04-02T23:21:19.329 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:19.318+0000 7f585b463700 1 -- 172.21.15.174:0/2544443431 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f585414e4b0 msgr2=0x7f58541508a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:19.329 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:19.318+0000 7f585b463700 1 --2- 172.21.15.174:0/2544443431 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f585414e4b0 0x7f58541508a0 secure :-1 s=READY pgs=6 cs=0 l=1 rx=0x7f58540a3ce0 tx=0x7f584c008c60).stop 2020-04-02T23:21:19.329 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:19.319+0000 7f585b463700 1 -- 172.21.15.174:0/2544443431 shutdown_connections 2020-04-02T23:21:19.329 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:19.319+0000 7f585b463700 1 --2- 172.21.15.174:0/2544443431 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f585414e4b0 0x7f58541508a0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:19.330 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:19.319+0000 7f585b463700 1 -- 172.21.15.174:0/2544443431 >> 172.21.15.174:0/2544443431 conn(0x7f58540a6d00 msgr2=0x7f58540a7110 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:19.330 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:19.319+0000 7f585b463700 1 -- 172.21.15.174:0/2544443431 shutdown_connections 2020-04-02T23:21:19.330 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:19.319+0000 7f585b463700 1 -- 172.21.15.174:0/2544443431 wait complete. 2020-04-02T23:21:19.330 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:19.320+0000 7f585b463700 1 Processor -- start 2020-04-02T23:21:19.330 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:19.320+0000 7f585b463700 1 -- start start 2020-04-02T23:21:19.330 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:19.320+0000 7f585b463700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f585405bdd0 0x7f585407e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:19.330 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:19.320+0000 7f585b463700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f585414e4b0 0x7f585413b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:19.330 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:19.320+0000 7f585b463700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f585409ff30 con 0x7f585414a9a0 2020-04-02T23:21:19.331 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:19.320+0000 7f585b463700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58540a01d0 con 0x7f585414e4b0 2020-04-02T23:21:19.331 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:19.320+0000 7f585b463700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58540a1650 con 0x7f585405bdd0 2020-04-02T23:21:19.331 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:19.320+0000 7f585a201700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f585414e4b0 0x7f585413b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:19.331 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:19.320+0000 7f585a201700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f585414e4b0 0x7f585413b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:39088/0 (socket says 172.21.15.174:39088) 2020-04-02T23:21:19.331 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:19.320+0000 7f585a201700 1 -- 172.21.15.174:0/426390494 learned_addr learned my addr 172.21.15.174:0/426390494 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:21:19.331 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:19.321+0000 7f5859a00700 1 --2- 172.21.15.174:0/426390494 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f585405bdd0 0x7f585407e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:19.331 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:19.321+0000 7f584a7fc700 1 -- 172.21.15.174:0/426390494 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3611135431 0 0) 0x7f585409ff30 con 0x7f585414a9a0 2020-04-02T23:21:19.332 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:19.321+0000 7f585a201700 1 -- 172.21.15.174:0/426390494 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f585405bdd0 msgr2=0x7f585407e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:19.332 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:19.321+0000 7f585a201700 1 --2- 172.21.15.174:0/426390494 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f585405bdd0 0x7f585407e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:19.332 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:19.321+0000 7f585a201700 1 -- 172.21.15.174:0/426390494 >> v1:172.21.15.196:6789/0 conn(0x7f585414a9a0 legacy=0x7f585407d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:19.332 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:19.321+0000 7f585a201700 1 -- 172.21.15.174:0/426390494 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58540655c0 con 0x7f585414e4b0 2020-04-02T23:21:19.332 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:19.321+0000 7f585a201700 1 --2- 172.21.15.174:0/426390494 >> v2:172.21.15.174:3300/0 conn(0x7f585414e4b0 0x7f585413b1b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f58540a3ce0 tx=0x7f584c011630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:19.332 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:19.321+0000 7f585a201700 1 --2- 172.21.15.174:0/426390494 >> v2:172.21.15.174:3300/0 conn(0x7f585414e4b0 0x7f585413b1b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f58540a3ce0 tx=0x7f584c011630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:19.332 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:19.321+0000 7f585a201700 1 --2- 172.21.15.174:0/426390494 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f585414e4b0 0x7f585413b1b0 secure :-1 s=READY pgs=7 cs=0 l=1 rx=0x7f58540a3ce0 tx=0x7f584c011630).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:19.332 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:19.321+0000 7f585a201700 1 --2- 172.21.15.174:0/426390494 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f585414e4b0 0x7f585413b1b0 secure :-1 s=THROTTLE_DONE pgs=7 cs=0 l=1 rx=0x7f58540a3ce0 tx=0x7f584c011630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:19.333 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:19.321+0000 7f585a201700 1 --2- 172.21.15.174:0/426390494 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f585414e4b0 0x7f585413b1b0 secure :-1 s=THROTTLE_DONE pgs=7 cs=0 l=1 rx=0x7f58540a3ce0 tx=0x7f584c011630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:19.333 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:19.321+0000 7f584a7fc700 1 -- 172.21.15.174:0/426390494 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f584c005c30 con 0x7f585414e4b0 2020-04-02T23:21:19.333 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:19.321+0000 7f585a201700 1 --2- 172.21.15.174:0/426390494 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f585414e4b0 0x7f585413b1b0 secure :-1 s=THROTTLE_DONE pgs=7 cs=0 l=1 rx=0x7f58540a3ce0 tx=0x7f584c011630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:19.333 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:19.321+0000 7f584a7fc700 1 -- 172.21.15.174:0/426390494 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f584c005d90 con 0x7f585414e4b0 2020-04-02T23:21:19.333 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:19.321+0000 7f585b463700 1 -- 172.21.15.174:0/426390494 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5854064d90 con 0x7f585414e4b0 2020-04-02T23:21:19.333 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:19.321+0000 7f584a7fc700 1 -- 172.21.15.174:0/426390494 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f584c007340 con 0x7f585414e4b0 2020-04-02T23:21:19.333 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:19.321+0000 7f585a201700 1 --2- 172.21.15.174:0/426390494 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f585414e4b0 0x7f585413b1b0 secure :-1 s=THROTTLE_DONE pgs=7 cs=0 l=1 rx=0x7f58540a3ce0 tx=0x7f584c011630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:19.334 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:19.321+0000 7f584a7fc700 1 -- 172.21.15.174:0/426390494 <== mon.0 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 1) v1 ==== 360+0+0 (secure 0 0 0) 0x7f584c00f360 con 0x7f585414e4b0 2020-04-02T23:21:19.334 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:19.321+0000 7f585b463700 1 -- 172.21.15.174:0/426390494 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5854065a30 con 0x7f585414e4b0 2020-04-02T23:21:19.334 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:19.321+0000 7f585a201700 1 --2- 172.21.15.174:0/426390494 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f585414e4b0 0x7f585413b1b0 secure :-1 s=THROTTLE_DONE pgs=7 cs=0 l=1 rx=0x7f58540a3ce0 tx=0x7f584c011630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:19.334 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:19.321+0000 7f584a7fc700 1 -- 172.21.15.174:0/426390494 <== mon.0 v2:172.21.15.174:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f584c00c9f0 con 0x7f585414e4b0 2020-04-02T23:21:19.334 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:19.322+0000 7f585b463700 1 -- 172.21.15.174:0/426390494 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5854056c50 con 0x7f585414e4b0 2020-04-02T23:21:19.334 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:19.324+0000 7f585a201700 1 --2- 172.21.15.174:0/426390494 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f585414e4b0 0x7f585413b1b0 secure :-1 s=THROTTLE_DONE pgs=7 cs=0 l=1 rx=0x7f58540a3ce0 tx=0x7f584c011630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:19.335 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:19.324+0000 7f584a7fc700 1 -- 172.21.15.174:0/426390494 <== mon.0 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67700 (secure 0 0 0) 0x7f584c00cbb0 con 0x7f585414e4b0 2020-04-02T23:21:19.404 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:19.402+0000 7f585b463700 1 -- 172.21.15.174:0/426390494 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f585407e4e0 con 0x7f585414e4b0 2020-04-02T23:21:19.406 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:19.404+0000 7f585a201700 1 --2- 172.21.15.174:0/426390494 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f585414e4b0 0x7f585413b1b0 secure :-1 s=THROTTLE_DONE pgs=7 cs=0 l=1 rx=0x7f58540a3ce0 tx=0x7f584c011630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:19.407 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:19.404+0000 7f584a7fc700 1 -- 172.21.15.174:0/426390494 <== mon.0 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f584c00cd50 con 0x7f585414e4b0 2020-04-02T23:21:19.408 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:19.405+0000 7f585b463700 1 -- 172.21.15.174:0/426390494 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f585414e4b0 msgr2=0x7f585413b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:19.408 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:19.405+0000 7f585b463700 1 --2- 172.21.15.174:0/426390494 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f585414e4b0 0x7f585413b1b0 secure :-1 s=READY pgs=7 cs=0 l=1 rx=0x7f58540a3ce0 tx=0x7f584c011630).stop 2020-04-02T23:21:19.408 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:19.405+0000 7f585b463700 1 -- 172.21.15.174:0/426390494 shutdown_connections 2020-04-02T23:21:19.408 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:19.405+0000 7f585b463700 1 --2- 172.21.15.174:0/426390494 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f585414e4b0 0x7f585413b1b0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:19.409 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:19.405+0000 7f585b463700 1 --2- 172.21.15.174:0/426390494 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f585405bdd0 0x7f585407e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:19.409 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:19.405+0000 7f585b463700 1 -- 172.21.15.174:0/426390494 >> 172.21.15.174:0/426390494 conn(0x7f58540a6d00 msgr2=0x7f58540695c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:19.409 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:19.405+0000 7f585b463700 1 -- 172.21.15.174:0/426390494 shutdown_connections 2020-04-02T23:21:19.409 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:19.405+0000 7f585b463700 1 -- 172.21.15.174:0/426390494 wait complete. 2020-04-02T23:21:19.409 INFO:teuthology.orchestra.run.smithi174.stderr:adjusted tunables profile to default 2020-04-02T23:21:19.418 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2020-04-02T23:21:19.418 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:19.431 INFO:teuthology.orchestra.run.smithi196:> mktemp 2020-04-02T23:21:19.486 INFO:teuthology.orchestra.run.smithi196.stdout:/tmp/tmp.fVzWCWDsFp 2020-04-02T23:21:19.486 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:19.543 INFO:teuthology.orchestra.run.smithi196:> sudo cp /var/lib/ceph/osd/ceph-4/fsid /tmp/tmp.fVzWCWDsFp 2020-04-02T23:21:19.611 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:19.668 INFO:teuthology.orchestra.run.smithi196:> sudo chmod 0666 /tmp/tmp.fVzWCWDsFp 2020-04-02T23:21:19.793 DEBUG:teuthology.orchestra.remote:smithi196:/tmp/tmp.fVzWCWDsFp is 37B 2020-04-02T23:21:19.840 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:19.868 INFO:teuthology.orchestra.run.smithi196:> rm -fr /tmp/tmp.fVzWCWDsFp 2020-04-02T23:21:19.908 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:19.962 INFO:teuthology.orchestra.run.smithi196:> mktemp 2020-04-02T23:21:20.015 INFO:teuthology.orchestra.run.smithi196.stdout:/tmp/tmp.sBcH1n9hFv 2020-04-02T23:21:20.016 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:20.070 INFO:teuthology.orchestra.run.smithi196:> sudo cp /var/lib/ceph/osd/ceph-5/fsid /tmp/tmp.sBcH1n9hFv 2020-04-02T23:21:20.161 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:20.176 INFO:teuthology.orchestra.run.smithi196:> sudo chmod 0666 /tmp/tmp.sBcH1n9hFv 2020-04-02T23:21:20.300 DEBUG:teuthology.orchestra.remote:smithi196:/tmp/tmp.sBcH1n9hFv is 37B 2020-04-02T23:21:20.347 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:20.361 INFO:teuthology.orchestra.run.smithi196:> rm -fr /tmp/tmp.sBcH1n9hFv 2020-04-02T23:21:20.414 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:20.469 INFO:teuthology.orchestra.run.smithi196:> mktemp 2020-04-02T23:21:20.525 INFO:teuthology.orchestra.run.smithi196.stdout:/tmp/tmp.LMVmSWCTPk 2020-04-02T23:21:20.526 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:20.579 INFO:teuthology.orchestra.run.smithi196:> sudo cp /var/lib/ceph/osd/ceph-6/fsid /tmp/tmp.LMVmSWCTPk 2020-04-02T23:21:20.648 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:20.702 INFO:teuthology.orchestra.run.smithi196:> sudo chmod 0666 /tmp/tmp.LMVmSWCTPk 2020-04-02T23:21:20.825 DEBUG:teuthology.orchestra.remote:smithi196:/tmp/tmp.LMVmSWCTPk is 37B 2020-04-02T23:21:20.878 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:20.892 INFO:teuthology.orchestra.run.smithi196:> rm -fr /tmp/tmp.LMVmSWCTPk 2020-04-02T23:21:20.945 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:21.002 INFO:teuthology.orchestra.run.smithi196:> mktemp 2020-04-02T23:21:21.065 INFO:teuthology.orchestra.run.smithi196.stdout:/tmp/tmp.W4ijmTzj5o 2020-04-02T23:21:21.066 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:21.121 INFO:teuthology.orchestra.run.smithi196:> sudo cp /var/lib/ceph/osd/ceph-7/fsid /tmp/tmp.W4ijmTzj5o 2020-04-02T23:21:21.189 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:21.245 INFO:teuthology.orchestra.run.smithi196:> sudo chmod 0666 /tmp/tmp.W4ijmTzj5o 2020-04-02T23:21:21.369 DEBUG:teuthology.orchestra.remote:smithi196:/tmp/tmp.W4ijmTzj5o is 37B 2020-04-02T23:21:21.424 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:21.437 INFO:teuthology.orchestra.run.smithi196:> rm -fr /tmp/tmp.W4ijmTzj5o 2020-04-02T23:21:21.491 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:21.505 INFO:teuthology.orchestra.run.smithi174:> mktemp 2020-04-02T23:21:21.559 INFO:teuthology.orchestra.run.smithi174.stdout:/tmp/tmp.MCfqSGXjQm 2020-04-02T23:21:21.559 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:21.613 INFO:teuthology.orchestra.run.smithi174:> sudo cp /var/lib/ceph/osd/ceph-0/fsid /tmp/tmp.MCfqSGXjQm 2020-04-02T23:21:21.681 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:21.734 INFO:teuthology.orchestra.run.smithi174:> sudo chmod 0666 /tmp/tmp.MCfqSGXjQm 2020-04-02T23:21:21.861 DEBUG:teuthology.orchestra.remote:smithi174:/tmp/tmp.MCfqSGXjQm is 37B 2020-04-02T23:21:21.908 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:21.922 INFO:teuthology.orchestra.run.smithi174:> rm -fr /tmp/tmp.MCfqSGXjQm 2020-04-02T23:21:21.982 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:22.036 INFO:teuthology.orchestra.run.smithi174:> mktemp 2020-04-02T23:21:22.090 INFO:teuthology.orchestra.run.smithi174.stdout:/tmp/tmp.Q52Cxn4H17 2020-04-02T23:21:22.090 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:22.144 INFO:teuthology.orchestra.run.smithi174:> sudo cp /var/lib/ceph/osd/ceph-1/fsid /tmp/tmp.Q52Cxn4H17 2020-04-02T23:21:22.212 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:22.265 INFO:teuthology.orchestra.run.smithi174:> sudo chmod 0666 /tmp/tmp.Q52Cxn4H17 2020-04-02T23:21:22.389 DEBUG:teuthology.orchestra.remote:smithi174:/tmp/tmp.Q52Cxn4H17 is 37B 2020-04-02T23:21:22.438 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:22.450 INFO:teuthology.orchestra.run.smithi174:> rm -fr /tmp/tmp.Q52Cxn4H17 2020-04-02T23:21:22.505 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:22.558 INFO:teuthology.orchestra.run.smithi174:> mktemp 2020-04-02T23:21:22.611 INFO:teuthology.orchestra.run.smithi174.stdout:/tmp/tmp.2VVQxxxC7v 2020-04-02T23:21:22.611 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:22.664 INFO:teuthology.orchestra.run.smithi174:> sudo cp /var/lib/ceph/osd/ceph-2/fsid /tmp/tmp.2VVQxxxC7v 2020-04-02T23:21:22.730 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:22.783 INFO:teuthology.orchestra.run.smithi174:> sudo chmod 0666 /tmp/tmp.2VVQxxxC7v 2020-04-02T23:21:22.905 DEBUG:teuthology.orchestra.remote:smithi174:/tmp/tmp.2VVQxxxC7v is 37B 2020-04-02T23:21:22.961 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:22.977 INFO:teuthology.orchestra.run.smithi174:> rm -fr /tmp/tmp.2VVQxxxC7v 2020-04-02T23:21:23.029 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:23.082 INFO:teuthology.orchestra.run.smithi174:> mktemp 2020-04-02T23:21:23.136 INFO:teuthology.orchestra.run.smithi174.stdout:/tmp/tmp.UpsYonUNY7 2020-04-02T23:21:23.136 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:23.189 INFO:teuthology.orchestra.run.smithi174:> sudo cp /var/lib/ceph/osd/ceph-3/fsid /tmp/tmp.UpsYonUNY7 2020-04-02T23:21:23.256 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:23.312 INFO:teuthology.orchestra.run.smithi174:> sudo chmod 0666 /tmp/tmp.UpsYonUNY7 2020-04-02T23:21:23.435 DEBUG:teuthology.orchestra.remote:smithi174:/tmp/tmp.UpsYonUNY7 is 37B 2020-04-02T23:21:23.484 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:23.498 INFO:teuthology.orchestra.run.smithi174:> rm -fr /tmp/tmp.UpsYonUNY7 2020-04-02T23:21:23.556 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:23.557 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:23.611 INFO:teuthology.orchestra.run.smithi174:> sudo ceph --cluster ceph osd new c9d748ee-c52f-4f21-b8c9-2a53a937be1d 0 2020-04-02T23:21:23.611 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:21:23.653 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:23.670 INFO:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:21:23.759 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.753+0000 7f33f1b61700 1 Processor -- start 2020-04-02T23:21:23.759 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.754+0000 7f33f1b61700 1 -- start start 2020-04-02T23:21:23.759 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.754+0000 7f33f1b61700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f33ec05bdd0 0x7f33ec0a3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:23.759 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.754+0000 7f33f1b61700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f33ec0a4380 0x7f33ec0a4b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:23.760 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.754+0000 7f33f1b61700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33ec0a6440 con 0x7f33ec0a4f90 2020-04-02T23:21:23.760 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.754+0000 7f33f1b61700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33ec0a3a60 con 0x7f33ec0a4380 2020-04-02T23:21:23.760 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.754+0000 7f33f1b61700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33ec0a66e0 con 0x7f33ec05bdd0 2020-04-02T23:21:23.760 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.754+0000 7f33e3fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f33ec0a4380 0x7f33ec0a4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:23.760 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.754+0000 7f33f08ff700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f33ec0a4f90 0x7f33ec0a5420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:44132/0 (socket says 172.21.15.174:44132) 2020-04-02T23:21:23.760 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.754+0000 7f33f08ff700 1 -- 172.21.15.174:0/3447045353 learned_addr learned my addr 172.21.15.174:0/3447045353 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:21:23.761 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.754+0000 7f33ebfff700 1 --2- 172.21.15.174:0/3447045353 >> v2:172.21.15.196:3300/0 conn(0x7f33ec05bdd0 0x7f33ec0a3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:23.761 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.755+0000 7f33e3fff700 1 -- 172.21.15.174:0/3447045353 >> v2:172.21.15.196:3300/0 conn(0x7f33ec05bdd0 msgr2=0x7f33ec0a3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:23.761 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.755+0000 7f33e3fff700 1 --2- 172.21.15.174:0/3447045353 >> v2:172.21.15.196:3300/0 conn(0x7f33ec05bdd0 0x7f33ec0a3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:23.761 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.755+0000 7f33e3fff700 1 -- 172.21.15.174:0/3447045353 >> v1:172.21.15.174:6789/0 conn(0x7f33ec0a4f90 legacy=0x7f33ec0a5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:23.761 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.755+0000 7f33e3fff700 1 -- 172.21.15.174:0/3447045353 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33ec0a6980 con 0x7f33ec0a4380 2020-04-02T23:21:23.761 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.755+0000 7f33eb7fe700 1 -- 172.21.15.174:0/3447045353 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3104473733 0 0) 0x7f33ec0a6440 con 0x7f33ec0a4f90 2020-04-02T23:21:23.761 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.755+0000 7f33e3fff700 1 --2- 172.21.15.174:0/3447045353 >> v2:172.21.15.174:3300/0 conn(0x7f33ec0a4380 0x7f33ec0a4b30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f33d4002f30 tx=0x7f33d4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:23.762 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.755+0000 7f33e3fff700 1 --2- 172.21.15.174:0/3447045353 >> v2:172.21.15.174:3300/0 conn(0x7f33ec0a4380 0x7f33ec0a4b30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f33d4002f30 tx=0x7f33d4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:23.762 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.755+0000 7f33e3fff700 1 --2- 172.21.15.174:0/3447045353 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f33ec0a4380 0x7f33ec0a4b30 secure :-1 s=READY pgs=13 cs=0 l=1 rx=0x7f33d4002f30 tx=0x7f33d4007a40).ready entity=mon.0 client_cookie=7adf61805378b6ed server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:23.762 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.755+0000 7f33e3fff700 1 --2- 172.21.15.174:0/3447045353 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f33ec0a4380 0x7f33ec0a4b30 secure :-1 s=THROTTLE_DONE pgs=13 cs=0 l=1 rx=0x7f33d4002f30 tx=0x7f33d4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:23.762 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.755+0000 7f33eb7fe700 1 -- 172.21.15.174:0/3447045353 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33d40113c0 con 0x7f33ec0a4380 2020-04-02T23:21:23.762 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.755+0000 7f33e3fff700 1 --2- 172.21.15.174:0/3447045353 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f33ec0a4380 0x7f33ec0a4b30 secure :-1 s=THROTTLE_DONE pgs=13 cs=0 l=1 rx=0x7f33d4002f30 tx=0x7f33d4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:23.762 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.755+0000 7f33e3fff700 1 --2- 172.21.15.174:0/3447045353 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f33ec0a4380 0x7f33ec0a4b30 secure :-1 s=THROTTLE_DONE pgs=13 cs=0 l=1 rx=0x7f33d4002f30 tx=0x7f33d4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:23.762 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.755+0000 7f33eb7fe700 1 -- 172.21.15.174:0/3447045353 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33d4011520 con 0x7f33ec0a4380 2020-04-02T23:21:23.762 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.755+0000 7f33eb7fe700 1 -- 172.21.15.174:0/3447045353 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33d40118c0 con 0x7f33ec0a4380 2020-04-02T23:21:23.763 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.755+0000 7f33f1b61700 1 -- 172.21.15.174:0/3447045353 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f33ec0a4380 msgr2=0x7f33ec0a4b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:23.763 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.755+0000 7f33f1b61700 1 --2- 172.21.15.174:0/3447045353 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f33ec0a4380 0x7f33ec0a4b30 secure :-1 s=READY pgs=13 cs=0 l=1 rx=0x7f33d4002f30 tx=0x7f33d4007a40).stop 2020-04-02T23:21:23.763 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.755+0000 7f33f1b61700 1 -- 172.21.15.174:0/3447045353 shutdown_connections 2020-04-02T23:21:23.763 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.755+0000 7f33f1b61700 1 --2- 172.21.15.174:0/3447045353 >> v2:172.21.15.196:3300/0 conn(0x7f33ec05bdd0 0x7f33ec0a3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:23.763 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.755+0000 7f33f1b61700 1 --2- 172.21.15.174:0/3447045353 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f33ec0a4380 0x7f33ec0a4b30 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:23.764 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.755+0000 7f33f1b61700 1 -- 172.21.15.174:0/3447045353 >> 172.21.15.174:0/3447045353 conn(0x7f33ec0a6d00 msgr2=0x7f33ec0a7110 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:23.764 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.755+0000 7f33f1b61700 1 -- 172.21.15.174:0/3447045353 shutdown_connections 2020-04-02T23:21:23.764 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.755+0000 7f33f1b61700 1 -- 172.21.15.174:0/3447045353 wait complete. 2020-04-02T23:21:23.764 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.756+0000 7f33f1b61700 1 Processor -- start 2020-04-02T23:21:23.764 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.757+0000 7f33f1b61700 1 -- start start 2020-04-02T23:21:23.768 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.757+0000 7f33f1b61700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f33ec0a4380 0x7f33ec07c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:23.768 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.757+0000 7f33f1b61700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f33ec0a4f90 0x7f33ec07c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:23.768 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.757+0000 7f33f1b61700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33ec065840 con 0x7f33ec05bdd0 2020-04-02T23:21:23.769 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.757+0000 7f33f1b61700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33ec065ae0 con 0x7f33ec0a4f90 2020-04-02T23:21:23.769 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.757+0000 7f33f1b61700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33ec065d80 con 0x7f33ec0a4380 2020-04-02T23:21:23.769 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.757+0000 7f33f08ff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f33ec0a4f90 0x7f33ec07c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:23.769 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.757+0000 7f33f08ff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f33ec0a4f90 0x7f33ec07c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:39102/0 (socket says 172.21.15.174:39102) 2020-04-02T23:21:23.770 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.757+0000 7f33f08ff700 1 -- 172.21.15.174:0/2759988493 learned_addr learned my addr 172.21.15.174:0/2759988493 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:21:23.770 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.757+0000 7f33e3fff700 1 --2- 172.21.15.174:0/2759988493 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f33ec0a4380 0x7f33ec07c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:23.770 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.757+0000 7f33f08ff700 1 -- 172.21.15.174:0/2759988493 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f33ec0a4380 msgr2=0x7f33ec07c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:23.771 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.757+0000 7f33f08ff700 1 --2- 172.21.15.174:0/2759988493 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f33ec0a4380 0x7f33ec07c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:23.771 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.757+0000 7f33f08ff700 1 -- 172.21.15.174:0/2759988493 >> v1:172.21.15.196:6789/0 conn(0x7f33ec05bdd0 legacy=0x7f33ec066280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:23.771 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.757+0000 7f33f08ff700 1 -- 172.21.15.174:0/2759988493 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33ec07e940 con 0x7f33ec0a4f90 2020-04-02T23:21:23.771 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.757+0000 7f33f08ff700 1 --2- 172.21.15.174:0/2759988493 >> v2:172.21.15.174:3300/0 conn(0x7f33ec0a4f90 0x7f33ec07c660 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f33ec1323a0 tx=0x7f33e4010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:23.771 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.757+0000 7f33f08ff700 1 --2- 172.21.15.174:0/2759988493 >> v2:172.21.15.174:3300/0 conn(0x7f33ec0a4f90 0x7f33ec07c660 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f33ec1323a0 tx=0x7f33e4010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:23.771 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.758+0000 7f33f08ff700 1 --2- 172.21.15.174:0/2759988493 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f33ec0a4f90 0x7f33ec07c660 secure :-1 s=READY pgs=14 cs=0 l=1 rx=0x7f33ec1323a0 tx=0x7f33e4010cd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:23.771 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.758+0000 7f33f08ff700 1 --2- 172.21.15.174:0/2759988493 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f33ec0a4f90 0x7f33ec07c660 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rx=0x7f33ec1323a0 tx=0x7f33e4010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:23.772 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.758+0000 7f33f08ff700 1 --2- 172.21.15.174:0/2759988493 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f33ec0a4f90 0x7f33ec07c660 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rx=0x7f33ec1323a0 tx=0x7f33e4010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:23.772 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.758+0000 7f33f08ff700 1 --2- 172.21.15.174:0/2759988493 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f33ec0a4f90 0x7f33ec07c660 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rx=0x7f33ec1323a0 tx=0x7f33e4010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:23.772 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.758+0000 7f33e97fa700 1 -- 172.21.15.174:0/2759988493 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33e4005e30 con 0x7f33ec0a4f90 2020-04-02T23:21:23.773 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.758+0000 7f33e97fa700 1 -- 172.21.15.174:0/2759988493 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e4012520 con 0x7f33ec0a4f90 2020-04-02T23:21:23.773 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.758+0000 7f33f1b61700 1 -- 172.21.15.174:0/2759988493 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33ec064260 con 0x7f33ec0a4f90 2020-04-02T23:21:23.773 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.758+0000 7f33e97fa700 1 -- 172.21.15.174:0/2759988493 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33e4012900 con 0x7f33ec0a4f90 2020-04-02T23:21:23.774 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.758+0000 7f33f1b61700 1 -- 172.21.15.174:0/2759988493 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33ec0a0d80 con 0x7f33ec0a4f90 2020-04-02T23:21:23.774 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.758+0000 7f33f08ff700 1 --2- 172.21.15.174:0/2759988493 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f33ec0a4f90 0x7f33ec07c660 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rx=0x7f33ec1323a0 tx=0x7f33e4010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:23.774 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.759+0000 7f33f1b61700 1 -- 172.21.15.174:0/2759988493 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33ec063bc0 con 0x7f33ec0a4f90 2020-04-02T23:21:23.774 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.759+0000 7f33e97fa700 1 -- 172.21.15.174:0/2759988493 <== mon.0 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 59405+0+0 (secure 0 0 0) 0x7f33e4012b70 con 0x7f33ec0a4f90 2020-04-02T23:21:23.775 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.759+0000 7f33f08ff700 1 --2- 172.21.15.174:0/2759988493 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f33ec0a4f90 0x7f33ec07c660 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rx=0x7f33ec1323a0 tx=0x7f33e4010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:23.775 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.759+0000 7f33e97fa700 1 --2- 172.21.15.174:0/2759988493 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f33d004d470 0x7f33d004f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:23.775 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.759+0000 7f33e97fa700 1 -- 172.21.15.174:0/2759988493 <== mon.0 v2:172.21.15.174:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1130+0+0 (secure 0 0 0) 0x7f33e4061420 con 0x7f33ec0a4f90 2020-04-02T23:21:23.775 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.759+0000 7f33ebfff700 1 --2- 172.21.15.174:0/2759988493 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f33d004d470 0x7f33d004f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:23.775 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.759+0000 7f33ebfff700 1 --2- 172.21.15.174:0/2759988493 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f33d004d470 0x7f33d004f930 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f33ec064950 tx=0x7f33dc007700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:23.775 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.759+0000 7f33ebfff700 1 --2- 172.21.15.174:0/2759988493 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f33d004d470 0x7f33d004f930 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f33ec064950 tx=0x7f33dc007700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:23.775 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.759+0000 7f33ebfff700 1 --2- 172.21.15.174:0/2759988493 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f33d004d470 0x7f33d004f930 secure :-1 s=READY pgs=9 cs=0 l=1 rx=0x7f33ec064950 tx=0x7f33dc007700).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:23.775 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.763+0000 7f33f08ff700 1 --2- 172.21.15.174:0/2759988493 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f33ec0a4f90 0x7f33ec07c660 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rx=0x7f33ec1323a0 tx=0x7f33e4010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:23.776 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.763+0000 7f33e97fa700 1 -- 172.21.15.174:0/2759988493 <== mon.0 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f33e403cc00 con 0x7f33ec0a4f90 2020-04-02T23:21:23.921 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.915+0000 7f33f1b61700 1 -- 172.21.15.174:0/2759988493 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c9d748ee-c52f-4f21-b8c9-2a53a937be1d", "id": 0} v 0) v1 -- 0x7f33ec066b50 con 0x7f33ec0a4f90 2020-04-02T23:21:23.925 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.921+0000 7f33f08ff700 1 --2- 172.21.15.174:0/2759988493 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f33ec0a4f90 0x7f33ec07c660 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rx=0x7f33ec1323a0 tx=0x7f33e4010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:23.926 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.921+0000 7f33e97fa700 1 -- 172.21.15.174:0/2759988493 <== mon.0 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c9d748ee-c52f-4f21-b8c9-2a53a937be1d", "id": 0}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f33e4040220 con 0x7f33ec0a4f90 2020-04-02T23:21:23.931 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.922+0000 7f33f1b61700 1 -- 172.21.15.174:0/2759988493 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f33d004d470 msgr2=0x7f33d004f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:23.931 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.922+0000 7f33f1b61700 1 --2- 172.21.15.174:0/2759988493 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f33d004d470 0x7f33d004f930 secure :-1 s=READY pgs=9 cs=0 l=1 rx=0x7f33ec064950 tx=0x7f33dc007700).stop 2020-04-02T23:21:23.931 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.922+0000 7f33f1b61700 1 -- 172.21.15.174:0/2759988493 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f33ec0a4f90 msgr2=0x7f33ec07c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:23.931 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.922+0000 7f33f1b61700 1 --2- 172.21.15.174:0/2759988493 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f33ec0a4f90 0x7f33ec07c660 secure :-1 s=READY pgs=14 cs=0 l=1 rx=0x7f33ec1323a0 tx=0x7f33e4010cd0).stop 2020-04-02T23:21:23.931 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.922+0000 7f33f1b61700 1 -- 172.21.15.174:0/2759988493 shutdown_connections 2020-04-02T23:21:23.931 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.922+0000 7f33f1b61700 1 --2- 172.21.15.174:0/2759988493 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f33d004d470 0x7f33d004f930 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:23.931 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.922+0000 7f33f1b61700 1 --2- 172.21.15.174:0/2759988493 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f33ec0a4f90 0x7f33ec07c660 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:23.932 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.922+0000 7f33f1b61700 1 --2- 172.21.15.174:0/2759988493 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f33ec0a4380 0x7f33ec07c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:23.932 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.922+0000 7f33f1b61700 1 -- 172.21.15.174:0/2759988493 >> 172.21.15.174:0/2759988493 conn(0x7f33ec0a6d00 msgr2=0x7f33ec0695c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:23.932 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.922+0000 7f33f1b61700 1 -- 172.21.15.174:0/2759988493 shutdown_connections 2020-04-02T23:21:23.932 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:23.922+0000 7f33f1b61700 1 -- 172.21.15.174:0/2759988493 wait complete. 2020-04-02T23:21:23.932 INFO:teuthology.orchestra.run.smithi174.stdout:0 2020-04-02T23:21:23.941 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:23.994 INFO:teuthology.orchestra.run.smithi174:> sudo ceph --cluster ceph osd new 27c05faf-11f5-4cef-9bde-1a6653a9e533 1 2020-04-02T23:21:24.147 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.136+0000 7f055ca58700 1 Processor -- start 2020-04-02T23:21:24.147 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.136+0000 7f055ca58700 1 -- start start 2020-04-02T23:21:24.147 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.136+0000 7f055ca58700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f055814e4b0 0x7f05581508a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:24.147 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.136+0000 7f055ca58700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05580a39a0 con 0x7f055814a9a0 2020-04-02T23:21:24.147 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.136+0000 7f055ca58700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05580a6440 con 0x7f055805bdd0 2020-04-02T23:21:24.148 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.136+0000 7f055ca58700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05580a66e0 con 0x7f055814e4b0 2020-04-02T23:21:24.148 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.136+0000 7f055659c700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f055814a9a0 0x7f055814cd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:44144/0 (socket says 172.21.15.174:44144) 2020-04-02T23:21:24.148 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.136+0000 7f055659c700 1 -- 172.21.15.174:0/1042231507 learned_addr learned my addr 172.21.15.174:0/1042231507 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:21:24.148 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.137+0000 7f0555d9b700 1 -- 172.21.15.174:0/1042231507 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4172275717 0 0) 0x7f05580a39a0 con 0x7f055814a9a0 2020-04-02T23:21:24.148 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.137+0000 7f055759e700 1 --2- 172.21.15.174:0/1042231507 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f055814e4b0 0x7f05581508a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:24.148 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.137+0000 7f0555d9b700 1 -- 172.21.15.174:0/1042231507 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0540003230 con 0x7f055814a9a0 2020-04-02T23:21:24.149 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.137+0000 7f0555d9b700 1 -- 172.21.15.174:0/1042231507 <== mon.0 v1:172.21.15.174:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3335938283 0 0) 0x7f0540003230 con 0x7f055814a9a0 2020-04-02T23:21:24.149 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.137+0000 7f0555d9b700 1 -- 172.21.15.174:0/1042231507 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f055814e4b0 msgr2=0x7f05581508a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:24.149 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.137+0000 7f0555d9b700 1 --2- 172.21.15.174:0/1042231507 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f055814e4b0 0x7f05581508a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:24.154 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.137+0000 7f0555d9b700 1 -- 172.21.15.174:0/1042231507 >> v1:172.21.15.196:6789/0 conn(0x7f055805bdd0 legacy=0x7f05580a3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:24.154 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.137+0000 7f0555d9b700 1 -- 172.21.15.174:0/1042231507 --> v1:172.21.15.174:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05580a6980 con 0x7f055814a9a0 2020-04-02T23:21:24.155 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.137+0000 7f0555d9b700 1 -- 172.21.15.174:0/1042231507 <== mon.0 v1:172.21.15.174:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2811762909 0 0) 0x7f054c0016d0 con 0x7f055814a9a0 2020-04-02T23:21:24.155 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.137+0000 7f0555d9b700 1 -- 172.21.15.174:0/1042231507 >> v1:172.21.15.174:6789/0 conn(0x7f055814a9a0 legacy=0x7f055814cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:24.155 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.137+0000 7f0555d9b700 1 --2- 172.21.15.174:0/1042231507 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0540003750 0x7f0540003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:24.156 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.137+0000 7f0555d9b700 1 --2- 172.21.15.174:0/1042231507 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f055814e4b0 0x7f05400044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:24.156 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.137+0000 7f0555d9b700 1 --2- 172.21.15.174:0/1042231507 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0540004930 0x7f0540004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:24.156 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.137+0000 7f0555d9b700 1 -- 172.21.15.174:0/1042231507 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05580a66e0 con 0x7f0540003750 2020-04-02T23:21:24.157 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.137+0000 7f0555d9b700 1 -- 172.21.15.174:0/1042231507 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0540005330 con 0x7f0540004930 2020-04-02T23:21:24.157 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.137+0000 7f0555d9b700 1 -- 172.21.15.174:0/1042231507 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0540004150 con 0x7f055814e4b0 2020-04-02T23:21:24.157 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.137+0000 7f0556d9d700 1 --2- 172.21.15.174:0/1042231507 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0540003750 0x7f0540003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:24.157 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.137+0000 7f055659c700 1 --2- 172.21.15.174:0/1042231507 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f055814e4b0 0x7f05400044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:24.157 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.137+0000 7f055759e700 1 --2- 172.21.15.174:0/1042231507 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0540004930 0x7f0540004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:24.157 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.137+0000 7f055659c700 1 -- 172.21.15.174:0/1042231507 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0540004930 msgr2=0x7f0540004db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:24.158 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.137+0000 7f055659c700 1 --2- 172.21.15.174:0/1042231507 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0540004930 0x7f0540004db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:24.158 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.137+0000 7f055659c700 1 -- 172.21.15.174:0/1042231507 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0540003750 msgr2=0x7f0540003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:24.158 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.137+0000 7f055659c700 1 --2- 172.21.15.174:0/1042231507 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0540003750 0x7f0540003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:24.158 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.137+0000 7f055659c700 1 -- 172.21.15.174:0/1042231507 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0540003230 con 0x7f055814e4b0 2020-04-02T23:21:24.158 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.137+0000 7f055759e700 1 --2- 172.21.15.174:0/1042231507 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0540004930 0x7f0540004db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:21:24.158 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.137+0000 7f0556d9d700 1 --2- 172.21.15.174:0/1042231507 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0540003750 0x7f0540003b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:21:24.159 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.137+0000 7f055659c700 1 --2- 172.21.15.174:0/1042231507 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f055814e4b0 0x7f05400044d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f054c0013e0 tx=0x7f054c00c2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:24.159 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.138+0000 7f055659c700 1 --2- 172.21.15.174:0/1042231507 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f055814e4b0 0x7f05400044d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f054c0013e0 tx=0x7f054c00c2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:24.159 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.138+0000 7f055659c700 1 --2- 172.21.15.174:0/1042231507 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f055814e4b0 0x7f05400044d0 secure :-1 s=READY pgs=8 cs=0 l=1 rx=0x7f054c0013e0 tx=0x7f054c00c2e0).ready entity=mon.2 client_cookie=29f935aea882c00 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:24.160 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.138+0000 7f055659c700 1 --2- 172.21.15.174:0/1042231507 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f055814e4b0 0x7f05400044d0 secure :-1 s=THROTTLE_DONE pgs=8 cs=0 l=1 rx=0x7f054c0013e0 tx=0x7f054c00c2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:24.160 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.138+0000 7f0555d9b700 1 -- 172.21.15.174:0/1042231507 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f054c010d80 con 0x7f055814e4b0 2020-04-02T23:21:24.161 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.138+0000 7f055659c700 1 --2- 172.21.15.174:0/1042231507 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f055814e4b0 0x7f05400044d0 secure :-1 s=THROTTLE_DONE pgs=8 cs=0 l=1 rx=0x7f054c0013e0 tx=0x7f054c00c2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:24.161 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.138+0000 7f055659c700 1 --2- 172.21.15.174:0/1042231507 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f055814e4b0 0x7f05400044d0 secure :-1 s=THROTTLE_DONE pgs=8 cs=0 l=1 rx=0x7f054c0013e0 tx=0x7f054c00c2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:24.162 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.138+0000 7f0555d9b700 1 -- 172.21.15.174:0/1042231507 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f054c0055e0 con 0x7f055814e4b0 2020-04-02T23:21:24.162 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.138+0000 7f0555d9b700 1 -- 172.21.15.174:0/1042231507 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f054c005a00 con 0x7f055814e4b0 2020-04-02T23:21:24.162 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.138+0000 7f055ca58700 1 -- 172.21.15.174:0/1042231507 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f055814e4b0 msgr2=0x7f05400044d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:24.162 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.138+0000 7f055ca58700 1 --2- 172.21.15.174:0/1042231507 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f055814e4b0 0x7f05400044d0 secure :-1 s=READY pgs=8 cs=0 l=1 rx=0x7f054c0013e0 tx=0x7f054c00c2e0).stop 2020-04-02T23:21:24.162 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.138+0000 7f055759e700 1 -- 172.21.15.174:0/1042231507 reap_dead start 2020-04-02T23:21:24.163 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.138+0000 7f055ca58700 1 -- 172.21.15.174:0/1042231507 shutdown_connections 2020-04-02T23:21:24.163 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.138+0000 7f055ca58700 1 -- 172.21.15.174:0/1042231507 >> 172.21.15.174:0/1042231507 conn(0x7f05580a6d00 msgr2=0x7f05580a7110 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:24.163 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.138+0000 7f055ca58700 1 -- 172.21.15.174:0/1042231507 shutdown_connections 2020-04-02T23:21:24.163 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.138+0000 7f055ca58700 1 -- 172.21.15.174:0/1042231507 wait complete. 2020-04-02T23:21:24.163 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.139+0000 7f055ca58700 1 Processor -- start 2020-04-02T23:21:24.163 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.139+0000 7f055ca58700 1 -- start start 2020-04-02T23:21:24.165 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.140+0000 7f055ca58700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f05581274f0 0x7f055807a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:24.165 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.140+0000 7f055ca58700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f055809c360 0x7f055809c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:24.165 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.140+0000 7f055ca58700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f055807c3b0 con 0x7f055807cb60 2020-04-02T23:21:24.165 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.140+0000 7f055ca58700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f055807c770 con 0x7f05581274f0 2020-04-02T23:21:24.165 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.140+0000 7f055ca58700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f055807cfc0 con 0x7f055809c360 2020-04-02T23:21:24.165 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.140+0000 7f0556d9d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f05581274f0 0x7f055807a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:24.166 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.140+0000 7f0556d9d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f05581274f0 0x7f055807a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:39116/0 (socket says 172.21.15.174:39116) 2020-04-02T23:21:24.166 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.140+0000 7f0556d9d700 1 -- 172.21.15.174:0/3289318921 learned_addr learned my addr 172.21.15.174:0/3289318921 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:21:24.166 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.140+0000 7f055659c700 1 --1- 172.21.15.174:0/3289318921 >> v1:172.21.15.174:6789/0 conn(0x7f055807cb60 0x7f055809bc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:44156/0 (socket says 172.21.15.174:44156) 2020-04-02T23:21:24.166 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.140+0000 7f055759e700 1 --2- 172.21.15.174:0/3289318921 >> v2:172.21.15.196:3300/0 conn(0x7f055809c360 0x7f055809c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:24.166 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.140+0000 7f0556d9d700 1 -- 172.21.15.174:0/3289318921 >> v2:172.21.15.196:3300/0 conn(0x7f055809c360 msgr2=0x7f055809c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:24.167 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.140+0000 7f0556d9d700 1 --2- 172.21.15.174:0/3289318921 >> v2:172.21.15.196:3300/0 conn(0x7f055809c360 0x7f055809c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:24.167 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.140+0000 7f0556d9d700 1 -- 172.21.15.174:0/3289318921 >> v1:172.21.15.174:6789/0 conn(0x7f055807cb60 legacy=0x7f055809bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:24.167 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.140+0000 7f05477fe700 1 -- 172.21.15.174:0/3289318921 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3270493524 0 0) 0x7f055807c3b0 con 0x7f055807cb60 2020-04-02T23:21:24.168 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.140+0000 7f0556d9d700 1 -- 172.21.15.174:0/3289318921 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05580a7a30 con 0x7f05581274f0 2020-04-02T23:21:24.170 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.140+0000 7f0556d9d700 1 --2- 172.21.15.174:0/3289318921 >> v2:172.21.15.174:3300/0 conn(0x7f05581274f0 0x7f055807a930 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0548001170 tx=0x7f054800c4e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:24.170 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.140+0000 7f0556d9d700 1 --2- 172.21.15.174:0/3289318921 >> v2:172.21.15.174:3300/0 conn(0x7f05581274f0 0x7f055807a930 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0548001170 tx=0x7f054800c4e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:24.170 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.140+0000 7f0556d9d700 1 --2- 172.21.15.174:0/3289318921 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f05581274f0 0x7f055807a930 secure :-1 s=READY pgs=18 cs=0 l=1 rx=0x7f0548001170 tx=0x7f054800c4e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:24.170 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.141+0000 7f0556d9d700 1 --2- 172.21.15.174:0/3289318921 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f05581274f0 0x7f055807a930 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7f0548001170 tx=0x7f054800c4e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:24.170 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.141+0000 7f05477fe700 1 -- 172.21.15.174:0/3289318921 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f054800cc20 con 0x7f05581274f0 2020-04-02T23:21:24.170 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.141+0000 7f0556d9d700 1 --2- 172.21.15.174:0/3289318921 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f05581274f0 0x7f055807a930 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7f0548001170 tx=0x7f054800c4e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:24.171 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.141+0000 7f0556d9d700 1 --2- 172.21.15.174:0/3289318921 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f05581274f0 0x7f055807a930 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7f0548001170 tx=0x7f054800c4e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:24.171 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.141+0000 7f05477fe700 1 -- 172.21.15.174:0/3289318921 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f054800cd80 con 0x7f05581274f0 2020-04-02T23:21:24.171 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.141+0000 7f055ca58700 1 -- 172.21.15.174:0/3289318921 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f055809d8d0 con 0x7f05581274f0 2020-04-02T23:21:24.171 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.141+0000 7f05477fe700 1 -- 172.21.15.174:0/3289318921 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0548012620 con 0x7f05581274f0 2020-04-02T23:21:24.171 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.141+0000 7f055ca58700 1 -- 172.21.15.174:0/3289318921 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f055809d530 con 0x7f05581274f0 2020-04-02T23:21:24.171 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.141+0000 7f0556d9d700 1 --2- 172.21.15.174:0/3289318921 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f05581274f0 0x7f055807a930 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7f0548001170 tx=0x7f054800c4e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:24.172 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.142+0000 7f05477fe700 1 -- 172.21.15.174:0/3289318921 <== mon.0 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 59405+0+0 (secure 0 0 0) 0x7f0548012780 con 0x7f05581274f0 2020-04-02T23:21:24.172 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.142+0000 7f0556d9d700 1 --2- 172.21.15.174:0/3289318921 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f05581274f0 0x7f055807a930 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7f0548001170 tx=0x7f054800c4e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:24.172 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.142+0000 7f055ca58700 1 -- 172.21.15.174:0/3289318921 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0558056c50 con 0x7f05581274f0 2020-04-02T23:21:24.172 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.142+0000 7f05477fe700 1 --2- 172.21.15.174:0/3289318921 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f053c04d470 0x7f053c04f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:24.172 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.142+0000 7f05477fe700 1 -- 172.21.15.174:0/3289318921 <== mon.0 v2:172.21.15.174:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1269+0+0 (secure 0 0 0) 0x7f0548060db0 con 0x7f05581274f0 2020-04-02T23:21:24.173 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.142+0000 7f055659c700 1 --2- 172.21.15.174:0/3289318921 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f053c04d470 0x7f053c04f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:24.173 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.142+0000 7f055659c700 1 --2- 172.21.15.174:0/3289318921 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f053c04d470 0x7f053c04f930 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f054c00efa0 tx=0x7f054c00c2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:24.173 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.142+0000 7f055659c700 1 --2- 172.21.15.174:0/3289318921 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f053c04d470 0x7f053c04f930 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f054c00efa0 tx=0x7f054c00c2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:24.173 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.142+0000 7f055659c700 1 --2- 172.21.15.174:0/3289318921 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f053c04d470 0x7f053c04f930 secure :-1 s=READY pgs=10 cs=0 l=1 rx=0x7f054c00efa0 tx=0x7f054c00c2e0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:24.174 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.145+0000 7f0556d9d700 1 --2- 172.21.15.174:0/3289318921 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f05581274f0 0x7f055807a930 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7f0548001170 tx=0x7f054800c4e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:24.177 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.145+0000 7f05477fe700 1 -- 172.21.15.174:0/3289318921 <== mon.0 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f054803c590 con 0x7f05581274f0 2020-04-02T23:21:24.307 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.305+0000 7f055ca58700 1 -- 172.21.15.174:0/3289318921 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd new", "uuid": "27c05faf-11f5-4cef-9bde-1a6653a9e533", "id": 1} v 0) v1 -- 0x7f05580a5b40 con 0x7f05581274f0 2020-04-02T23:21:24.313 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.310+0000 7f0556d9d700 1 --2- 172.21.15.174:0/3289318921 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f05581274f0 0x7f055807a930 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7f0548001170 tx=0x7f054800c4e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:24.313 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.310+0000 7f05477fe700 1 -- 172.21.15.174:0/3289318921 <== mon.0 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "27c05faf-11f5-4cef-9bde-1a6653a9e533", "id": 1}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f054803fbb0 con 0x7f05581274f0 2020-04-02T23:21:24.313 INFO:teuthology.orchestra.run.smithi174.stdout:1 2020-04-02T23:21:24.315 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.312+0000 7f055ca58700 1 -- 172.21.15.174:0/3289318921 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f053c04d470 msgr2=0x7f053c04f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:24.315 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.312+0000 7f055ca58700 1 --2- 172.21.15.174:0/3289318921 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f053c04d470 0x7f053c04f930 secure :-1 s=READY pgs=10 cs=0 l=1 rx=0x7f054c00efa0 tx=0x7f054c00c2e0).stop 2020-04-02T23:21:24.315 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.312+0000 7f055ca58700 1 -- 172.21.15.174:0/3289318921 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f05581274f0 msgr2=0x7f055807a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:24.316 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.312+0000 7f055ca58700 1 --2- 172.21.15.174:0/3289318921 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f05581274f0 0x7f055807a930 secure :-1 s=READY pgs=18 cs=0 l=1 rx=0x7f0548001170 tx=0x7f054800c4e0).stop 2020-04-02T23:21:24.316 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.312+0000 7f055ca58700 1 -- 172.21.15.174:0/3289318921 shutdown_connections 2020-04-02T23:21:24.316 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.312+0000 7f055ca58700 1 --2- 172.21.15.174:0/3289318921 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f053c04d470 0x7f053c04f930 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:24.316 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.312+0000 7f055ca58700 1 --2- 172.21.15.174:0/3289318921 >> v2:172.21.15.196:3300/0 conn(0x7f055809c360 0x7f055809c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:24.316 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.312+0000 7f055ca58700 1 --2- 172.21.15.174:0/3289318921 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f05581274f0 0x7f055807a930 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:24.316 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.312+0000 7f055ca58700 1 -- 172.21.15.174:0/3289318921 >> 172.21.15.174:0/3289318921 conn(0x7f05580a6d00 msgr2=0x7f055807e700 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:24.317 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.312+0000 7f055ca58700 1 -- 172.21.15.174:0/3289318921 shutdown_connections 2020-04-02T23:21:24.317 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.312+0000 7f055ca58700 1 -- 172.21.15.174:0/3289318921 wait complete. 2020-04-02T23:21:24.325 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:24.338 INFO:teuthology.orchestra.run.smithi174:> sudo ceph --cluster ceph osd new 02b1b455-b518-4393-b257-40c3a76af157 2 2020-04-02T23:21:24.502 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.479+0000 7f66aa727700 1 Processor -- start 2020-04-02T23:21:24.502 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.479+0000 7f66aa727700 1 -- start start 2020-04-02T23:21:24.503 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.480+0000 7f66aa727700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f66a405bdd0 0x7f66a40a3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:24.503 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.480+0000 7f66aa727700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66a40a6440 con 0x7f66a40a5240 2020-04-02T23:21:24.503 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.480+0000 7f66aa727700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66a40a66e0 con 0x7f66a40a4380 2020-04-02T23:21:24.503 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.480+0000 7f66aa727700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66a40a3a60 con 0x7f66a405bdd0 2020-04-02T23:21:24.503 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.480+0000 7f66a94c5700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f66a40a5240 0x7f66a414f9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:44164/0 (socket says 172.21.15.174:44164) 2020-04-02T23:21:24.503 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.480+0000 7f66a94c5700 1 -- 172.21.15.174:0/4220669406 learned_addr learned my addr 172.21.15.174:0/4220669406 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:21:24.504 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.480+0000 7f66a8cc4700 1 --2- 172.21.15.174:0/4220669406 >> v2:172.21.15.196:3300/0 conn(0x7f66a405bdd0 0x7f66a40a3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:24.504 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.480+0000 7f66a37fe700 1 -- 172.21.15.174:0/4220669406 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3903399607 0 0) 0x7f66a40a6440 con 0x7f66a40a5240 2020-04-02T23:21:24.504 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.480+0000 7f66a37fe700 1 -- 172.21.15.174:0/4220669406 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f668c003230 con 0x7f66a40a5240 2020-04-02T23:21:24.504 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.480+0000 7f66a37fe700 1 -- 172.21.15.174:0/4220669406 <== mon.0 v1:172.21.15.174:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 929008441 0 0) 0x7f668c003230 con 0x7f66a40a5240 2020-04-02T23:21:24.504 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.480+0000 7f66a37fe700 1 -- 172.21.15.174:0/4220669406 >> v2:172.21.15.196:3300/0 conn(0x7f66a405bdd0 msgr2=0x7f66a40a3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:24.504 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.480+0000 7f66a37fe700 1 --2- 172.21.15.174:0/4220669406 >> v2:172.21.15.196:3300/0 conn(0x7f66a405bdd0 0x7f66a40a3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:24.505 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.480+0000 7f66a37fe700 1 -- 172.21.15.174:0/4220669406 >> v1:172.21.15.196:6789/0 conn(0x7f66a40a4380 legacy=0x7f66a40a4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:24.505 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.480+0000 7f66a37fe700 1 -- 172.21.15.174:0/4220669406 --> v1:172.21.15.174:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a40a6980 con 0x7f66a40a5240 2020-04-02T23:21:24.505 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.480+0000 7f66a37fe700 1 -- 172.21.15.174:0/4220669406 <== mon.0 v1:172.21.15.174:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2811762909 0 0) 0x7f66940016d0 con 0x7f66a40a5240 2020-04-02T23:21:24.505 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.480+0000 7f66a37fe700 1 -- 172.21.15.174:0/4220669406 >> v1:172.21.15.174:6789/0 conn(0x7f66a40a5240 legacy=0x7f66a414f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:24.505 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.480+0000 7f66a37fe700 1 --2- 172.21.15.174:0/4220669406 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f668c003720 0x7f668c003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:24.505 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.480+0000 7f66a37fe700 1 --2- 172.21.15.174:0/4220669406 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f668c0044d0 0x7f668c004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:24.506 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.480+0000 7f66a37fe700 1 --2- 172.21.15.174:0/4220669406 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f668c004db0 0x7f668c00b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:24.506 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.480+0000 7f66a37fe700 1 -- 172.21.15.174:0/4220669406 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a40a3a60 con 0x7f668c003720 2020-04-02T23:21:24.506 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.480+0000 7f66a37fe700 1 -- 172.21.15.174:0/4220669406 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f668c0041c0 con 0x7f668c004db0 2020-04-02T23:21:24.506 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.480+0000 7f66a8cc4700 1 --2- 172.21.15.174:0/4220669406 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f668c003720 0x7f668c003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:24.506 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.480+0000 7f66a37fe700 1 -- 172.21.15.174:0/4220669406 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f668c04fb90 con 0x7f668c0044d0 2020-04-02T23:21:24.512 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.480+0000 7f66a3fff700 1 --2- 172.21.15.174:0/4220669406 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f668c0044d0 0x7f668c004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:24.513 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.480+0000 7f66a94c5700 1 --2- 172.21.15.174:0/4220669406 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f668c004db0 0x7f668c00b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:24.513 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.481+0000 7f66a8cc4700 1 -- 172.21.15.174:0/4220669406 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f668c0044d0 msgr2=0x7f668c004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:24.513 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.481+0000 7f66a8cc4700 1 --2- 172.21.15.174:0/4220669406 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f668c0044d0 0x7f668c004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:24.513 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.481+0000 7f66a8cc4700 1 -- 172.21.15.174:0/4220669406 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f668c004db0 msgr2=0x7f668c00b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:24.513 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.481+0000 7f66a8cc4700 1 --2- 172.21.15.174:0/4220669406 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f668c004db0 0x7f668c00b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:24.514 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.481+0000 7f66a8cc4700 1 -- 172.21.15.174:0/4220669406 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f668c003230 con 0x7f668c003720 2020-04-02T23:21:24.514 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.481+0000 7f66a94c5700 1 --2- 172.21.15.174:0/4220669406 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f668c004db0 0x7f668c00b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-02T23:21:24.514 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.481+0000 7f66a94c5700 1 -- 172.21.15.174:0/4220669406 reap_dead start 2020-04-02T23:21:24.514 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.481+0000 7f66a8cc4700 1 --2- 172.21.15.174:0/4220669406 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f668c003720 0x7f668c003b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f669c0032b0 tx=0x7f669c010400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:24.514 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.481+0000 7f66a8cc4700 1 --2- 172.21.15.174:0/4220669406 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f668c003720 0x7f668c003b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f669c0032b0 tx=0x7f669c010400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:24.514 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.481+0000 7f66a8cc4700 1 --2- 172.21.15.174:0/4220669406 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f668c003720 0x7f668c003b40 secure :-1 s=READY pgs=20 cs=0 l=1 rx=0x7f669c0032b0 tx=0x7f669c010400).ready entity=mon.0 client_cookie=ebe152cefc85a0ed server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:24.514 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.481+0000 7f66a8cc4700 1 --2- 172.21.15.174:0/4220669406 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f668c003720 0x7f668c003b40 secure :-1 s=THROTTLE_DONE pgs=20 cs=0 l=1 rx=0x7f669c0032b0 tx=0x7f669c010400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:24.515 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.481+0000 7f66a8cc4700 1 --2- 172.21.15.174:0/4220669406 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f668c003720 0x7f668c003b40 secure :-1 s=THROTTLE_DONE pgs=20 cs=0 l=1 rx=0x7f669c0032b0 tx=0x7f669c010400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:24.515 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.481+0000 7f66a37fe700 1 -- 172.21.15.174:0/4220669406 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f669c005c30 con 0x7f668c003720 2020-04-02T23:21:24.515 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.481+0000 7f66a8cc4700 1 --2- 172.21.15.174:0/4220669406 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f668c003720 0x7f668c003b40 secure :-1 s=THROTTLE_DONE pgs=20 cs=0 l=1 rx=0x7f669c0032b0 tx=0x7f669c010400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:24.515 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.481+0000 7f66a37fe700 1 -- 172.21.15.174:0/4220669406 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f669c005d90 con 0x7f668c003720 2020-04-02T23:21:24.515 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.481+0000 7f66a37fe700 1 -- 172.21.15.174:0/4220669406 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f669c0112d0 con 0x7f668c003720 2020-04-02T23:21:24.516 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.481+0000 7f66aa727700 1 -- 172.21.15.174:0/4220669406 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f668c003720 msgr2=0x7f668c003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:24.516 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.481+0000 7f66aa727700 1 --2- 172.21.15.174:0/4220669406 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f668c003720 0x7f668c003b40 secure :-1 s=READY pgs=20 cs=0 l=1 rx=0x7f669c0032b0 tx=0x7f669c010400).stop 2020-04-02T23:21:24.516 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.481+0000 7f66aa727700 1 -- 172.21.15.174:0/4220669406 shutdown_connections 2020-04-02T23:21:24.516 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.481+0000 7f66aa727700 1 --2- 172.21.15.174:0/4220669406 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f668c003720 0x7f668c003b40 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:24.516 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.481+0000 7f66aa727700 1 -- 172.21.15.174:0/4220669406 >> 172.21.15.174:0/4220669406 conn(0x7f66a40a6d00 msgr2=0x7f66a40a7110 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:24.516 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.481+0000 7f66aa727700 1 -- 172.21.15.174:0/4220669406 shutdown_connections 2020-04-02T23:21:24.516 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.481+0000 7f66aa727700 1 -- 172.21.15.174:0/4220669406 wait complete. 2020-04-02T23:21:24.517 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.482+0000 7f66aa727700 1 Processor -- start 2020-04-02T23:21:24.517 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.482+0000 7f66aa727700 1 -- start start 2020-04-02T23:21:24.517 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.483+0000 7f66aa727700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f66a4066640 0x7f66a4131620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:24.517 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.483+0000 7f66aa727700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66a40a7a30 con 0x7f66a409cd30 2020-04-02T23:21:24.517 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.483+0000 7f66aa727700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66a4063020 con 0x7f668c003720 2020-04-02T23:21:24.517 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.483+0000 7f66aa727700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66a4062e30 con 0x7f66a4066640 2020-04-02T23:21:24.518 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.483+0000 7f66a94c5700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f66a409cd30 0x7f66a413bf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:44180/0 (socket says 172.21.15.174:44180) 2020-04-02T23:21:24.520 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.483+0000 7f66a94c5700 1 -- 172.21.15.174:0/2812482781 learned_addr learned my addr 172.21.15.174:0/2812482781 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:21:24.520 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.483+0000 7f66a3fff700 1 --2- 172.21.15.174:0/2812482781 >> v2:172.21.15.196:3300/0 conn(0x7f66a4066640 0x7f66a4131620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:24.521 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.483+0000 7f66a17fa700 1 -- 172.21.15.174:0/2812482781 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3570414748 0 0) 0x7f66a40a7a30 con 0x7f66a409cd30 2020-04-02T23:21:24.521 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.483+0000 7f66a17fa700 1 -- 172.21.15.174:0/2812482781 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6684003230 con 0x7f66a409cd30 2020-04-02T23:21:24.521 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.483+0000 7f66a17fa700 1 -- 172.21.15.174:0/2812482781 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2582983702 0 0) 0x7f66a4063020 con 0x7f668c003720 2020-04-02T23:21:24.522 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.483+0000 7f66a17fa700 1 -- 172.21.15.174:0/2812482781 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66a40a7a30 con 0x7f668c003720 2020-04-02T23:21:24.522 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.484+0000 7f66a17fa700 1 -- 172.21.15.174:0/2812482781 <== mon.0 v1:172.21.15.174:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3747580193 0 0) 0x7f6684003230 con 0x7f66a409cd30 2020-04-02T23:21:24.522 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.484+0000 7f66a17fa700 1 -- 172.21.15.174:0/2812482781 --> v1:172.21.15.174:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f66a4063020 con 0x7f66a409cd30 2020-04-02T23:21:24.522 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.484+0000 7f66a17fa700 1 -- 172.21.15.174:0/2812482781 <== mon.0 v1:172.21.15.174:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2811762909 0 0) 0x7f6694000e50 con 0x7f66a409cd30 2020-04-02T23:21:24.522 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.484+0000 7f66a3fff700 1 -- 172.21.15.174:0/2812482781 >> v1:172.21.15.196:6789/0 conn(0x7f668c003720 legacy=0x7f66a4061990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:24.522 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.484+0000 7f66a3fff700 1 -- 172.21.15.174:0/2812482781 >> v1:172.21.15.174:6789/0 conn(0x7f66a409cd30 legacy=0x7f66a413bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:24.522 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.484+0000 7f66a3fff700 1 -- 172.21.15.174:0/2812482781 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a40632c0 con 0x7f66a4066640 2020-04-02T23:21:24.523 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.484+0000 7f66a3fff700 1 --2- 172.21.15.174:0/2812482781 >> v2:172.21.15.196:3300/0 conn(0x7f66a4066640 0x7f66a4131620 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f66a40a3d20 tx=0x7f6698010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:24.523 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.484+0000 7f66a3fff700 1 --2- 172.21.15.174:0/2812482781 >> v2:172.21.15.196:3300/0 conn(0x7f66a4066640 0x7f66a4131620 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f66a40a3d20 tx=0x7f6698010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:24.523 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.484+0000 7f66a3fff700 1 --2- 172.21.15.174:0/2812482781 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f66a4066640 0x7f66a4131620 secure :-1 s=READY pgs=25 cs=0 l=1 rx=0x7f66a40a3d20 tx=0x7f6698010960).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:24.523 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.484+0000 7f66a3fff700 1 --2- 172.21.15.174:0/2812482781 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f66a4066640 0x7f66a4131620 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7f66a40a3d20 tx=0x7f6698010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:24.523 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.484+0000 7f66a17fa700 1 -- 172.21.15.174:0/2812482781 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f669800c9e0 con 0x7f66a4066640 2020-04-02T23:21:24.524 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.484+0000 7f66a3fff700 1 --2- 172.21.15.174:0/2812482781 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f66a4066640 0x7f66a4131620 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7f66a40a3d20 tx=0x7f6698010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:24.524 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.484+0000 7f66a3fff700 1 --2- 172.21.15.174:0/2812482781 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f66a4066640 0x7f66a4131620 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7f66a40a3d20 tx=0x7f6698010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:24.525 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.484+0000 7f66a17fa700 1 -- 172.21.15.174:0/2812482781 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6698011e90 con 0x7f66a4066640 2020-04-02T23:21:24.525 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.484+0000 7f66aa727700 1 -- 172.21.15.174:0/2812482781 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66a409d200 con 0x7f66a4066640 2020-04-02T23:21:24.525 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.484+0000 7f66a17fa700 1 -- 172.21.15.174:0/2812482781 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f669800cd30 con 0x7f66a4066640 2020-04-02T23:21:24.525 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.484+0000 7f66aa727700 1 -- 172.21.15.174:0/2812482781 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66a4062260 con 0x7f66a4066640 2020-04-02T23:21:24.525 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.485+0000 7f66a3fff700 1 --2- 172.21.15.174:0/2812482781 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f66a4066640 0x7f66a4131620 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7f66a40a3d20 tx=0x7f6698010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:24.525 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.485+0000 7f66aa727700 1 -- 172.21.15.174:0/2812482781 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66a4062570 con 0x7f66a4066640 2020-04-02T23:21:24.525 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.485+0000 7f66a17fa700 1 -- 172.21.15.174:0/2812482781 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 3) v1 ==== 59405+0+0 (secure 0 0 0) 0x7f66980064e0 con 0x7f66a4066640 2020-04-02T23:21:24.526 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.485+0000 7f66a3fff700 1 --2- 172.21.15.174:0/2812482781 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f66a4066640 0x7f66a4131620 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7f66a40a3d20 tx=0x7f6698010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:24.526 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.485+0000 7f66a17fa700 1 --2- 172.21.15.174:0/2812482781 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f668404dc20 0x7f66840500e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:24.526 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.485+0000 7f66a17fa700 1 -- 172.21.15.174:0/2812482781 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1384+0+0 (secure 0 0 0) 0x7f6698060460 con 0x7f66a4066640 2020-04-02T23:21:24.526 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.485+0000 7f66a8cc4700 1 --2- 172.21.15.174:0/2812482781 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f668404dc20 0x7f66840500e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:24.527 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.486+0000 7f66a8cc4700 1 --2- 172.21.15.174:0/2812482781 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f668404dc20 0x7f66840500e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f669c010fc0 tx=0x7f669c010400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:24.527 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.486+0000 7f66a8cc4700 1 --2- 172.21.15.174:0/2812482781 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f668404dc20 0x7f66840500e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f669c010fc0 tx=0x7f669c010400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:24.527 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.486+0000 7f66a8cc4700 1 --2- 172.21.15.174:0/2812482781 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f668404dc20 0x7f66840500e0 secure :-1 s=READY pgs=12 cs=0 l=1 rx=0x7f669c010fc0 tx=0x7f669c010400).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:24.527 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.489+0000 7f66a3fff700 1 --2- 172.21.15.174:0/2812482781 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f66a4066640 0x7f66a4131620 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7f66a40a3d20 tx=0x7f6698010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:24.527 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.489+0000 7f66a17fa700 1 -- 172.21.15.174:0/2812482781 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f669803bca0 con 0x7f66a4066640 2020-04-02T23:21:24.644 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.641+0000 7f66aa727700 1 -- 172.21.15.174:0/2812482781 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd new", "uuid": "02b1b455-b518-4393-b257-40c3a76af157", "id": 2} v 0) v1 -- 0x7f66a4056c50 con 0x7f66a4066640 2020-04-02T23:21:24.649 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.646+0000 7f66a3fff700 1 --2- 172.21.15.174:0/2812482781 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f66a4066640 0x7f66a4131620 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7f66a40a3d20 tx=0x7f6698010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:24.649 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.646+0000 7f66a17fa700 1 -- 172.21.15.174:0/2812482781 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "02b1b455-b518-4393-b257-40c3a76af157", "id": 2}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f669803f2c0 con 0x7f66a4066640 2020-04-02T23:21:24.649 INFO:teuthology.orchestra.run.smithi174.stdout:2 2020-04-02T23:21:24.651 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.648+0000 7f66aa727700 1 -- 172.21.15.174:0/2812482781 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f668404dc20 msgr2=0x7f66840500e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:24.651 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.648+0000 7f66aa727700 1 --2- 172.21.15.174:0/2812482781 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f668404dc20 0x7f66840500e0 secure :-1 s=READY pgs=12 cs=0 l=1 rx=0x7f669c010fc0 tx=0x7f669c010400).stop 2020-04-02T23:21:24.651 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.648+0000 7f66aa727700 1 -- 172.21.15.174:0/2812482781 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f66a4066640 msgr2=0x7f66a4131620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:24.651 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.648+0000 7f66aa727700 1 --2- 172.21.15.174:0/2812482781 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f66a4066640 0x7f66a4131620 secure :-1 s=READY pgs=25 cs=0 l=1 rx=0x7f66a40a3d20 tx=0x7f6698010960).stop 2020-04-02T23:21:24.651 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.648+0000 7f66aa727700 1 -- 172.21.15.174:0/2812482781 shutdown_connections 2020-04-02T23:21:24.651 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.648+0000 7f66aa727700 1 --2- 172.21.15.174:0/2812482781 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f668404dc20 0x7f66840500e0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:24.652 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.648+0000 7f66aa727700 1 --2- 172.21.15.174:0/2812482781 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f66a4066640 0x7f66a4131620 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:24.652 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.648+0000 7f66aa727700 1 -- 172.21.15.174:0/2812482781 >> 172.21.15.174:0/2812482781 conn(0x7f66a40a6d00 msgr2=0x7f66a40a9270 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:24.652 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.648+0000 7f66aa727700 1 -- 172.21.15.174:0/2812482781 shutdown_connections 2020-04-02T23:21:24.652 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.648+0000 7f66aa727700 1 -- 172.21.15.174:0/2812482781 wait complete. 2020-04-02T23:21:24.660 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:24.673 INFO:teuthology.orchestra.run.smithi174:> sudo ceph --cluster ceph osd new d7fb3499-9e13-4076-b3cf-28f27eb62967 3 2020-04-02T23:21:24.819 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.814+0000 7f909ea4f700 1 Processor -- start 2020-04-02T23:21:24.819 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.814+0000 7f909ea4f700 1 -- start start 2020-04-02T23:21:24.819 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.814+0000 7f909ea4f700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f909805bdd0 0x7f90980a3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:24.819 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.814+0000 7f909ea4f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f90980a4380 0x7f90980a4b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:24.820 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.814+0000 7f909ea4f700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90980a6440 con 0x7f90980a4f90 2020-04-02T23:21:24.820 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.814+0000 7f909ea4f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90980a3a60 con 0x7f90980a4380 2020-04-02T23:21:24.820 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.814+0000 7f909ea4f700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90980a66e0 con 0x7f909805bdd0 2020-04-02T23:21:24.820 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.814+0000 7f9097fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f90980a4380 0x7f90980a4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:24.820 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.815+0000 7f9097fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f90980a4380 0x7f90980a4b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:39146/0 (socket says 172.21.15.174:39146) 2020-04-02T23:21:24.820 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.815+0000 7f9097fff700 1 -- 172.21.15.174:0/1101599143 learned_addr learned my addr 172.21.15.174:0/1101599143 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:21:24.820 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.815+0000 7f909cfec700 1 --2- 172.21.15.174:0/1101599143 >> v2:172.21.15.196:3300/0 conn(0x7f909805bdd0 0x7f90980a3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:24.821 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.815+0000 7f9097fff700 1 -- 172.21.15.174:0/1101599143 >> v2:172.21.15.196:3300/0 conn(0x7f909805bdd0 msgr2=0x7f90980a3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:24.822 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.815+0000 7f9097fff700 1 --2- 172.21.15.174:0/1101599143 >> v2:172.21.15.196:3300/0 conn(0x7f909805bdd0 0x7f90980a3f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:24.822 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.815+0000 7f9097fff700 1 -- 172.21.15.174:0/1101599143 >> v1:172.21.15.196:6789/0 conn(0x7f90980a4f90 legacy=0x7f90980a5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:24.822 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.815+0000 7f9097fff700 1 -- 172.21.15.174:0/1101599143 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90980a6980 con 0x7f90980a4380 2020-04-02T23:21:24.822 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.815+0000 7f9097fff700 1 --2- 172.21.15.174:0/1101599143 >> v2:172.21.15.174:3300/0 conn(0x7f90980a4380 0x7f90980a4b30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f90980a3ce0 tx=0x7f9080007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:24.822 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.815+0000 7f9097fff700 1 --2- 172.21.15.174:0/1101599143 >> v2:172.21.15.174:3300/0 conn(0x7f90980a4380 0x7f90980a4b30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f90980a3ce0 tx=0x7f9080007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:24.823 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.815+0000 7f9097fff700 1 --2- 172.21.15.174:0/1101599143 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f90980a4380 0x7f90980a4b30 secure :-1 s=READY pgs=22 cs=0 l=1 rx=0x7f90980a3ce0 tx=0x7f9080007a40).ready entity=mon.0 client_cookie=bcc7a82e3cc937c6 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:24.823 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.815+0000 7f9097fff700 1 --2- 172.21.15.174:0/1101599143 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f90980a4380 0x7f90980a4b30 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7f90980a3ce0 tx=0x7f9080007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:24.823 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.815+0000 7f90977fe700 1 -- 172.21.15.174:0/1101599143 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90800116e0 con 0x7f90980a4380 2020-04-02T23:21:24.823 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.815+0000 7f9097fff700 1 --2- 172.21.15.174:0/1101599143 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f90980a4380 0x7f90980a4b30 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7f90980a3ce0 tx=0x7f9080007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:24.823 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.815+0000 7f9097fff700 1 --2- 172.21.15.174:0/1101599143 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f90980a4380 0x7f90980a4b30 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7f90980a3ce0 tx=0x7f9080007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:24.823 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.815+0000 7f90977fe700 1 -- 172.21.15.174:0/1101599143 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9080011840 con 0x7f90980a4380 2020-04-02T23:21:24.823 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.815+0000 7f90977fe700 1 -- 172.21.15.174:0/1101599143 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9080011c20 con 0x7f90980a4380 2020-04-02T23:21:24.823 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.815+0000 7f909ea4f700 1 -- 172.21.15.174:0/1101599143 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f90980a4380 msgr2=0x7f90980a4b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:24.824 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.815+0000 7f909ea4f700 1 --2- 172.21.15.174:0/1101599143 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f90980a4380 0x7f90980a4b30 secure :-1 s=READY pgs=22 cs=0 l=1 rx=0x7f90980a3ce0 tx=0x7f9080007a40).stop 2020-04-02T23:21:24.824 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.816+0000 7f909ea4f700 1 -- 172.21.15.174:0/1101599143 shutdown_connections 2020-04-02T23:21:24.824 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.816+0000 7f909ea4f700 1 --2- 172.21.15.174:0/1101599143 >> v2:172.21.15.196:3300/0 conn(0x7f909805bdd0 0x7f90980a3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:24.824 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.816+0000 7f909ea4f700 1 --2- 172.21.15.174:0/1101599143 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f90980a4380 0x7f90980a4b30 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:24.824 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.816+0000 7f909ea4f700 1 -- 172.21.15.174:0/1101599143 >> 172.21.15.174:0/1101599143 conn(0x7f90980a6d00 msgr2=0x7f90980a7110 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:24.824 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.816+0000 7f909ea4f700 1 -- 172.21.15.174:0/1101599143 shutdown_connections 2020-04-02T23:21:24.824 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.816+0000 7f909ea4f700 1 -- 172.21.15.174:0/1101599143 wait complete. 2020-04-02T23:21:24.828 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.817+0000 7f909ea4f700 1 Processor -- start 2020-04-02T23:21:24.828 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.817+0000 7f909ea4f700 1 -- start start 2020-04-02T23:21:24.829 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.818+0000 7f909ea4f700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f909805bdd0 0x7f909807f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:24.829 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.818+0000 7f909ea4f700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f90980a4380 0x7f909807c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:24.829 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.818+0000 7f909ea4f700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f909805b7b0 con 0x7f90980a4f90 2020-04-02T23:21:24.830 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.818+0000 7f909ea4f700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90981214b0 con 0x7f90980a4380 2020-04-02T23:21:24.830 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.818+0000 7f909ea4f700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9098121750 con 0x7f909805bdd0 2020-04-02T23:21:24.830 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.818+0000 7f9097fff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f90980a4380 0x7f909807c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:24.830 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.818+0000 7f909d7ed700 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f90980a4f90 0x7f90980a0360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.174:50286/0 (socket says 172.21.15.174:50286) 2020-04-02T23:21:24.830 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.818+0000 7f909d7ed700 1 -- 172.21.15.174:0/1188456749 learned_addr learned my addr 172.21.15.174:0/1188456749 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:21:24.830 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.818+0000 7f909cfec700 1 --2- 172.21.15.174:0/1188456749 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f909805bdd0 0x7f909807f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:24.831 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.818+0000 7f90957fa700 1 -- 172.21.15.174:0/1188456749 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3928483470 0 0) 0x7f909805b7b0 con 0x7f90980a4f90 2020-04-02T23:21:24.831 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.818+0000 7f90957fa700 1 -- 172.21.15.174:0/1188456749 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f907c003230 con 0x7f90980a4f90 2020-04-02T23:21:24.831 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.818+0000 7f909cfec700 1 -- 172.21.15.174:0/1188456749 >> v2:172.21.15.196:3300/0 conn(0x7f90980a4380 msgr2=0x7f909807c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:24.831 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.818+0000 7f909cfec700 1 --2- 172.21.15.174:0/1188456749 >> v2:172.21.15.196:3300/0 conn(0x7f90980a4380 0x7f909807c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:24.831 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.818+0000 7f909cfec700 1 -- 172.21.15.174:0/1188456749 >> v1:172.21.15.196:6789/0 conn(0x7f90980a4f90 legacy=0x7f90980a0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:24.831 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.818+0000 7f909cfec700 1 -- 172.21.15.174:0/1188456749 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90981219f0 con 0x7f909805bdd0 2020-04-02T23:21:24.832 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.818+0000 7f909cfec700 1 --2- 172.21.15.174:0/1188456749 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f909805bdd0 0x7f909807f670 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9088002f30 tx=0x7f9088010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:24.832 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.818+0000 7f909cfec700 1 --2- 172.21.15.174:0/1188456749 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f909805bdd0 0x7f909807f670 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9088002f30 tx=0x7f9088010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:24.832 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.818+0000 7f909cfec700 1 --2- 172.21.15.174:0/1188456749 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f909805bdd0 0x7f909807f670 secure :-1 s=READY pgs=9 cs=0 l=1 rx=0x7f9088002f30 tx=0x7f9088010980).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:24.832 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.818+0000 7f909cfec700 1 --2- 172.21.15.174:0/1188456749 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f909805bdd0 0x7f909807f670 secure :-1 s=THROTTLE_DONE pgs=9 cs=0 l=1 rx=0x7f9088002f30 tx=0x7f9088010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:24.833 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.818+0000 7f90957fa700 1 -- 172.21.15.174:0/1188456749 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9088008e30 con 0x7f909805bdd0 2020-04-02T23:21:24.833 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.818+0000 7f909cfec700 1 --2- 172.21.15.174:0/1188456749 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f909805bdd0 0x7f909807f670 secure :-1 s=THROTTLE_DONE pgs=9 cs=0 l=1 rx=0x7f9088002f30 tx=0x7f9088010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:24.833 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.819+0000 7f909cfec700 1 --2- 172.21.15.174:0/1188456749 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f909805bdd0 0x7f909807f670 secure :-1 s=THROTTLE_DONE pgs=9 cs=0 l=1 rx=0x7f9088002f30 tx=0x7f9088010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:24.833 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.819+0000 7f90957fa700 1 -- 172.21.15.174:0/1188456749 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f908800a350 con 0x7f909805bdd0 2020-04-02T23:21:24.834 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.819+0000 7f909ea4f700 1 -- 172.21.15.174:0/1188456749 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90980a3ef0 con 0x7f909805bdd0 2020-04-02T23:21:24.834 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.819+0000 7f90957fa700 1 -- 172.21.15.174:0/1188456749 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f908800a770 con 0x7f909805bdd0 2020-04-02T23:21:24.834 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.819+0000 7f909ea4f700 1 -- 172.21.15.174:0/1188456749 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f909809ccf0 con 0x7f909805bdd0 2020-04-02T23:21:24.834 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.819+0000 7f909cfec700 1 --2- 172.21.15.174:0/1188456749 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f909805bdd0 0x7f909807f670 secure :-1 s=THROTTLE_DONE pgs=9 cs=0 l=1 rx=0x7f9088002f30 tx=0x7f9088010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:24.834 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.819+0000 7f909ea4f700 1 -- 172.21.15.174:0/1188456749 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9098121b80 con 0x7f909805bdd0 2020-04-02T23:21:24.834 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.819+0000 7f90957fa700 1 -- 172.21.15.174:0/1188456749 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 3) v1 ==== 59405+0+0 (secure 0 0 0) 0x7f9088007170 con 0x7f909805bdd0 2020-04-02T23:21:24.834 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.819+0000 7f909cfec700 1 --2- 172.21.15.174:0/1188456749 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f909805bdd0 0x7f909807f670 secure :-1 s=THROTTLE_DONE pgs=9 cs=0 l=1 rx=0x7f9088002f30 tx=0x7f9088010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:24.835 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.820+0000 7f90957fa700 1 --2- 172.21.15.174:0/1188456749 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f907c04d840 0x7f907c04fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:24.835 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.820+0000 7f90957fa700 1 -- 172.21.15.174:0/1188456749 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1499+0+0 (secure 0 0 0) 0x7f9088060870 con 0x7f909805bdd0 2020-04-02T23:21:24.835 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.820+0000 7f9097fff700 1 --2- 172.21.15.174:0/1188456749 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f907c04d840 0x7f907c04fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:24.835 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.820+0000 7f9097fff700 1 --2- 172.21.15.174:0/1188456749 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f907c04d840 0x7f907c04fd00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f90980a3ce0 tx=0x7f9080007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:24.835 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.820+0000 7f9097fff700 1 --2- 172.21.15.174:0/1188456749 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f907c04d840 0x7f907c04fd00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f90980a3ce0 tx=0x7f9080007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:24.835 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.820+0000 7f9097fff700 1 --2- 172.21.15.174:0/1188456749 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f907c04d840 0x7f907c04fd00 secure :-1 s=READY pgs=13 cs=0 l=1 rx=0x7f90980a3ce0 tx=0x7f9080007a40).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:24.836 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.824+0000 7f909cfec700 1 --2- 172.21.15.174:0/1188456749 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f909805bdd0 0x7f909807f670 secure :-1 s=THROTTLE_DONE pgs=9 cs=0 l=1 rx=0x7f9088002f30 tx=0x7f9088010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:24.836 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.824+0000 7f90957fa700 1 -- 172.21.15.174:0/1188456749 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f908803c0b0 con 0x7f909805bdd0 2020-04-02T23:21:24.977 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.975+0000 7f909ea4f700 1 -- 172.21.15.174:0/1188456749 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d7fb3499-9e13-4076-b3cf-28f27eb62967", "id": 3} v 0) v1 -- 0x7f9098056c50 con 0x7f909805bdd0 2020-04-02T23:21:24.982 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.980+0000 7f909cfec700 1 --2- 172.21.15.174:0/1188456749 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f909805bdd0 0x7f909807f670 secure :-1 s=THROTTLE_DONE pgs=9 cs=0 l=1 rx=0x7f9088002f30 tx=0x7f9088010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:24.983 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.980+0000 7f90957fa700 1 -- 172.21.15.174:0/1188456749 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d7fb3499-9e13-4076-b3cf-28f27eb62967", "id": 3}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f908803f6d0 con 0x7f909805bdd0 2020-04-02T23:21:24.983 INFO:teuthology.orchestra.run.smithi174.stdout:3 2020-04-02T23:21:24.984 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.981+0000 7f909ea4f700 1 -- 172.21.15.174:0/1188456749 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f907c04d840 msgr2=0x7f907c04fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:24.985 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.981+0000 7f909ea4f700 1 --2- 172.21.15.174:0/1188456749 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f907c04d840 0x7f907c04fd00 secure :-1 s=READY pgs=13 cs=0 l=1 rx=0x7f90980a3ce0 tx=0x7f9080007a40).stop 2020-04-02T23:21:24.985 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.982+0000 7f909ea4f700 1 -- 172.21.15.174:0/1188456749 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f909805bdd0 msgr2=0x7f909807f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:24.985 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.982+0000 7f909ea4f700 1 --2- 172.21.15.174:0/1188456749 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f909805bdd0 0x7f909807f670 secure :-1 s=READY pgs=9 cs=0 l=1 rx=0x7f9088002f30 tx=0x7f9088010980).stop 2020-04-02T23:21:24.985 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.982+0000 7f909ea4f700 1 -- 172.21.15.174:0/1188456749 shutdown_connections 2020-04-02T23:21:24.985 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.982+0000 7f909ea4f700 1 --2- 172.21.15.174:0/1188456749 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f907c04d840 0x7f907c04fd00 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:24.985 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.982+0000 7f909ea4f700 1 --2- 172.21.15.174:0/1188456749 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f909805bdd0 0x7f909807f670 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:24.986 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.982+0000 7f909ea4f700 1 --2- 172.21.15.174:0/1188456749 >> v2:172.21.15.196:3300/0 conn(0x7f90980a4380 0x7f909807c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:24.987 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.982+0000 7f909ea4f700 1 -- 172.21.15.174:0/1188456749 >> 172.21.15.174:0/1188456749 conn(0x7f90980a6d00 msgr2=0x7f90980695c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:24.987 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.982+0000 7f909ea4f700 1 -- 172.21.15.174:0/1188456749 shutdown_connections 2020-04-02T23:21:24.987 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:24.982+0000 7f909ea4f700 1 -- 172.21.15.174:0/1188456749 wait complete. 2020-04-02T23:21:24.994 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:25.008 INFO:teuthology.orchestra.run.smithi174:> sudo ceph --cluster ceph osd new 16923c47-2f21-43ea-9647-5ead4b1b2101 4 2020-04-02T23:21:25.154 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.148+0000 7fe85c8ee700 1 Processor -- start 2020-04-02T23:21:25.154 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.149+0000 7fe85c8ee700 1 -- start start 2020-04-02T23:21:25.154 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.149+0000 7fe85c8ee700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe85814a9a0 0x7fe85814cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:25.154 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.149+0000 7fe85c8ee700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe85814d1f0 0x7fe85814f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:25.154 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.149+0000 7fe85c8ee700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8580a39a0 con 0x7fe85805bdd0 2020-04-02T23:21:25.155 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.149+0000 7fe85c8ee700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8580a6440 con 0x7fe85814a9a0 2020-04-02T23:21:25.155 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.149+0000 7fe85c8ee700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8580a66e0 con 0x7fe85814d1f0 2020-04-02T23:21:25.155 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.149+0000 7fe85659c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe85814a9a0 0x7fe85814cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:25.155 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.149+0000 7fe85659c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe85814a9a0 0x7fe85814cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:39158/0 (socket says 172.21.15.174:39158) 2020-04-02T23:21:25.155 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.149+0000 7fe85659c700 1 -- 172.21.15.174:0/3479289765 learned_addr learned my addr 172.21.15.174:0/3479289765 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:21:25.155 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.150+0000 7fe85759e700 1 --2- 172.21.15.174:0/3479289765 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe85814d1f0 0x7fe85814f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:25.156 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.150+0000 7fe85659c700 1 -- 172.21.15.174:0/3479289765 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe85814d1f0 msgr2=0x7fe85814f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:25.156 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.150+0000 7fe85659c700 1 --2- 172.21.15.174:0/3479289765 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe85814d1f0 0x7fe85814f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:25.156 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.150+0000 7fe85659c700 1 -- 172.21.15.174:0/3479289765 >> v1:172.21.15.196:6789/0 conn(0x7fe85805bdd0 legacy=0x7fe8580a3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:25.156 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.150+0000 7fe85659c700 1 -- 172.21.15.174:0/3479289765 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8580a6980 con 0x7fe85814a9a0 2020-04-02T23:21:25.156 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.150+0000 7fe85659c700 1 --2- 172.21.15.174:0/3479289765 >> v2:172.21.15.174:3300/0 conn(0x7fe85814a9a0 0x7fe85814cd90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe8580a3d20 tx=0x7fe84c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:25.156 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.150+0000 7fe85659c700 1 --2- 172.21.15.174:0/3479289765 >> v2:172.21.15.174:3300/0 conn(0x7fe85814a9a0 0x7fe85814cd90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe8580a3d20 tx=0x7fe84c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:25.156 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.150+0000 7fe85659c700 1 --2- 172.21.15.174:0/3479289765 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe85814a9a0 0x7fe85814cd90 secure :-1 s=READY pgs=23 cs=0 l=1 rx=0x7fe8580a3d20 tx=0x7fe84c0088e0).ready entity=mon.0 client_cookie=167cea816c1c66a7 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:25.157 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.150+0000 7fe85659c700 1 --2- 172.21.15.174:0/3479289765 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe85814a9a0 0x7fe85814cd90 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7fe8580a3d20 tx=0x7fe84c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:25.157 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.150+0000 7fe85659c700 1 --2- 172.21.15.174:0/3479289765 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe85814a9a0 0x7fe85814cd90 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7fe8580a3d20 tx=0x7fe84c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:25.157 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.150+0000 7fe85659c700 1 --2- 172.21.15.174:0/3479289765 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe85814a9a0 0x7fe85814cd90 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7fe8580a3d20 tx=0x7fe84c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:25.157 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.150+0000 7fe855d9b700 1 -- 172.21.15.174:0/3479289765 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe84c0116e0 con 0x7fe85814a9a0 2020-04-02T23:21:25.157 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.150+0000 7fe855d9b700 1 -- 172.21.15.174:0/3479289765 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe84c011840 con 0x7fe85814a9a0 2020-04-02T23:21:25.157 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.150+0000 7fe855d9b700 1 -- 172.21.15.174:0/3479289765 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe84c011c20 con 0x7fe85814a9a0 2020-04-02T23:21:25.157 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.150+0000 7fe85c8ee700 1 -- 172.21.15.174:0/3479289765 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe85814a9a0 msgr2=0x7fe85814cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:25.157 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.150+0000 7fe85c8ee700 1 --2- 172.21.15.174:0/3479289765 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe85814a9a0 0x7fe85814cd90 secure :-1 s=READY pgs=23 cs=0 l=1 rx=0x7fe8580a3d20 tx=0x7fe84c0088e0).stop 2020-04-02T23:21:25.158 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.150+0000 7fe85c8ee700 1 -- 172.21.15.174:0/3479289765 shutdown_connections 2020-04-02T23:21:25.158 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.150+0000 7fe85c8ee700 1 --2- 172.21.15.174:0/3479289765 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe85814d1f0 0x7fe85814f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:25.158 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.150+0000 7fe85c8ee700 1 --2- 172.21.15.174:0/3479289765 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe85814a9a0 0x7fe85814cd90 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:25.158 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.150+0000 7fe85c8ee700 1 -- 172.21.15.174:0/3479289765 >> 172.21.15.174:0/3479289765 conn(0x7fe8580a6d00 msgr2=0x7fe8580a7110 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:25.158 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.150+0000 7fe85c8ee700 1 -- 172.21.15.174:0/3479289765 shutdown_connections 2020-04-02T23:21:25.158 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.150+0000 7fe85c8ee700 1 -- 172.21.15.174:0/3479289765 wait complete. 2020-04-02T23:21:25.158 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.152+0000 7fe85c8ee700 1 Processor -- start 2020-04-02T23:21:25.159 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.152+0000 7fe85c8ee700 1 -- start start 2020-04-02T23:21:25.169 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.152+0000 7fe85c8ee700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe85805bdd0 0x7fe85809b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:25.170 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.152+0000 7fe85c8ee700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fe85814a9a0 0x7fe85809b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:25.170 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.152+0000 7fe85c8ee700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe85807f230 con 0x7fe85814d1f0 2020-04-02T23:21:25.170 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.152+0000 7fe85c8ee700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe85809d4c0 con 0x7fe85805bdd0 2020-04-02T23:21:25.170 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.152+0000 7fe85c8ee700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe85809ae00 con 0x7fe85814a9a0 2020-04-02T23:21:25.170 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.152+0000 7fe856d9d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe85805bdd0 0x7fe85809b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:25.170 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.152+0000 7fe85759e700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fe85814d1f0 0x7fe85807c100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:44202/0 (socket says 172.21.15.174:44202) 2020-04-02T23:21:25.170 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.152+0000 7fe85759e700 1 -- 172.21.15.174:0/3395274508 learned_addr learned my addr 172.21.15.174:0/3395274508 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:21:25.171 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.152+0000 7fe85659c700 1 --2- 172.21.15.174:0/3395274508 >> v2:172.21.15.196:3300/0 conn(0x7fe85814a9a0 0x7fe85809b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:25.171 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.152+0000 7fe856d9d700 1 -- 172.21.15.174:0/3395274508 >> v2:172.21.15.196:3300/0 conn(0x7fe85814a9a0 msgr2=0x7fe85809b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:25.171 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.152+0000 7fe856d9d700 1 --2- 172.21.15.174:0/3395274508 >> v2:172.21.15.196:3300/0 conn(0x7fe85814a9a0 0x7fe85809b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:25.171 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.152+0000 7fe856d9d700 1 -- 172.21.15.174:0/3395274508 >> v1:172.21.15.174:6789/0 conn(0x7fe85814d1f0 legacy=0x7fe85807c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:25.171 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.152+0000 7fe856d9d700 1 -- 172.21.15.174:0/3395274508 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe858066870 con 0x7fe85805bdd0 2020-04-02T23:21:25.171 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.152+0000 7fe8477fe700 1 -- 172.21.15.174:0/3395274508 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2862084503 0 0) 0x7fe85807f230 con 0x7fe85814d1f0 2020-04-02T23:21:25.171 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.152+0000 7fe856d9d700 1 --2- 172.21.15.174:0/3395274508 >> v2:172.21.15.174:3300/0 conn(0x7fe85805bdd0 0x7fe85809b250 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe848001f50 tx=0x7fe848010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:25.172 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.153+0000 7fe856d9d700 1 --2- 172.21.15.174:0/3395274508 >> v2:172.21.15.174:3300/0 conn(0x7fe85805bdd0 0x7fe85809b250 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe848001f50 tx=0x7fe848010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:25.172 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.153+0000 7fe856d9d700 1 --2- 172.21.15.174:0/3395274508 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe85805bdd0 0x7fe85809b250 secure :-1 s=READY pgs=25 cs=0 l=1 rx=0x7fe848001f50 tx=0x7fe848010850).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:25.172 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.153+0000 7fe856d9d700 1 --2- 172.21.15.174:0/3395274508 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe85805bdd0 0x7fe85809b250 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7fe848001f50 tx=0x7fe848010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:25.172 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.153+0000 7fe8477fe700 1 -- 172.21.15.174:0/3395274508 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe848006bc0 con 0x7fe85805bdd0 2020-04-02T23:21:25.172 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.153+0000 7fe856d9d700 1 --2- 172.21.15.174:0/3395274508 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe85805bdd0 0x7fe85809b250 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7fe848001f50 tx=0x7fe848010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:25.172 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.153+0000 7fe856d9d700 1 --2- 172.21.15.174:0/3395274508 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe85805bdd0 0x7fe85809b250 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7fe848001f50 tx=0x7fe848010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:25.172 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.153+0000 7fe8477fe700 1 -- 172.21.15.174:0/3395274508 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe848006d20 con 0x7fe85805bdd0 2020-04-02T23:21:25.173 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.153+0000 7fe85c8ee700 1 -- 172.21.15.174:0/3395274508 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8580a8b70 con 0x7fe85805bdd0 2020-04-02T23:21:25.173 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.153+0000 7fe8477fe700 1 -- 172.21.15.174:0/3395274508 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe848008350 con 0x7fe85805bdd0 2020-04-02T23:21:25.173 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.153+0000 7fe85c8ee700 1 -- 172.21.15.174:0/3395274508 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe85809d1e0 con 0x7fe85805bdd0 2020-04-02T23:21:25.173 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.153+0000 7fe856d9d700 1 --2- 172.21.15.174:0/3395274508 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe85805bdd0 0x7fe85809b250 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7fe848001f50 tx=0x7fe848010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:25.176 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.154+0000 7fe8477fe700 1 -- 172.21.15.174:0/3395274508 <== mon.0 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 3) v1 ==== 59405+0+0 (secure 0 0 0) 0x7fe8480085c0 con 0x7fe85805bdd0 2020-04-02T23:21:25.176 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.154+0000 7fe856d9d700 1 --2- 172.21.15.174:0/3395274508 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe85805bdd0 0x7fe85809b250 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7fe848001f50 tx=0x7fe848010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:25.176 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.154+0000 7fe85c8ee700 1 -- 172.21.15.174:0/3395274508 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe85809ccd0 con 0x7fe85805bdd0 2020-04-02T23:21:25.176 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.154+0000 7fe8477fe700 1 --2- 172.21.15.174:0/3395274508 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fe83c04d4a0 0x7fe83c04f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:25.176 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.154+0000 7fe8477fe700 1 -- 172.21.15.174:0/3395274508 <== mon.0 v2:172.21.15.174:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1614+0+0 (secure 0 0 0) 0x7fe848060ec0 con 0x7fe85805bdd0 2020-04-02T23:21:25.177 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.154+0000 7fe85659c700 1 --2- 172.21.15.174:0/3395274508 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fe83c04d4a0 0x7fe83c04f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:25.177 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.154+0000 7fe85659c700 1 --2- 172.21.15.174:0/3395274508 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fe83c04d4a0 0x7fe83c04f960 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe8580a3d20 tx=0x7fe84c011490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:25.177 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.154+0000 7fe85659c700 1 --2- 172.21.15.174:0/3395274508 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fe83c04d4a0 0x7fe83c04f960 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe8580a3d20 tx=0x7fe84c011490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:25.177 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.155+0000 7fe85659c700 1 --2- 172.21.15.174:0/3395274508 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fe83c04d4a0 0x7fe83c04f960 secure :-1 s=READY pgs=14 cs=0 l=1 rx=0x7fe8580a3d20 tx=0x7fe84c011490).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:25.177 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.157+0000 7fe856d9d700 1 --2- 172.21.15.174:0/3395274508 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe85805bdd0 0x7fe85809b250 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7fe848001f50 tx=0x7fe848010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:25.178 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.157+0000 7fe8477fe700 1 -- 172.21.15.174:0/3395274508 <== mon.0 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fe84803c6a0 con 0x7fe85805bdd0 2020-04-02T23:21:25.188 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.185+0000 7fe856d9d700 1 --2- 172.21.15.174:0/3395274508 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe85805bdd0 0x7fe85809b250 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7fe848001f50 tx=0x7fe848010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:25.188 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.186+0000 7fe8477fe700 1 -- 172.21.15.174:0/3395274508 <== mon.0 v2:172.21.15.174:3300/0 7 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fe84803ca70 con 0x7fe85805bdd0 2020-04-02T23:21:25.312 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.310+0000 7fe85c8ee700 1 -- 172.21.15.174:0/3395274508 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd new", "uuid": "16923c47-2f21-43ea-9647-5ead4b1b2101", "id": 4} v 0) v1 -- 0x7fe85809d690 con 0x7fe85805bdd0 2020-04-02T23:21:25.315 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.313+0000 7fe856d9d700 1 --2- 172.21.15.174:0/3395274508 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe85805bdd0 0x7fe85809b250 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7fe848001f50 tx=0x7fe848010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:25.316 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.313+0000 7fe8477fe700 1 -- 172.21.15.174:0/3395274508 <== mon.0 v2:172.21.15.174:3300/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "16923c47-2f21-43ea-9647-5ead4b1b2101", "id": 4}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe84804f810 con 0x7fe85805bdd0 2020-04-02T23:21:25.316 INFO:teuthology.orchestra.run.smithi174.stdout:4 2020-04-02T23:21:25.318 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.315+0000 7fe85c8ee700 1 -- 172.21.15.174:0/3395274508 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fe83c04d4a0 msgr2=0x7fe83c04f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:25.318 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.315+0000 7fe85c8ee700 1 --2- 172.21.15.174:0/3395274508 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fe83c04d4a0 0x7fe83c04f960 secure :-1 s=READY pgs=14 cs=0 l=1 rx=0x7fe8580a3d20 tx=0x7fe84c011490).stop 2020-04-02T23:21:25.318 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.315+0000 7fe85c8ee700 1 -- 172.21.15.174:0/3395274508 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe85805bdd0 msgr2=0x7fe85809b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:25.319 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.315+0000 7fe85c8ee700 1 --2- 172.21.15.174:0/3395274508 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe85805bdd0 0x7fe85809b250 secure :-1 s=READY pgs=25 cs=0 l=1 rx=0x7fe848001f50 tx=0x7fe848010850).stop 2020-04-02T23:21:25.319 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.315+0000 7fe85c8ee700 1 -- 172.21.15.174:0/3395274508 shutdown_connections 2020-04-02T23:21:25.319 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.315+0000 7fe85c8ee700 1 --2- 172.21.15.174:0/3395274508 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fe83c04d4a0 0x7fe83c04f960 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:25.319 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.315+0000 7fe85c8ee700 1 --2- 172.21.15.174:0/3395274508 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe85805bdd0 0x7fe85809b250 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:25.319 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.315+0000 7fe85c8ee700 1 --2- 172.21.15.174:0/3395274508 >> v2:172.21.15.196:3300/0 conn(0x7fe85814a9a0 0x7fe85809b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:25.319 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.315+0000 7fe85c8ee700 1 -- 172.21.15.174:0/3395274508 >> 172.21.15.174:0/3395274508 conn(0x7fe8580a6d00 msgr2=0x7fe8580695c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:25.320 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.315+0000 7fe85c8ee700 1 -- 172.21.15.174:0/3395274508 shutdown_connections 2020-04-02T23:21:25.320 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.315+0000 7fe85c8ee700 1 -- 172.21.15.174:0/3395274508 wait complete. 2020-04-02T23:21:25.327 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:25.341 INFO:teuthology.orchestra.run.smithi174:> sudo ceph --cluster ceph osd new 7cf2859b-2226-4908-8d70-6e699d1acb0c 5 2020-04-02T23:21:25.492 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.482+0000 7f4569828700 1 Processor -- start 2020-04-02T23:21:25.493 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.482+0000 7f4569828700 1 -- start start 2020-04-02T23:21:25.493 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.483+0000 7f4569828700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f456414e4b0 0x7f45641508a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:25.493 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.483+0000 7f4569828700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45640a39a0 con 0x7f456414a9a0 2020-04-02T23:21:25.494 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.483+0000 7f4569828700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45640a6440 con 0x7f456405bdd0 2020-04-02T23:21:25.494 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.483+0000 7f4569828700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45640a66e0 con 0x7f456414e4b0 2020-04-02T23:21:25.494 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.483+0000 7f4562ffd700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f456414a9a0 0x7f456414cd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:44208/0 (socket says 172.21.15.174:44208) 2020-04-02T23:21:25.494 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.483+0000 7f4562ffd700 1 -- 172.21.15.174:0/1541916169 learned_addr learned my addr 172.21.15.174:0/1541916169 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:21:25.494 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.483+0000 7f4563fff700 1 --2- 172.21.15.174:0/1541916169 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f456414e4b0 0x7f45641508a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:25.495 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.483+0000 7f45627fc700 1 -- 172.21.15.174:0/1541916169 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 353708740 0 0) 0x7f45640a39a0 con 0x7f456414a9a0 2020-04-02T23:21:25.495 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.483+0000 7f45627fc700 1 -- 172.21.15.174:0/1541916169 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f454c003230 con 0x7f456414a9a0 2020-04-02T23:21:25.495 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.484+0000 7f45627fc700 1 -- 172.21.15.174:0/1541916169 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 291685928 0 0) 0x7f45640a6440 con 0x7f456405bdd0 2020-04-02T23:21:25.495 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.484+0000 7f45627fc700 1 -- 172.21.15.174:0/1541916169 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45640a39a0 con 0x7f456405bdd0 2020-04-02T23:21:25.495 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.484+0000 7f45627fc700 1 -- 172.21.15.174:0/1541916169 <== mon.0 v1:172.21.15.174:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3010869467 0 0) 0x7f454c003230 con 0x7f456414a9a0 2020-04-02T23:21:25.496 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.484+0000 7f45627fc700 1 -- 172.21.15.174:0/1541916169 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f456414e4b0 msgr2=0x7f45641508a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:25.496 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.484+0000 7f45627fc700 1 --2- 172.21.15.174:0/1541916169 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f456414e4b0 0x7f45641508a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:25.496 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.484+0000 7f45627fc700 1 -- 172.21.15.174:0/1541916169 >> v1:172.21.15.196:6789/0 conn(0x7f456405bdd0 legacy=0x7f45640a3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:25.496 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.484+0000 7f45627fc700 1 -- 172.21.15.174:0/1541916169 --> v1:172.21.15.174:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45640a6980 con 0x7f456414a9a0 2020-04-02T23:21:25.497 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.484+0000 7f45627fc700 1 -- 172.21.15.174:0/1541916169 <== mon.0 v1:172.21.15.174:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2811762909 0 0) 0x7f45580016d0 con 0x7f456414a9a0 2020-04-02T23:21:25.497 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.484+0000 7f45627fc700 1 -- 172.21.15.174:0/1541916169 >> v1:172.21.15.174:6789/0 conn(0x7f456414a9a0 legacy=0x7f456414cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:25.497 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.484+0000 7f45627fc700 1 --2- 172.21.15.174:0/1541916169 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f454c0038e0 0x7f454c003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:25.497 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.484+0000 7f45627fc700 1 --2- 172.21.15.174:0/1541916169 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f456414e4b0 0x7f454c0044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:25.497 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.484+0000 7f45627fc700 1 --2- 172.21.15.174:0/1541916169 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f454c004930 0x7f454c004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:25.498 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.484+0000 7f45627fc700 1 -- 172.21.15.174:0/1541916169 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45640a66e0 con 0x7f454c0038e0 2020-04-02T23:21:25.498 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.484+0000 7f45627fc700 1 -- 172.21.15.174:0/1541916169 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f454c005210 con 0x7f454c004930 2020-04-02T23:21:25.498 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.484+0000 7f45627fc700 1 -- 172.21.15.174:0/1541916169 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f454c04f730 con 0x7f456414e4b0 2020-04-02T23:21:25.498 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.484+0000 7f45637fe700 1 --2- 172.21.15.174:0/1541916169 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f454c0038e0 0x7f454c003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:25.498 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.484+0000 7f4562ffd700 1 --2- 172.21.15.174:0/1541916169 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f456414e4b0 0x7f454c0044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:25.499 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.484+0000 7f4563fff700 1 --2- 172.21.15.174:0/1541916169 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f454c004930 0x7f454c004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:25.499 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.484+0000 7f45637fe700 1 -- 172.21.15.174:0/1541916169 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f456414e4b0 msgr2=0x7f454c0044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:25.499 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.484+0000 7f45637fe700 1 --2- 172.21.15.174:0/1541916169 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f456414e4b0 0x7f454c0044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:25.499 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.484+0000 7f45637fe700 1 -- 172.21.15.174:0/1541916169 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f454c004930 msgr2=0x7f454c004db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:25.499 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.484+0000 7f45637fe700 1 --2- 172.21.15.174:0/1541916169 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f454c004930 0x7f454c004db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:25.500 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.484+0000 7f45637fe700 1 -- 172.21.15.174:0/1541916169 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f454c003230 con 0x7f454c0038e0 2020-04-02T23:21:25.500 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.484+0000 7f4563fff700 1 --2- 172.21.15.174:0/1541916169 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f454c004930 0x7f454c004db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-02T23:21:25.500 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.484+0000 7f45637fe700 1 --2- 172.21.15.174:0/1541916169 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f454c0038e0 0x7f454c003cc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f45540010d0 tx=0x7f455400ff00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:25.500 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.484+0000 7f45637fe700 1 --2- 172.21.15.174:0/1541916169 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f454c0038e0 0x7f454c003cc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f45540010d0 tx=0x7f455400ff00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:25.501 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.484+0000 7f45637fe700 1 --2- 172.21.15.174:0/1541916169 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f454c0038e0 0x7f454c003cc0 secure :-1 s=READY pgs=27 cs=0 l=1 rx=0x7f45540010d0 tx=0x7f455400ff00).ready entity=mon.0 client_cookie=92a2ad4fa1b8296f server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:25.501 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.484+0000 7f45637fe700 1 --2- 172.21.15.174:0/1541916169 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f454c0038e0 0x7f454c003cc0 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7f45540010d0 tx=0x7f455400ff00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:25.501 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.484+0000 7f45627fc700 1 -- 172.21.15.174:0/1541916169 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4554010c10 con 0x7f454c0038e0 2020-04-02T23:21:25.505 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.484+0000 7f45637fe700 1 --2- 172.21.15.174:0/1541916169 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f454c0038e0 0x7f454c003cc0 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7f45540010d0 tx=0x7f455400ff00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:25.505 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.484+0000 7f45637fe700 1 --2- 172.21.15.174:0/1541916169 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f454c0038e0 0x7f454c003cc0 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7f45540010d0 tx=0x7f455400ff00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:25.505 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.484+0000 7f45627fc700 1 -- 172.21.15.174:0/1541916169 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4554010db0 con 0x7f454c0038e0 2020-04-02T23:21:25.506 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.484+0000 7f45627fc700 1 -- 172.21.15.174:0/1541916169 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45540066d0 con 0x7f454c0038e0 2020-04-02T23:21:25.507 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.484+0000 7f4569828700 1 -- 172.21.15.174:0/1541916169 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f454c0038e0 msgr2=0x7f454c003cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:25.508 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.484+0000 7f4569828700 1 --2- 172.21.15.174:0/1541916169 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f454c0038e0 0x7f454c003cc0 secure :-1 s=READY pgs=27 cs=0 l=1 rx=0x7f45540010d0 tx=0x7f455400ff00).stop 2020-04-02T23:21:25.508 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.484+0000 7f4563fff700 1 -- 172.21.15.174:0/1541916169 reap_dead start 2020-04-02T23:21:25.509 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.485+0000 7f4569828700 1 -- 172.21.15.174:0/1541916169 shutdown_connections 2020-04-02T23:21:25.509 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.485+0000 7f4569828700 1 -- 172.21.15.174:0/1541916169 >> 172.21.15.174:0/1541916169 conn(0x7f45640a6d00 msgr2=0x7f45640a7110 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:25.509 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.485+0000 7f4569828700 1 -- 172.21.15.174:0/1541916169 shutdown_connections 2020-04-02T23:21:25.509 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.485+0000 7f4569828700 1 -- 172.21.15.174:0/1541916169 wait complete. 2020-04-02T23:21:25.511 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.486+0000 7f4569828700 1 Processor -- start 2020-04-02T23:21:25.512 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.486+0000 7f4569828700 1 -- start start 2020-04-02T23:21:25.512 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.487+0000 7f4569828700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f456409c010 0x7f45641312a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:25.512 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.487+0000 7f4569828700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4564130e70 con 0x7f4564131700 2020-04-02T23:21:25.512 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.487+0000 7f4569828700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f456409f580 con 0x7f456409cbf0 2020-04-02T23:21:25.512 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.487+0000 7f4569828700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4564120f10 con 0x7f456409c010 2020-04-02T23:21:25.512 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.487+0000 7f4562ffd700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f4564131700 0x7f456409c4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:44218/0 (socket says 172.21.15.174:44218) 2020-04-02T23:21:25.513 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.487+0000 7f4562ffd700 1 -- 172.21.15.174:0/255385384 learned_addr learned my addr 172.21.15.174:0/255385384 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:21:25.513 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.487+0000 7f45637fe700 1 --2- 172.21.15.174:0/255385384 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f456409c010 0x7f45641312a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:25.513 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.487+0000 7f454bfff700 1 -- 172.21.15.174:0/255385384 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4107242646 0 0) 0x7f4564130e70 con 0x7f4564131700 2020-04-02T23:21:25.513 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.487+0000 7f454bfff700 1 -- 172.21.15.174:0/255385384 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4544003230 con 0x7f4564131700 2020-04-02T23:21:25.513 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.487+0000 7f454bfff700 1 -- 172.21.15.174:0/255385384 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3459029613 0 0) 0x7f456409f580 con 0x7f456409cbf0 2020-04-02T23:21:25.513 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.487+0000 7f454bfff700 1 -- 172.21.15.174:0/255385384 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4564130e70 con 0x7f456409cbf0 2020-04-02T23:21:25.514 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.487+0000 7f454bfff700 1 -- 172.21.15.174:0/255385384 <== mon.0 v1:172.21.15.174:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4127018808 0 0) 0x7f4544003230 con 0x7f4564131700 2020-04-02T23:21:25.514 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.487+0000 7f45637fe700 1 -- 172.21.15.174:0/255385384 >> v1:172.21.15.196:6789/0 conn(0x7f456409cbf0 legacy=0x7f45641384c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:25.514 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.487+0000 7f45637fe700 1 -- 172.21.15.174:0/255385384 >> v1:172.21.15.174:6789/0 conn(0x7f4564131700 legacy=0x7f456409c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:25.514 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.487+0000 7f45637fe700 1 -- 172.21.15.174:0/255385384 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45641211b0 con 0x7f456409c010 2020-04-02T23:21:25.515 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.487+0000 7f45637fe700 1 --2- 172.21.15.174:0/255385384 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f456409c010 0x7f45641312a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f45580010d0 tx=0x7f455400ff00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:25.515 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.487+0000 7f45637fe700 1 --2- 172.21.15.174:0/255385384 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f456409c010 0x7f45641312a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f45580010d0 tx=0x7f455400ff00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:25.515 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.487+0000 7f45637fe700 1 --2- 172.21.15.174:0/255385384 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f456409c010 0x7f45641312a0 secure :-1 s=READY pgs=10 cs=0 l=1 rx=0x7f45580010d0 tx=0x7f455400ff00).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:25.515 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.487+0000 7f45637fe700 1 --2- 172.21.15.174:0/255385384 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f456409c010 0x7f45641312a0 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7f45580010d0 tx=0x7f455400ff00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:25.515 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.488+0000 7f454bfff700 1 -- 172.21.15.174:0/255385384 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45580016d0 con 0x7f456409c010 2020-04-02T23:21:25.516 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.488+0000 7f45637fe700 1 --2- 172.21.15.174:0/255385384 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f456409c010 0x7f45641312a0 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7f45580010d0 tx=0x7f455400ff00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:25.516 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.488+0000 7f454bfff700 1 -- 172.21.15.174:0/255385384 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4554001680 con 0x7f456409c010 2020-04-02T23:21:25.516 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.488+0000 7f45637fe700 1 --2- 172.21.15.174:0/255385384 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f456409c010 0x7f45641312a0 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7f45580010d0 tx=0x7f455400ff00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:25.516 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.488+0000 7f4569828700 1 -- 172.21.15.174:0/255385384 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45640a7a00 con 0x7f456409c010 2020-04-02T23:21:25.516 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.488+0000 7f454bfff700 1 -- 172.21.15.174:0/255385384 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4554006b20 con 0x7f456409c010 2020-04-02T23:21:25.516 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.488+0000 7f4569828700 1 -- 172.21.15.174:0/255385384 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f456414d320 con 0x7f456409c010 2020-04-02T23:21:25.517 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.488+0000 7f45637fe700 1 --2- 172.21.15.174:0/255385384 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f456409c010 0x7f45641312a0 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7f45580010d0 tx=0x7f455400ff00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:25.517 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.488+0000 7f4569828700 1 -- 172.21.15.174:0/255385384 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4564056c50 con 0x7f456409c010 2020-04-02T23:21:25.517 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.489+0000 7f454bfff700 1 -- 172.21.15.174:0/255385384 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f4554006d20 con 0x7f456409c010 2020-04-02T23:21:25.517 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.489+0000 7f45637fe700 1 --2- 172.21.15.174:0/255385384 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f456409c010 0x7f45641312a0 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7f45580010d0 tx=0x7f455400ff00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:25.517 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.489+0000 7f454bfff700 1 --2- 172.21.15.174:0/255385384 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f454404d9e0 0x7f454404fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:25.517 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.489+0000 7f454bfff700 1 -- 172.21.15.174:0/255385384 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1729+0+0 (secure 0 0 0) 0x7f4554060940 con 0x7f456409c010 2020-04-02T23:21:25.517 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.489+0000 7f4562ffd700 1 --2- 172.21.15.174:0/255385384 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f454404d9e0 0x7f454404fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:25.518 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.489+0000 7f4562ffd700 1 --2- 172.21.15.174:0/255385384 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f454404d9e0 0x7f454404fea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4558001d40 tx=0x7f455800d1e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:25.518 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.489+0000 7f4562ffd700 1 --2- 172.21.15.174:0/255385384 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f454404d9e0 0x7f454404fea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4558001d40 tx=0x7f455800d1e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:25.518 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.489+0000 7f4562ffd700 1 --2- 172.21.15.174:0/255385384 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f454404d9e0 0x7f454404fea0 secure :-1 s=READY pgs=15 cs=0 l=1 rx=0x7f4558001d40 tx=0x7f455800d1e0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:25.518 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.493+0000 7f45637fe700 1 --2- 172.21.15.174:0/255385384 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f456409c010 0x7f45641312a0 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7f45580010d0 tx=0x7f455400ff00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:25.519 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.493+0000 7f454bfff700 1 -- 172.21.15.174:0/255385384 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f455403c200 con 0x7f456409c010 2020-04-02T23:21:25.646 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.643+0000 7f4569828700 1 -- 172.21.15.174:0/255385384 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd new", "uuid": "7cf2859b-2226-4908-8d70-6e699d1acb0c", "id": 5} v 0) v1 -- 0x7f45640a5b40 con 0x7f456409c010 2020-04-02T23:21:25.650 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.647+0000 7f45637fe700 1 --2- 172.21.15.174:0/255385384 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f456409c010 0x7f45641312a0 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7f45580010d0 tx=0x7f455400ff00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:25.650 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.647+0000 7f454bfff700 1 -- 172.21.15.174:0/255385384 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7cf2859b-2226-4908-8d70-6e699d1acb0c", "id": 5}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f455403f760 con 0x7f456409c010 2020-04-02T23:21:25.650 INFO:teuthology.orchestra.run.smithi174.stdout:5 2020-04-02T23:21:25.652 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.649+0000 7f4569828700 1 -- 172.21.15.174:0/255385384 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f454404d9e0 msgr2=0x7f454404fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:25.653 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.649+0000 7f4569828700 1 --2- 172.21.15.174:0/255385384 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f454404d9e0 0x7f454404fea0 secure :-1 s=READY pgs=15 cs=0 l=1 rx=0x7f4558001d40 tx=0x7f455800d1e0).stop 2020-04-02T23:21:25.653 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.649+0000 7f4569828700 1 -- 172.21.15.174:0/255385384 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f456409c010 msgr2=0x7f45641312a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:25.653 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.649+0000 7f4569828700 1 --2- 172.21.15.174:0/255385384 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f456409c010 0x7f45641312a0 secure :-1 s=READY pgs=10 cs=0 l=1 rx=0x7f45580010d0 tx=0x7f455400ff00).stop 2020-04-02T23:21:25.653 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.649+0000 7f4569828700 1 -- 172.21.15.174:0/255385384 shutdown_connections 2020-04-02T23:21:25.654 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.649+0000 7f4569828700 1 --2- 172.21.15.174:0/255385384 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f454404d9e0 0x7f454404fea0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:25.654 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.649+0000 7f4569828700 1 --2- 172.21.15.174:0/255385384 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f456409c010 0x7f45641312a0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:25.654 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.649+0000 7f4569828700 1 -- 172.21.15.174:0/255385384 >> 172.21.15.174:0/255385384 conn(0x7f45640a6d00 msgr2=0x7f45640695c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:25.654 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.649+0000 7f4569828700 1 -- 172.21.15.174:0/255385384 shutdown_connections 2020-04-02T23:21:25.655 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.649+0000 7f4569828700 1 -- 172.21.15.174:0/255385384 wait complete. 2020-04-02T23:21:25.662 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:25.690 INFO:teuthology.orchestra.run.smithi174:> sudo ceph --cluster ceph osd new 441081ef-133a-41ec-8041-094e129707e3 6 2020-04-02T23:21:25.842 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.831+0000 7f461eb85700 1 Processor -- start 2020-04-02T23:21:25.842 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.831+0000 7f461eb85700 1 -- start start 2020-04-02T23:21:25.842 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.831+0000 7f461eb85700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f461805bdd0 0x7f46180a3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:25.843 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.831+0000 7f461eb85700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f46180a4380 0x7f46180a4b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:25.843 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.831+0000 7f461eb85700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46180a6440 con 0x7f46180a4f90 2020-04-02T23:21:25.843 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.831+0000 7f461eb85700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46180a3a60 con 0x7f461805bdd0 2020-04-02T23:21:25.843 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.831+0000 7f461eb85700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46180a66e0 con 0x7f46180a4380 2020-04-02T23:21:25.843 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.832+0000 7f461d923700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f46180a4f90 0x7f46180a5420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:44224/0 (socket says 172.21.15.174:44224) 2020-04-02T23:21:25.843 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.832+0000 7f461d923700 1 -- 172.21.15.174:0/631325096 learned_addr learned my addr 172.21.15.174:0/631325096 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:21:25.843 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.832+0000 7f461c921700 1 --2- 172.21.15.174:0/631325096 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f46180a4380 0x7f46180a4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:25.844 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.832+0000 7f461d122700 1 --2- 172.21.15.174:0/631325096 >> v2:172.21.15.196:3300/0 conn(0x7f461805bdd0 0x7f46180a3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:25.844 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.832+0000 7f460ffff700 1 -- 172.21.15.174:0/631325096 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1211379211 0 0) 0x7f46180a6440 con 0x7f46180a4f90 2020-04-02T23:21:25.844 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.832+0000 7f460ffff700 1 -- 172.21.15.174:0/631325096 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4604003230 con 0x7f46180a4f90 2020-04-02T23:21:25.844 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.832+0000 7f460ffff700 1 -- 172.21.15.174:0/631325096 <== mon.0 v1:172.21.15.174:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4083154767 0 0) 0x7f4604003230 con 0x7f46180a4f90 2020-04-02T23:21:25.844 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.832+0000 7f460ffff700 1 -- 172.21.15.174:0/631325096 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f46180a4380 msgr2=0x7f46180a4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:25.844 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.832+0000 7f460ffff700 1 --2- 172.21.15.174:0/631325096 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f46180a4380 0x7f46180a4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:25.844 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.832+0000 7f460ffff700 1 -- 172.21.15.174:0/631325096 >> v2:172.21.15.196:3300/0 conn(0x7f461805bdd0 msgr2=0x7f46180a3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:25.845 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.832+0000 7f460ffff700 1 --2- 172.21.15.174:0/631325096 >> v2:172.21.15.196:3300/0 conn(0x7f461805bdd0 0x7f46180a3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:25.845 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.832+0000 7f460ffff700 1 -- 172.21.15.174:0/631325096 --> v1:172.21.15.174:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46180a6980 con 0x7f46180a4f90 2020-04-02T23:21:25.845 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.832+0000 7f460ffff700 1 -- 172.21.15.174:0/631325096 <== mon.0 v1:172.21.15.174:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2811762909 0 0) 0x7f4610001a50 con 0x7f46180a4f90 2020-04-02T23:21:25.845 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.832+0000 7f460ffff700 1 -- 172.21.15.174:0/631325096 >> v1:172.21.15.174:6789/0 conn(0x7f46180a4f90 legacy=0x7f46180a5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:25.845 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.832+0000 7f460ffff700 1 --2- 172.21.15.174:0/631325096 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4604003720 0x7f4604003b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:25.845 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.832+0000 7f460ffff700 1 --2- 172.21.15.174:0/631325096 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f46180a4380 0x7f4604003ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:25.845 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.832+0000 7f460ffff700 1 --2- 172.21.15.174:0/631325096 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4604004520 0x7f46040049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:25.846 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.832+0000 7f460ffff700 1 -- 172.21.15.174:0/631325096 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46180a3a60 con 0x7f4604004520 2020-04-02T23:21:25.846 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.832+0000 7f460ffff700 1 -- 172.21.15.174:0/631325096 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46180a66e0 con 0x7f4604003720 2020-04-02T23:21:25.846 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.832+0000 7f460ffff700 1 -- 172.21.15.174:0/631325096 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4604004fa0 con 0x7f46180a4380 2020-04-02T23:21:25.846 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.832+0000 7f461d923700 1 --2- 172.21.15.174:0/631325096 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4604004520 0x7f46040049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:25.846 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.832+0000 7f461d122700 1 --2- 172.21.15.174:0/631325096 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4604003720 0x7f4604003b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:25.846 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.832+0000 7f461c921700 1 --2- 172.21.15.174:0/631325096 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f46180a4380 0x7f4604003ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:25.846 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.832+0000 7f461d923700 1 -- 172.21.15.174:0/631325096 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f46180a4380 msgr2=0x7f4604003ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:25.846 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.832+0000 7f461d923700 1 --2- 172.21.15.174:0/631325096 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f46180a4380 0x7f4604003ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:25.847 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.832+0000 7f461d923700 1 -- 172.21.15.174:0/631325096 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4604003720 msgr2=0x7f4604003b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:25.847 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.832+0000 7f461d923700 1 --2- 172.21.15.174:0/631325096 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4604003720 0x7f4604003b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:25.847 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.832+0000 7f461d923700 1 -- 172.21.15.174:0/631325096 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4604003230 con 0x7f4604004520 2020-04-02T23:21:25.847 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.833+0000 7f461d923700 1 --2- 172.21.15.174:0/631325096 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4604004520 0x7f46040049a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4610001760 tx=0x7f4610010f80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:25.847 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.833+0000 7f461d923700 1 --2- 172.21.15.174:0/631325096 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4604004520 0x7f46040049a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4610001760 tx=0x7f4610010f80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:25.847 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.833+0000 7f461d923700 1 --2- 172.21.15.174:0/631325096 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4604004520 0x7f46040049a0 secure :-1 s=READY pgs=30 cs=0 l=1 rx=0x7f4610001760 tx=0x7f4610010f80).ready entity=mon.0 client_cookie=365fdeb0c6abad3d server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:25.847 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.833+0000 7f461d923700 1 --2- 172.21.15.174:0/631325096 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4604004520 0x7f46040049a0 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f4610001760 tx=0x7f4610010f80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:25.848 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.833+0000 7f460ffff700 1 -- 172.21.15.174:0/631325096 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4610005d40 con 0x7f4604004520 2020-04-02T23:21:25.848 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.833+0000 7f461d923700 1 --2- 172.21.15.174:0/631325096 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4604004520 0x7f46040049a0 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f4610001760 tx=0x7f4610010f80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:25.848 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.833+0000 7f461d923700 1 --2- 172.21.15.174:0/631325096 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4604004520 0x7f46040049a0 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f4610001760 tx=0x7f4610010f80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:25.848 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.833+0000 7f460ffff700 1 -- 172.21.15.174:0/631325096 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4610012870 con 0x7f4604004520 2020-04-02T23:21:25.848 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.833+0000 7f460ffff700 1 -- 172.21.15.174:0/631325096 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4610005ea0 con 0x7f4604004520 2020-04-02T23:21:25.848 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.833+0000 7f461eb85700 1 -- 172.21.15.174:0/631325096 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4604004520 msgr2=0x7f46040049a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:25.848 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.833+0000 7f461eb85700 1 --2- 172.21.15.174:0/631325096 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4604004520 0x7f46040049a0 secure :-1 s=READY pgs=30 cs=0 l=1 rx=0x7f4610001760 tx=0x7f4610010f80).stop 2020-04-02T23:21:25.849 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.833+0000 7f461d923700 1 -- 172.21.15.174:0/631325096 reap_dead start 2020-04-02T23:21:25.849 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.833+0000 7f461eb85700 1 -- 172.21.15.174:0/631325096 shutdown_connections 2020-04-02T23:21:25.849 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.833+0000 7f461eb85700 1 -- 172.21.15.174:0/631325096 >> 172.21.15.174:0/631325096 conn(0x7f46180a6d00 msgr2=0x7f46180a7110 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:25.849 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.833+0000 7f461eb85700 1 -- 172.21.15.174:0/631325096 shutdown_connections 2020-04-02T23:21:25.849 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.833+0000 7f461eb85700 1 -- 172.21.15.174:0/631325096 wait complete. 2020-04-02T23:21:25.849 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.834+0000 7f461eb85700 1 Processor -- start 2020-04-02T23:21:25.849 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.834+0000 7f461eb85700 1 -- start start 2020-04-02T23:21:25.849 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.835+0000 7f461eb85700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4618065c10 0x7f4618121e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:25.850 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.835+0000 7f461eb85700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f46181222f0 0x7f461809ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:25.850 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.835+0000 7f461eb85700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f461809d150 0x7f4618134d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:25.850 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.835+0000 7f461eb85700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4618120bc0 con 0x7f4618065c10 2020-04-02T23:21:25.850 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.835+0000 7f461eb85700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46180a7a30 con 0x7f461809d150 2020-04-02T23:21:25.850 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.835+0000 7f461eb85700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f461809d970 con 0x7f46181222f0 2020-04-02T23:21:25.850 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.835+0000 7f461d122700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4618065c10 0x7f4618121e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:25.850 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.835+0000 7f461d122700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4618065c10 0x7f4618121e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:39194/0 (socket says 172.21.15.174:39194) 2020-04-02T23:21:25.851 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.835+0000 7f461d122700 1 -- 172.21.15.174:0/2135491623 learned_addr learned my addr 172.21.15.174:0/2135491623 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:21:25.851 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.835+0000 7f461c921700 1 --2- 172.21.15.174:0/2135491623 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f46181222f0 0x7f461809ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:25.851 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.835+0000 7f461d923700 1 --2- 172.21.15.174:0/2135491623 >> v2:172.21.15.196:3300/0 conn(0x7f461809d150 0x7f4618134d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:25.851 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.835+0000 7f461d122700 1 -- 172.21.15.174:0/2135491623 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f46181222f0 msgr2=0x7f461809ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:25.851 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.835+0000 7f461d122700 1 --2- 172.21.15.174:0/2135491623 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f46181222f0 0x7f461809ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:25.851 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.835+0000 7f461d122700 1 -- 172.21.15.174:0/2135491623 >> v2:172.21.15.196:3300/0 conn(0x7f461809d150 msgr2=0x7f4618134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:25.851 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.835+0000 7f461d122700 1 --2- 172.21.15.174:0/2135491623 >> v2:172.21.15.196:3300/0 conn(0x7f461809d150 0x7f4618134d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:25.851 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.835+0000 7f461d122700 1 -- 172.21.15.174:0/2135491623 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f461809dc70 con 0x7f4618065c10 2020-04-02T23:21:25.852 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.835+0000 7f461d122700 1 --2- 172.21.15.174:0/2135491623 >> v2:172.21.15.174:3300/0 conn(0x7f4618065c10 0x7f4618121e90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4618064ef0 tx=0x7f4614012cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:25.852 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.836+0000 7f461d122700 1 --2- 172.21.15.174:0/2135491623 >> v2:172.21.15.174:3300/0 conn(0x7f4618065c10 0x7f4618121e90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4618064ef0 tx=0x7f4614012cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:25.852 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.836+0000 7f461d122700 1 --2- 172.21.15.174:0/2135491623 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4618065c10 0x7f4618121e90 secure :-1 s=READY pgs=31 cs=0 l=1 rx=0x7f4618064ef0 tx=0x7f4614012cd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:25.852 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.836+0000 7f461d122700 1 --2- 172.21.15.174:0/2135491623 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4618065c10 0x7f4618121e90 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f4618064ef0 tx=0x7f4614012cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:25.852 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.836+0000 7f461d122700 1 --2- 172.21.15.174:0/2135491623 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4618065c10 0x7f4618121e90 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f4618064ef0 tx=0x7f4614012cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:25.852 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.836+0000 7f460dffb700 1 -- 172.21.15.174:0/2135491623 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4614005aa0 con 0x7f4618065c10 2020-04-02T23:21:25.852 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.836+0000 7f461d122700 1 --2- 172.21.15.174:0/2135491623 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4618065c10 0x7f4618121e90 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f4618064ef0 tx=0x7f4614012cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:25.853 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.836+0000 7f460dffb700 1 -- 172.21.15.174:0/2135491623 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4614005c40 con 0x7f4618065c10 2020-04-02T23:21:25.853 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.836+0000 7f461eb85700 1 -- 172.21.15.174:0/2135491623 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4618120920 con 0x7f4618065c10 2020-04-02T23:21:25.853 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.836+0000 7f460dffb700 1 -- 172.21.15.174:0/2135491623 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4614005e70 con 0x7f4618065c10 2020-04-02T23:21:25.853 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.836+0000 7f461eb85700 1 -- 172.21.15.174:0/2135491623 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46180a4900 con 0x7f4618065c10 2020-04-02T23:21:25.853 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.836+0000 7f461d122700 1 --2- 172.21.15.174:0/2135491623 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4618065c10 0x7f4618121e90 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f4618064ef0 tx=0x7f4614012cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:25.853 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.837+0000 7f461eb85700 1 -- 172.21.15.174:0/2135491623 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46181226d0 con 0x7f4618065c10 2020-04-02T23:21:25.854 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.837+0000 7f460dffb700 1 -- 172.21.15.174:0/2135491623 <== mon.0 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f4614007140 con 0x7f4618065c10 2020-04-02T23:21:25.854 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.837+0000 7f461d122700 1 --2- 172.21.15.174:0/2135491623 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4618065c10 0x7f4618121e90 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f4618064ef0 tx=0x7f4614012cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:25.854 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.837+0000 7f460dffb700 1 --2- 172.21.15.174:0/2135491623 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f45f804d5a0 0x7f45f804fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:25.854 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.837+0000 7f460dffb700 1 -- 172.21.15.174:0/2135491623 <== mon.0 v2:172.21.15.174:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1844+0+0 (secure 0 0 0) 0x7f46140140c0 con 0x7f4618065c10 2020-04-02T23:21:25.854 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.837+0000 7f461c921700 1 --2- 172.21.15.174:0/2135491623 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f45f804d5a0 0x7f45f804fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:25.854 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.837+0000 7f461c921700 1 --2- 172.21.15.174:0/2135491623 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f45f804d5a0 0x7f45f804fa60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4608002f30 tx=0x7f460800cb70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:25.854 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.837+0000 7f461c921700 1 --2- 172.21.15.174:0/2135491623 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f45f804d5a0 0x7f45f804fa60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4608002f30 tx=0x7f460800cb70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:25.855 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.837+0000 7f461c921700 1 --2- 172.21.15.174:0/2135491623 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f45f804d5a0 0x7f45f804fa60 secure :-1 s=READY pgs=16 cs=0 l=1 rx=0x7f4608002f30 tx=0x7f460800cb70).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:25.855 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.840+0000 7f461d122700 1 --2- 172.21.15.174:0/2135491623 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4618065c10 0x7f4618121e90 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f4618064ef0 tx=0x7f4614012cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:25.855 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.840+0000 7f460dffb700 1 -- 172.21.15.174:0/2135491623 <== mon.0 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f46181226d0 con 0x7f4618065c10 2020-04-02T23:21:26.002 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.991+0000 7f461eb85700 1 -- 172.21.15.174:0/2135491623 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd new", "uuid": "441081ef-133a-41ec-8041-094e129707e3", "id": 6} v 0) v1 -- 0x7f46181226d0 con 0x7f4618065c10 2020-04-02T23:21:26.002 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.994+0000 7f461d122700 1 --2- 172.21.15.174:0/2135491623 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4618065c10 0x7f4618121e90 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f4618064ef0 tx=0x7f4614012cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:26.002 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.994+0000 7f460dffb700 1 -- 172.21.15.174:0/2135491623 <== mon.0 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "441081ef-133a-41ec-8041-094e129707e3", "id": 6}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f46181226d0 con 0x7f4618065c10 2020-04-02T23:21:26.002 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.995+0000 7f461eb85700 1 -- 172.21.15.174:0/2135491623 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f45f804d5a0 msgr2=0x7f45f804fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:26.002 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.995+0000 7f461eb85700 1 --2- 172.21.15.174:0/2135491623 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f45f804d5a0 0x7f45f804fa60 secure :-1 s=READY pgs=16 cs=0 l=1 rx=0x7f4608002f30 tx=0x7f460800cb70).stop 2020-04-02T23:21:26.003 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.995+0000 7f461eb85700 1 -- 172.21.15.174:0/2135491623 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4618065c10 msgr2=0x7f4618121e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:26.003 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.995+0000 7f461eb85700 1 --2- 172.21.15.174:0/2135491623 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4618065c10 0x7f4618121e90 secure :-1 s=READY pgs=31 cs=0 l=1 rx=0x7f4618064ef0 tx=0x7f4614012cd0).stop 2020-04-02T23:21:26.003 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.995+0000 7f461eb85700 1 -- 172.21.15.174:0/2135491623 shutdown_connections 2020-04-02T23:21:26.003 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.995+0000 7f461eb85700 1 --2- 172.21.15.174:0/2135491623 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f45f804d5a0 0x7f45f804fa60 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:26.003 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.995+0000 7f461eb85700 1 --2- 172.21.15.174:0/2135491623 >> v2:172.21.15.196:3300/0 conn(0x7f461809d150 0x7f4618134d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:26.003 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.995+0000 7f461eb85700 1 --2- 172.21.15.174:0/2135491623 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4618065c10 0x7f4618121e90 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:26.003 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.995+0000 7f461eb85700 1 --2- 172.21.15.174:0/2135491623 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f46181222f0 0x7f461809ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:26.004 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.995+0000 7f461eb85700 1 -- 172.21.15.174:0/2135491623 >> 172.21.15.174:0/2135491623 conn(0x7f46180a6d00 msgr2=0x7f46180695c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:26.004 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.995+0000 7f461eb85700 1 -- 172.21.15.174:0/2135491623 shutdown_connections 2020-04-02T23:21:26.004 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:25.996+0000 7f461eb85700 1 -- 172.21.15.174:0/2135491623 wait complete. 2020-04-02T23:21:26.004 INFO:teuthology.orchestra.run.smithi174.stdout:6 2020-04-02T23:21:26.008 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:26.021 INFO:teuthology.orchestra.run.smithi174:> sudo ceph --cluster ceph osd new 17ee8d46-46bf-4ef0-8d02-82cbc4ef5a5e 7 2020-04-02T23:21:26.172 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.162+0000 7f1277c69700 1 Processor -- start 2020-04-02T23:21:26.172 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.162+0000 7f1277c69700 1 -- start start 2020-04-02T23:21:26.172 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.163+0000 7f1277c69700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f127014a9a0 0x7f127014cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:26.173 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.163+0000 7f1277c69700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f127014d1f0 0x7f127014f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:26.173 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.163+0000 7f1277c69700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12700a39a0 con 0x7f127005bdd0 2020-04-02T23:21:26.173 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.163+0000 7f1277c69700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12700a6440 con 0x7f127014d1f0 2020-04-02T23:21:26.173 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.163+0000 7f1277c69700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12700a66e0 con 0x7f127014a9a0 2020-04-02T23:21:26.173 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.163+0000 7f1276206700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f127005bdd0 0x7f12700a3f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:44240/0 (socket says 172.21.15.174:44240) 2020-04-02T23:21:26.173 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.163+0000 7f1276206700 1 -- 172.21.15.174:0/1070296335 learned_addr learned my addr 172.21.15.174:0/1070296335 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:21:26.173 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.163+0000 7f1275a05700 1 --2- 172.21.15.174:0/1070296335 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f127014a9a0 0x7f127014cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:26.174 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.163+0000 7f1276a07700 1 --2- 172.21.15.174:0/1070296335 >> v2:172.21.15.196:3300/0 conn(0x7f127014d1f0 0x7f127014f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:26.174 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.163+0000 7f1275204700 1 -- 172.21.15.174:0/1070296335 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2939254668 0 0) 0x7f12700a39a0 con 0x7f127005bdd0 2020-04-02T23:21:26.174 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.163+0000 7f1275204700 1 -- 172.21.15.174:0/1070296335 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f125c003230 con 0x7f127005bdd0 2020-04-02T23:21:26.174 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.163+0000 7f1275204700 1 -- 172.21.15.174:0/1070296335 <== mon.0 v1:172.21.15.174:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3760551444 0 0) 0x7f125c003230 con 0x7f127005bdd0 2020-04-02T23:21:26.174 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.163+0000 7f1275204700 1 -- 172.21.15.174:0/1070296335 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f127014a9a0 msgr2=0x7f127014cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:26.174 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.163+0000 7f1275204700 1 --2- 172.21.15.174:0/1070296335 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f127014a9a0 0x7f127014cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:26.174 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.163+0000 7f1275204700 1 -- 172.21.15.174:0/1070296335 >> v2:172.21.15.196:3300/0 conn(0x7f127014d1f0 msgr2=0x7f127014f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:26.175 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.163+0000 7f1275204700 1 --2- 172.21.15.174:0/1070296335 >> v2:172.21.15.196:3300/0 conn(0x7f127014d1f0 0x7f127014f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:26.175 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.163+0000 7f1275204700 1 -- 172.21.15.174:0/1070296335 --> v1:172.21.15.174:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12700a6980 con 0x7f127005bdd0 2020-04-02T23:21:26.175 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.163+0000 7f1275204700 1 -- 172.21.15.174:0/1070296335 <== mon.0 v1:172.21.15.174:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2811762909 0 0) 0x7f126c0016d0 con 0x7f127005bdd0 2020-04-02T23:21:26.175 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.163+0000 7f1275204700 1 -- 172.21.15.174:0/1070296335 >> v1:172.21.15.174:6789/0 conn(0x7f127005bdd0 legacy=0x7f12700a3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:26.175 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.164+0000 7f1275204700 1 --2- 172.21.15.174:0/1070296335 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f125c003720 0x7f125c003b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:26.175 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.164+0000 7f1275204700 1 --2- 172.21.15.174:0/1070296335 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f127014a9a0 0x7f125c003ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:26.175 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.164+0000 7f1275204700 1 --2- 172.21.15.174:0/1070296335 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f125c004520 0x7f125c0049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:26.175 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.164+0000 7f1275204700 1 -- 172.21.15.174:0/1070296335 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12700a6440 con 0x7f125c004520 2020-04-02T23:21:26.176 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.164+0000 7f1275204700 1 -- 172.21.15.174:0/1070296335 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12700a66e0 con 0x7f125c003720 2020-04-02T23:21:26.176 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.164+0000 7f1275204700 1 -- 172.21.15.174:0/1070296335 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f125c004fd0 con 0x7f127014a9a0 2020-04-02T23:21:26.176 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.164+0000 7f1276a07700 1 --2- 172.21.15.174:0/1070296335 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f125c004520 0x7f125c0049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:26.176 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.164+0000 7f1275a05700 1 --2- 172.21.15.174:0/1070296335 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f127014a9a0 0x7f125c003ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:26.176 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.164+0000 7f1276206700 1 --2- 172.21.15.174:0/1070296335 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f125c003720 0x7f125c003b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:26.176 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.164+0000 7f1276a07700 1 -- 172.21.15.174:0/1070296335 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f127014a9a0 msgr2=0x7f125c003ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:26.177 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.164+0000 7f1276a07700 1 --2- 172.21.15.174:0/1070296335 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f127014a9a0 0x7f125c003ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:26.177 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.164+0000 7f1276a07700 1 -- 172.21.15.174:0/1070296335 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f125c003720 msgr2=0x7f125c003b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:26.177 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.164+0000 7f1276a07700 1 --2- 172.21.15.174:0/1070296335 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f125c003720 0x7f125c003b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:26.177 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.164+0000 7f1276a07700 1 -- 172.21.15.174:0/1070296335 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f125c003230 con 0x7f125c004520 2020-04-02T23:21:26.177 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.164+0000 7f1275a05700 1 --2- 172.21.15.174:0/1070296335 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f127014a9a0 0x7f125c003ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-02T23:21:26.177 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.164+0000 7f1276a07700 1 --2- 172.21.15.174:0/1070296335 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f125c004520 0x7f125c0049a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f12680032b0 tx=0x7f1268010450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:26.177 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.164+0000 7f1276a07700 1 --2- 172.21.15.174:0/1070296335 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f125c004520 0x7f125c0049a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f12680032b0 tx=0x7f1268010450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:26.178 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.164+0000 7f1276a07700 1 --2- 172.21.15.174:0/1070296335 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f125c004520 0x7f125c0049a0 secure :-1 s=READY pgs=33 cs=0 l=1 rx=0x7f12680032b0 tx=0x7f1268010450).ready entity=mon.0 client_cookie=1d4e16fe6e5740c7 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:26.178 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.164+0000 7f1276a07700 1 --2- 172.21.15.174:0/1070296335 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f125c004520 0x7f125c0049a0 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f12680032b0 tx=0x7f1268010450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:26.178 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.164+0000 7f1275204700 1 -- 172.21.15.174:0/1070296335 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12680112b0 con 0x7f125c004520 2020-04-02T23:21:26.178 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.164+0000 7f1276a07700 1 --2- 172.21.15.174:0/1070296335 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f125c004520 0x7f125c0049a0 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f12680032b0 tx=0x7f1268010450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:26.178 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.164+0000 7f1276a07700 1 --2- 172.21.15.174:0/1070296335 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f125c004520 0x7f125c0049a0 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f12680032b0 tx=0x7f1268010450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:26.178 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.164+0000 7f1275204700 1 -- 172.21.15.174:0/1070296335 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1268011410 con 0x7f125c004520 2020-04-02T23:21:26.179 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.164+0000 7f1275204700 1 -- 172.21.15.174:0/1070296335 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12680117b0 con 0x7f125c004520 2020-04-02T23:21:26.179 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.164+0000 7f1277c69700 1 -- 172.21.15.174:0/1070296335 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f125c004520 msgr2=0x7f125c0049a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:26.179 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.164+0000 7f1277c69700 1 --2- 172.21.15.174:0/1070296335 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f125c004520 0x7f125c0049a0 secure :-1 s=READY pgs=33 cs=0 l=1 rx=0x7f12680032b0 tx=0x7f1268010450).stop 2020-04-02T23:21:26.179 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.164+0000 7f1276a07700 1 -- 172.21.15.174:0/1070296335 reap_dead start 2020-04-02T23:21:26.179 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.165+0000 7f1277c69700 1 -- 172.21.15.174:0/1070296335 shutdown_connections 2020-04-02T23:21:26.179 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.165+0000 7f1277c69700 1 -- 172.21.15.174:0/1070296335 >> 172.21.15.174:0/1070296335 conn(0x7f12700a6d00 msgr2=0x7f12700a7110 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:26.179 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.165+0000 7f1277c69700 1 -- 172.21.15.174:0/1070296335 shutdown_connections 2020-04-02T23:21:26.179 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.165+0000 7f1277c69700 1 -- 172.21.15.174:0/1070296335 wait complete. 2020-04-02T23:21:26.180 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.166+0000 7f1277c69700 1 Processor -- start 2020-04-02T23:21:26.180 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.166+0000 7f1277c69700 1 -- start start 2020-04-02T23:21:26.180 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.167+0000 7f1277c69700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f127007bda0 0x7f127007c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:26.180 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.167+0000 7f1277c69700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f127007c690 0x7f127013a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:26.180 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.167+0000 7f1277c69700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12700a7a30 con 0x7f12700a84e0 2020-04-02T23:21:26.180 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.167+0000 7f1277c69700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12700a1010 con 0x7f127007bda0 2020-04-02T23:21:26.180 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.167+0000 7f1277c69700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12700a4970 con 0x7f127007c690 2020-04-02T23:21:26.181 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.167+0000 7f1275a05700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f127007bda0 0x7f127007c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:26.181 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.167+0000 7f1275a05700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f127007bda0 0x7f127007c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:39214/0 (socket says 172.21.15.174:39214) 2020-04-02T23:21:26.181 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.167+0000 7f1275a05700 1 -- 172.21.15.174:0/588005955 learned_addr learned my addr 172.21.15.174:0/588005955 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:21:26.181 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.167+0000 7f1276a07700 1 --2- 172.21.15.174:0/588005955 >> v2:172.21.15.196:3300/0 conn(0x7f127007c690 0x7f127013a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:26.181 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.167+0000 7f1275a05700 1 -- 172.21.15.174:0/588005955 >> v2:172.21.15.196:3300/0 conn(0x7f127007c690 msgr2=0x7f127013a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:26.181 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.167+0000 7f1275a05700 1 --2- 172.21.15.174:0/588005955 >> v2:172.21.15.196:3300/0 conn(0x7f127007c690 0x7f127013a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:26.181 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.167+0000 7f1275a05700 1 -- 172.21.15.174:0/588005955 >> v1:172.21.15.196:6789/0 conn(0x7f12700a84e0 legacy=0x7f127009f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:26.182 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.167+0000 7f1275a05700 1 -- 172.21.15.174:0/588005955 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f127012a1b0 con 0x7f127007bda0 2020-04-02T23:21:26.182 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.167+0000 7f1276a07700 1 --2- 172.21.15.174:0/588005955 >> v2:172.21.15.196:3300/0 conn(0x7f127007c690 0x7f127013a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-02T23:21:26.182 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.167+0000 7f1275a05700 1 --2- 172.21.15.174:0/588005955 >> v2:172.21.15.174:3300/0 conn(0x7f127007bda0 0x7f127007c230 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1260002f30 tx=0x7f1260010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:26.182 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.167+0000 7f1275a05700 1 --2- 172.21.15.174:0/588005955 >> v2:172.21.15.174:3300/0 conn(0x7f127007bda0 0x7f127007c230 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1260002f30 tx=0x7f1260010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:26.182 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.167+0000 7f1275a05700 1 --2- 172.21.15.174:0/588005955 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f127007bda0 0x7f127007c230 secure :-1 s=READY pgs=34 cs=0 l=1 rx=0x7f1260002f30 tx=0x7f1260010ba0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:26.182 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.167+0000 7f1275a05700 1 --2- 172.21.15.174:0/588005955 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f127007bda0 0x7f127007c230 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f1260002f30 tx=0x7f1260010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:26.182 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.167+0000 7f1275a05700 1 --2- 172.21.15.174:0/588005955 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f127007bda0 0x7f127007c230 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f1260002f30 tx=0x7f1260010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:26.182 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.167+0000 7f1266ffd700 1 -- 172.21.15.174:0/588005955 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1260007530 con 0x7f127007bda0 2020-04-02T23:21:26.183 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.167+0000 7f1275a05700 1 --2- 172.21.15.174:0/588005955 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f127007bda0 0x7f127007c230 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f1260002f30 tx=0x7f1260010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:26.183 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.167+0000 7f1266ffd700 1 -- 172.21.15.174:0/588005955 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12600056c0 con 0x7f127007bda0 2020-04-02T23:21:26.183 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.167+0000 7f1277c69700 1 -- 172.21.15.174:0/588005955 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12700a08d0 con 0x7f127007bda0 2020-04-02T23:21:26.183 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.167+0000 7f1266ffd700 1 -- 172.21.15.174:0/588005955 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1260005ae0 con 0x7f127007bda0 2020-04-02T23:21:26.183 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.167+0000 7f1277c69700 1 -- 172.21.15.174:0/588005955 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f127007cb20 con 0x7f127007bda0 2020-04-02T23:21:26.183 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.168+0000 7f1275a05700 1 --2- 172.21.15.174:0/588005955 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f127007bda0 0x7f127007c230 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f1260002f30 tx=0x7f1260010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:26.183 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.169+0000 7f1266ffd700 1 -- 172.21.15.174:0/588005955 <== mon.0 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f1260005d50 con 0x7f127007bda0 2020-04-02T23:21:26.184 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.169+0000 7f1275a05700 1 --2- 172.21.15.174:0/588005955 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f127007bda0 0x7f127007c230 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f1260002f30 tx=0x7f1260010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:26.184 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.169+0000 7f1277c69700 1 -- 172.21.15.174:0/588005955 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1270056c50 con 0x7f127007bda0 2020-04-02T23:21:26.184 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.169+0000 7f1266ffd700 1 --2- 172.21.15.174:0/588005955 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f125804d460 0x7f125804f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:26.184 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.169+0000 7f1266ffd700 1 -- 172.21.15.174:0/588005955 <== mon.0 v2:172.21.15.174:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1959+0+0 (secure 0 0 0) 0x7f1260061270 con 0x7f127007bda0 2020-04-02T23:21:26.184 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.169+0000 7f1276206700 1 --2- 172.21.15.174:0/588005955 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f125804d460 0x7f125804f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:26.184 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.169+0000 7f1276206700 1 --2- 172.21.15.174:0/588005955 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f125804d460 0x7f125804f920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f12700a0ef0 tx=0x7f126c004520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:26.184 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.169+0000 7f1276206700 1 --2- 172.21.15.174:0/588005955 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f125804d460 0x7f125804f920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f12700a0ef0 tx=0x7f126c004520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:26.185 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.169+0000 7f1276206700 1 --2- 172.21.15.174:0/588005955 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f125804d460 0x7f125804f920 secure :-1 s=READY pgs=17 cs=0 l=1 rx=0x7f12700a0ef0 tx=0x7f126c004520).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:26.185 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.172+0000 7f1275a05700 1 --2- 172.21.15.174:0/588005955 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f127007bda0 0x7f127007c230 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f1260002f30 tx=0x7f1260010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:26.185 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.172+0000 7f1266ffd700 1 -- 172.21.15.174:0/588005955 <== mon.0 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f126003c910 con 0x7f127007bda0 2020-04-02T23:21:26.328 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.325+0000 7f1277c69700 1 -- 172.21.15.174:0/588005955 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd new", "uuid": "17ee8d46-46bf-4ef0-8d02-82cbc4ef5a5e", "id": 7} v 0) v1 -- 0x7f12700a5b40 con 0x7f127007bda0 2020-04-02T23:21:26.331 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.329+0000 7f1275a05700 1 --2- 172.21.15.174:0/588005955 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f127007bda0 0x7f127007c230 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f1260002f30 tx=0x7f1260010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:26.331 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.329+0000 7f1266ffd700 1 -- 172.21.15.174:0/588005955 <== mon.0 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "17ee8d46-46bf-4ef0-8d02-82cbc4ef5a5e", "id": 7}]=0 v11) v1 ==== 112+0+2 (secure 0 0 0) 0x7f126003ff30 con 0x7f127007bda0 2020-04-02T23:21:26.332 INFO:teuthology.orchestra.run.smithi174.stdout:7 2020-04-02T23:21:26.334 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.331+0000 7f1277c69700 1 -- 172.21.15.174:0/588005955 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f125804d460 msgr2=0x7f125804f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:26.334 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.331+0000 7f1277c69700 1 --2- 172.21.15.174:0/588005955 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f125804d460 0x7f125804f920 secure :-1 s=READY pgs=17 cs=0 l=1 rx=0x7f12700a0ef0 tx=0x7f126c004520).stop 2020-04-02T23:21:26.334 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.331+0000 7f1277c69700 1 -- 172.21.15.174:0/588005955 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f127007bda0 msgr2=0x7f127007c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:26.334 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.331+0000 7f1277c69700 1 --2- 172.21.15.174:0/588005955 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f127007bda0 0x7f127007c230 secure :-1 s=READY pgs=34 cs=0 l=1 rx=0x7f1260002f30 tx=0x7f1260010ba0).stop 2020-04-02T23:21:26.334 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.331+0000 7f1277c69700 1 -- 172.21.15.174:0/588005955 shutdown_connections 2020-04-02T23:21:26.334 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.331+0000 7f1277c69700 1 --2- 172.21.15.174:0/588005955 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f125804d460 0x7f125804f920 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:26.335 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.331+0000 7f1277c69700 1 --2- 172.21.15.174:0/588005955 >> v2:172.21.15.196:3300/0 conn(0x7f127007c690 0x7f127013a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:26.335 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.331+0000 7f1277c69700 1 --2- 172.21.15.174:0/588005955 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f127007bda0 0x7f127007c230 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:26.335 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.331+0000 7f1277c69700 1 -- 172.21.15.174:0/588005955 >> 172.21.15.174:0/588005955 conn(0x7f12700a6d00 msgr2=0x7f12700695c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:26.335 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.331+0000 7f1277c69700 1 -- 172.21.15.174:0/588005955 shutdown_connections 2020-04-02T23:21:26.335 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:26.331+0000 7f1277c69700 1 -- 172.21.15.174:0/588005955 wait complete. 2020-04-02T23:21:26.343 INFO:tasks.ceph.osd.4:Restarting daemon 2020-04-02T23:21:26.343 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:26.361 INFO:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2020-04-02T23:21:26.407 INFO:tasks.ceph.osd.4:Started 2020-04-02T23:21:26.407 INFO:tasks.ceph.osd.5:Restarting daemon 2020-04-02T23:21:26.407 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:26.423 INFO:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2020-04-02T23:21:26.468 INFO:tasks.ceph.osd.5:Started 2020-04-02T23:21:26.469 INFO:tasks.ceph.osd.6:Restarting daemon 2020-04-02T23:21:26.469 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:26.487 INFO:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2020-04-02T23:21:26.489 INFO:tasks.ceph.osd.4.smithi196.stderr:2020-04-02T23:21:26.487+0000 7fc5c47a0ec0 -1 Falling back to public interface 2020-04-02T23:21:26.491 INFO:tasks.ceph.osd.6:Started 2020-04-02T23:21:26.491 INFO:tasks.ceph.osd.7:Restarting daemon 2020-04-02T23:21:26.491 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:26.506 INFO:tasks.ceph.osd.4.smithi196.stderr:2020-04-02T23:21:26.499+0000 7fc5c47a0ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-04-02T23:21:26.506 INFO:tasks.ceph.osd.4.smithi196.stderr:2020-04-02T23:21:26.500+0000 7fc5c47a0ec0 -1 journal do_read_entry(8192): bad header magic 2020-04-02T23:21:26.506 INFO:tasks.ceph.osd.4.smithi196.stderr:2020-04-02T23:21:26.500+0000 7fc5c47a0ec0 -1 journal do_read_entry(8192): bad header magic 2020-04-02T23:21:26.507 INFO:tasks.ceph.osd.4.smithi196.stderr:2020-04-02T23:21:26.505+0000 7fc5c47a0ec0 -1 osd.4 0 log_to_monitors {default=true} 2020-04-02T23:21:26.509 INFO:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2020-04-02T23:21:26.551 INFO:tasks.ceph.osd.7:Started 2020-04-02T23:21:26.551 INFO:tasks.ceph.osd.0:Restarting daemon 2020-04-02T23:21:26.551 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:26.552 INFO:tasks.ceph.osd.5.smithi196.stderr:2020-04-02T23:21:26.550+0000 7fd929d6cec0 -1 Falling back to public interface 2020-04-02T23:21:26.565 INFO:tasks.ceph.osd.5.smithi196.stderr:2020-04-02T23:21:26.563+0000 7fd929d6cec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-04-02T23:21:26.565 INFO:tasks.ceph.osd.5.smithi196.stderr:2020-04-02T23:21:26.563+0000 7fd929d6cec0 -1 journal do_read_entry(8192): bad header magic 2020-04-02T23:21:26.565 INFO:tasks.ceph.osd.5.smithi196.stderr:2020-04-02T23:21:26.563+0000 7fd929d6cec0 -1 journal do_read_entry(8192): bad header magic 2020-04-02T23:21:26.566 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2020-04-02T23:21:26.569 INFO:tasks.ceph.osd.5.smithi196.stderr:2020-04-02T23:21:26.568+0000 7fd929d6cec0 -1 osd.5 0 log_to_monitors {default=true} 2020-04-02T23:21:26.576 INFO:tasks.ceph.osd.6.smithi196.stderr:2020-04-02T23:21:26.575+0000 7f3878bf7ec0 -1 Falling back to public interface 2020-04-02T23:21:26.589 INFO:tasks.ceph.osd.6.smithi196.stderr:2020-04-02T23:21:26.587+0000 7f3878bf7ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-04-02T23:21:26.589 INFO:tasks.ceph.osd.6.smithi196.stderr:2020-04-02T23:21:26.587+0000 7f3878bf7ec0 -1 journal do_read_entry(8192): bad header magic 2020-04-02T23:21:26.589 INFO:tasks.ceph.osd.6.smithi196.stderr:2020-04-02T23:21:26.587+0000 7f3878bf7ec0 -1 journal do_read_entry(8192): bad header magic 2020-04-02T23:21:26.594 INFO:tasks.ceph.osd.6.smithi196.stderr:2020-04-02T23:21:26.592+0000 7f3878bf7ec0 -1 osd.6 0 log_to_monitors {default=true} 2020-04-02T23:21:26.609 INFO:tasks.ceph.osd.0:Started 2020-04-02T23:21:26.610 INFO:tasks.ceph.osd.1:Restarting daemon 2020-04-02T23:21:26.610 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:26.624 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2020-04-02T23:21:26.628 INFO:tasks.ceph.osd.7.smithi196.stderr:2020-04-02T23:21:26.627+0000 7f9dce69fec0 -1 Falling back to public interface 2020-04-02T23:21:26.641 INFO:tasks.ceph.osd.7.smithi196.stderr:2020-04-02T23:21:26.639+0000 7f9dce69fec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-04-02T23:21:26.641 INFO:tasks.ceph.osd.7.smithi196.stderr:2020-04-02T23:21:26.640+0000 7f9dce69fec0 -1 journal do_read_entry(8192): bad header magic 2020-04-02T23:21:26.642 INFO:tasks.ceph.osd.7.smithi196.stderr:2020-04-02T23:21:26.640+0000 7f9dce69fec0 -1 journal do_read_entry(8192): bad header magic 2020-04-02T23:21:26.646 INFO:tasks.ceph.osd.7.smithi196.stderr:2020-04-02T23:21:26.644+0000 7f9dce69fec0 -1 osd.7 0 log_to_monitors {default=true} 2020-04-02T23:21:26.666 INFO:tasks.ceph.osd.1:Started 2020-04-02T23:21:26.666 INFO:tasks.ceph.osd.2:Restarting daemon 2020-04-02T23:21:26.666 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:26.680 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2020-04-02T23:21:26.683 INFO:tasks.ceph.osd.0.smithi174.stderr:2020-04-02T23:21:26.681+0000 7f00407b8ec0 -1 Falling back to public interface 2020-04-02T23:21:26.684 INFO:tasks.ceph.osd.2:Started 2020-04-02T23:21:26.685 INFO:tasks.ceph.osd.3:Restarting daemon 2020-04-02T23:21:26.685 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:26.693 INFO:tasks.ceph.osd.0.smithi174.stderr:2020-04-02T23:21:26.691+0000 7f00407b8ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-04-02T23:21:26.693 INFO:tasks.ceph.osd.0.smithi174.stderr:2020-04-02T23:21:26.691+0000 7f00407b8ec0 -1 journal do_read_entry(8192): bad header magic 2020-04-02T23:21:26.693 INFO:tasks.ceph.osd.0.smithi174.stderr:2020-04-02T23:21:26.691+0000 7f00407b8ec0 -1 journal do_read_entry(8192): bad header magic 2020-04-02T23:21:26.699 INFO:tasks.ceph.osd.0.smithi174.stderr:2020-04-02T23:21:26.696+0000 7f00407b8ec0 -1 osd.0 0 log_to_monitors {default=true} 2020-04-02T23:21:26.703 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2020-04-02T23:21:26.745 INFO:tasks.ceph.osd.3:Started 2020-04-02T23:21:26.745 INFO:tasks.ceph:Waiting for OSDs to come up 2020-04-02T23:21:26.754 INFO:tasks.ceph.osd.1.smithi174.stderr:2020-04-02T23:21:26.752+0000 7fd3a0f62ec0 -1 Falling back to public interface 2020-04-02T23:21:26.765 INFO:tasks.ceph.osd.1.smithi174.stderr:2020-04-02T23:21:26.763+0000 7fd3a0f62ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-04-02T23:21:26.765 INFO:tasks.ceph.osd.1.smithi174.stderr:2020-04-02T23:21:26.763+0000 7fd3a0f62ec0 -1 journal do_read_entry(8192): bad header magic 2020-04-02T23:21:26.766 INFO:tasks.ceph.osd.1.smithi174.stderr:2020-04-02T23:21:26.763+0000 7fd3a0f62ec0 -1 journal do_read_entry(8192): bad header magic 2020-04-02T23:21:26.771 INFO:tasks.ceph.osd.1.smithi174.stderr:2020-04-02T23:21:26.769+0000 7fd3a0f62ec0 -1 osd.1 0 log_to_monitors {default=true} 2020-04-02T23:21:26.774 INFO:tasks.ceph.osd.2.smithi174.stderr:2020-04-02T23:21:26.772+0000 7f4c84694ec0 -1 Falling back to public interface 2020-04-02T23:21:26.786 INFO:tasks.ceph.osd.2.smithi174.stderr:2020-04-02T23:21:26.783+0000 7f4c84694ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-04-02T23:21:26.786 INFO:tasks.ceph.osd.2.smithi174.stderr:2020-04-02T23:21:26.783+0000 7f4c84694ec0 -1 journal do_read_entry(8192): bad header magic 2020-04-02T23:21:26.786 INFO:tasks.ceph.osd.2.smithi174.stderr:2020-04-02T23:21:26.783+0000 7f4c84694ec0 -1 journal do_read_entry(8192): bad header magic 2020-04-02T23:21:26.790 INFO:tasks.ceph.osd.2.smithi174.stderr:2020-04-02T23:21:26.788+0000 7f4c84694ec0 -1 osd.2 0 log_to_monitors {default=true} 2020-04-02T23:21:26.821 INFO:tasks.ceph.osd.3.smithi174.stderr:2020-04-02T23:21:26.819+0000 7f2237cb2ec0 -1 Falling back to public interface 2020-04-02T23:21:26.841 INFO:tasks.ceph.osd.3.smithi174.stderr:2020-04-02T23:21:26.831+0000 7f2237cb2ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-04-02T23:21:26.841 INFO:tasks.ceph.osd.3.smithi174.stderr:2020-04-02T23:21:26.831+0000 7f2237cb2ec0 -1 journal do_read_entry(8192): bad header magic 2020-04-02T23:21:26.841 INFO:tasks.ceph.osd.3.smithi174.stderr:2020-04-02T23:21:26.831+0000 7f2237cb2ec0 -1 journal do_read_entry(8192): bad header magic 2020-04-02T23:21:26.842 INFO:tasks.ceph.osd.3.smithi174.stderr:2020-04-02T23:21:26.836+0000 7f2237cb2ec0 -1 osd.3 0 log_to_monitors {default=true} 2020-04-02T23:21:27.552 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:27.567 INFO:teuthology.orchestra.run.smithi174:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2020-04-02T23:21:27.709 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.703+0000 7f88ff9d5700 1 Processor -- start 2020-04-02T23:21:27.709 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.704+0000 7f88ff9d5700 1 -- start start 2020-04-02T23:21:27.709 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.704+0000 7f88ff9d5700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f88f805bfc0 0x7f88f80a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:27.709 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.704+0000 7f88ff9d5700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f88f80a3a40 0x7f88f80a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:27.710 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.704+0000 7f88ff9d5700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88f80a65c0 con 0x7f88f80a4510 2020-04-02T23:21:27.710 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.704+0000 7f88ff9d5700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88f8060620 con 0x7f88f80a3a40 2020-04-02T23:21:27.710 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.704+0000 7f88ff9d5700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88f80a1bf0 con 0x7f88f805bfc0 2020-04-02T23:21:27.710 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.704+0000 7f88fe773700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f88f80a3a40 0x7f88f80a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:27.710 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.704+0000 7f88fe773700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f88f80a3a40 0x7f88f80a52d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:39266/0 (socket says 172.21.15.174:39266) 2020-04-02T23:21:27.710 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.704+0000 7f88fe773700 1 -- 172.21.15.174:0/141035703 learned_addr learned my addr 172.21.15.174:0/141035703 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:21:27.710 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.705+0000 7f88fdf72700 1 --2- 172.21.15.174:0/141035703 >> v2:172.21.15.196:3300/0 conn(0x7f88f805bfc0 0x7f88f80a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:27.711 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.705+0000 7f88fe773700 1 -- 172.21.15.174:0/141035703 >> v2:172.21.15.196:3300/0 conn(0x7f88f805bfc0 msgr2=0x7f88f80a35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:27.711 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.705+0000 7f88fe773700 1 --2- 172.21.15.174:0/141035703 >> v2:172.21.15.196:3300/0 conn(0x7f88f805bfc0 0x7f88f80a35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:27.711 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.705+0000 7f88fe773700 1 -- 172.21.15.174:0/141035703 >> v1:172.21.15.196:6789/0 conn(0x7f88f80a4510 legacy=0x7f88f80a4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:27.711 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.705+0000 7f88fe773700 1 -- 172.21.15.174:0/141035703 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88f807fa40 con 0x7f88f80a3a40 2020-04-02T23:21:27.711 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.705+0000 7f88fdf72700 1 --2- 172.21.15.174:0/141035703 >> v2:172.21.15.196:3300/0 conn(0x7f88f805bfc0 0x7f88f80a35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-02T23:21:27.711 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.705+0000 7f88fe773700 1 --2- 172.21.15.174:0/141035703 >> v2:172.21.15.174:3300/0 conn(0x7f88f80a3a40 0x7f88f80a52d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f88f80a34f0 tx=0x7f88f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:27.711 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.705+0000 7f88fe773700 1 --2- 172.21.15.174:0/141035703 >> v2:172.21.15.174:3300/0 conn(0x7f88f80a3a40 0x7f88f80a52d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f88f80a34f0 tx=0x7f88f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:27.711 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.705+0000 7f88fe773700 1 --2- 172.21.15.174:0/141035703 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f88f80a3a40 0x7f88f80a52d0 secure :-1 s=READY pgs=50 cs=0 l=1 rx=0x7f88f80a34f0 tx=0x7f88f0007a40).ready entity=mon.0 client_cookie=d89a2867ff4054bb server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:27.712 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.705+0000 7f88fe773700 1 --2- 172.21.15.174:0/141035703 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f88f80a3a40 0x7f88f80a52d0 secure :-1 s=THROTTLE_DONE pgs=50 cs=0 l=1 rx=0x7f88f80a34f0 tx=0x7f88f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:27.712 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.705+0000 7f88fcf70700 1 -- 172.21.15.174:0/141035703 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f88f00116e0 con 0x7f88f80a3a40 2020-04-02T23:21:27.712 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.705+0000 7f88fe773700 1 --2- 172.21.15.174:0/141035703 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f88f80a3a40 0x7f88f80a52d0 secure :-1 s=THROTTLE_DONE pgs=50 cs=0 l=1 rx=0x7f88f80a34f0 tx=0x7f88f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:27.712 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.705+0000 7f88fcf70700 1 -- 172.21.15.174:0/141035703 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88f0011840 con 0x7f88f80a3a40 2020-04-02T23:21:27.712 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.705+0000 7f88fe773700 1 --2- 172.21.15.174:0/141035703 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f88f80a3a40 0x7f88f80a52d0 secure :-1 s=THROTTLE_DONE pgs=50 cs=0 l=1 rx=0x7f88f80a34f0 tx=0x7f88f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:27.712 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.705+0000 7f88fcf70700 1 -- 172.21.15.174:0/141035703 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f88f0011c20 con 0x7f88f80a3a40 2020-04-02T23:21:27.713 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.705+0000 7f88ff9d5700 1 -- 172.21.15.174:0/141035703 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f88f80a3a40 msgr2=0x7f88f80a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:27.713 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.705+0000 7f88ff9d5700 1 --2- 172.21.15.174:0/141035703 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f88f80a3a40 0x7f88f80a52d0 secure :-1 s=READY pgs=50 cs=0 l=1 rx=0x7f88f80a34f0 tx=0x7f88f0007a40).stop 2020-04-02T23:21:27.713 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.705+0000 7f88ff9d5700 1 -- 172.21.15.174:0/141035703 shutdown_connections 2020-04-02T23:21:27.713 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.705+0000 7f88ff9d5700 1 --2- 172.21.15.174:0/141035703 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f88f80a3a40 0x7f88f80a52d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:27.713 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.705+0000 7f88ff9d5700 1 --2- 172.21.15.174:0/141035703 >> v2:172.21.15.196:3300/0 conn(0x7f88f805bfc0 0x7f88f80a35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:27.713 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.705+0000 7f88ff9d5700 1 -- 172.21.15.174:0/141035703 >> 172.21.15.174:0/141035703 conn(0x7f88f80aadc0 msgr2=0x7f88f80a6d90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:27.714 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.706+0000 7f88ff9d5700 1 -- 172.21.15.174:0/141035703 shutdown_connections 2020-04-02T23:21:27.714 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.706+0000 7f88ff9d5700 1 -- 172.21.15.174:0/141035703 wait complete. 2020-04-02T23:21:27.714 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.707+0000 7f88ff9d5700 1 Processor -- start 2020-04-02T23:21:27.714 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.707+0000 7f88ff9d5700 1 -- start start 2020-04-02T23:21:27.718 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.707+0000 7f88ff9d5700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f88f80a4510 0x7f88f807ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:27.718 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.707+0000 7f88ff9d5700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88f8136350 con 0x7f88f805bfc0 2020-04-02T23:21:27.719 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.707+0000 7f88ff9d5700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88f80a8ef0 con 0x7f88f80a3a40 2020-04-02T23:21:27.719 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.707+0000 7f88ff9d5700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88f80a0250 con 0x7f88f80a4510 2020-04-02T23:21:27.720 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.707+0000 7f88fe773700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f88f80a4510 0x7f88f807ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:27.720 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.707+0000 7f88fdf72700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f88f805bfc0 0x7f88f8135c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:44306/0 (socket says 172.21.15.174:44306) 2020-04-02T23:21:27.721 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.707+0000 7f88fdf72700 1 -- 172.21.15.174:0/60755336 learned_addr learned my addr 172.21.15.174:0/60755336 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:21:27.721 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.708+0000 7f88fe773700 1 -- 172.21.15.174:0/60755336 >> v1:172.21.15.196:6789/0 conn(0x7f88f80a3a40 legacy=0x7f88f807e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:27.721 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.708+0000 7f88fe773700 1 -- 172.21.15.174:0/60755336 >> v1:172.21.15.174:6789/0 conn(0x7f88f805bfc0 legacy=0x7f88f8135c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:27.722 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.708+0000 7f88fe773700 1 -- 172.21.15.174:0/60755336 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88f8120b30 con 0x7f88f80a4510 2020-04-02T23:21:27.722 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.708+0000 7f88ee7fc700 1 -- 172.21.15.174:0/60755336 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4191671955 0 0) 0x7f88f8136350 con 0x7f88f805bfc0 2020-04-02T23:21:27.723 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.708+0000 7f88fe773700 1 --2- 172.21.15.174:0/60755336 >> v2:172.21.15.174:3300/0 conn(0x7f88f80a4510 0x7f88f807ea00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f88f8122150 tx=0x7f88f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:27.724 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.708+0000 7f88fe773700 1 --2- 172.21.15.174:0/60755336 >> v2:172.21.15.174:3300/0 conn(0x7f88f80a4510 0x7f88f807ea00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f88f8122150 tx=0x7f88f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:27.724 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.708+0000 7f88fe773700 1 --2- 172.21.15.174:0/60755336 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f88f80a4510 0x7f88f807ea00 secure :-1 s=READY pgs=52 cs=0 l=1 rx=0x7f88f8122150 tx=0x7f88f0007a40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:27.724 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.708+0000 7f88fe773700 1 --2- 172.21.15.174:0/60755336 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f88f80a4510 0x7f88f807ea00 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7f88f8122150 tx=0x7f88f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:27.724 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.708+0000 7f88ee7fc700 1 -- 172.21.15.174:0/60755336 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f88f0007340 con 0x7f88f80a4510 2020-04-02T23:21:27.725 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.708+0000 7f88fe773700 1 --2- 172.21.15.174:0/60755336 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f88f80a4510 0x7f88f807ea00 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7f88f8122150 tx=0x7f88f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:27.725 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.708+0000 7f88fe773700 1 --2- 172.21.15.174:0/60755336 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f88f80a4510 0x7f88f807ea00 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7f88f8122150 tx=0x7f88f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:27.725 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.708+0000 7f88ee7fc700 1 -- 172.21.15.174:0/60755336 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88f00074a0 con 0x7f88f80a4510 2020-04-02T23:21:27.725 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.708+0000 7f88ff9d5700 1 -- 172.21.15.174:0/60755336 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88f8120dd0 con 0x7f88f80a4510 2020-04-02T23:21:27.725 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.708+0000 7f88ee7fc700 1 -- 172.21.15.174:0/60755336 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f88f00058b0 con 0x7f88f80a4510 2020-04-02T23:21:27.725 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.708+0000 7f88ff9d5700 1 -- 172.21.15.174:0/60755336 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88f8128940 con 0x7f88f80a4510 2020-04-02T23:21:27.725 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.709+0000 7f88fe773700 1 --2- 172.21.15.174:0/60755336 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f88f80a4510 0x7f88f807ea00 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7f88f8122150 tx=0x7f88f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:27.726 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.709+0000 7f88ee7fc700 1 -- 172.21.15.174:0/60755336 <== mon.0 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f88f0005ae0 con 0x7f88f80a4510 2020-04-02T23:21:27.726 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.709+0000 7f88fe773700 1 --2- 172.21.15.174:0/60755336 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f88f80a4510 0x7f88f807ea00 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7f88f8122150 tx=0x7f88f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:27.726 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.709+0000 7f88ff9d5700 1 -- 172.21.15.174:0/60755336 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88f80a8c10 con 0x7f88f80a4510 2020-04-02T23:21:27.726 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.709+0000 7f88ee7fc700 1 --2- 172.21.15.174:0/60755336 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f88e004d410 0x7f88e004f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:27.726 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.709+0000 7f88ee7fc700 1 -- 172.21.15.174:0/60755336 <== mon.0 v2:172.21.15.174:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2312+0+0 (secure 0 0 0) 0x7f88f00612b0 con 0x7f88f80a4510 2020-04-02T23:21:27.726 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.709+0000 7f88fdf72700 1 --2- 172.21.15.174:0/60755336 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f88e004d410 0x7f88e004f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:27.726 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.710+0000 7f88fdf72700 1 --2- 172.21.15.174:0/60755336 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f88e004d410 0x7f88e004f8d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f88f40033f0 tx=0x7f88f4002850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:27.726 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.710+0000 7f88fdf72700 1 --2- 172.21.15.174:0/60755336 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f88e004d410 0x7f88e004f8d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f88f40033f0 tx=0x7f88f4002850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:27.727 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.710+0000 7f88fdf72700 1 --2- 172.21.15.174:0/60755336 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f88e004d410 0x7f88e004f8d0 secure :-1 s=READY pgs=18 cs=0 l=1 rx=0x7f88f40033f0 tx=0x7f88f4002850).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:27.727 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.712+0000 7f88fe773700 1 --2- 172.21.15.174:0/60755336 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f88f80a4510 0x7f88f807ea00 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7f88f8122150 tx=0x7f88f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:27.727 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.712+0000 7f88ee7fc700 1 -- 172.21.15.174:0/60755336 <== mon.0 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f88f003cad0 con 0x7f88f80a4510 2020-04-02T23:21:27.853 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.850+0000 7f88ff9d5700 1 -- 172.21.15.174:0/60755336 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f88f80a65a0 con 0x7f88f80a4510 2020-04-02T23:21:27.853 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.851+0000 7f88fe773700 1 --2- 172.21.15.174:0/60755336 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f88f80a4510 0x7f88f807ea00 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7f88f8122150 tx=0x7f88f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:27.854 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.851+0000 7f88ee7fc700 1 -- 172.21.15.174:0/60755336 <== mon.0 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+8274 (secure 0 0 0) 0x7f88f00400f0 con 0x7f88f80a4510 2020-04-02T23:21:27.854 INFO:teuthology.misc.health.smithi174.stdout: 2020-04-02T23:21:27.854 INFO:teuthology.misc.health.smithi174.stdout:{"epoch":12,"fsid":"06504ece-4284-40ba-b298-58864abc4224","created":"2020-04-02T23:21:19.153932+0000","modified":"2020-04-02T23:21:27.328399+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-02T23:21:22.199702+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"4","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"c9d748ee-c52f-4f21-b8c9-2a53a937be1d","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"27c05faf-11f5-4cef-9bde-1a6653a9e533","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"02b1b455-b518-4393-b257-40c3a76af157","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d7fb3499-9e13-4076-b3cf-28f27eb62967","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"16923c47-2f21-43ea-9647-5ead4b1b2101","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"7cf2859b-2226-4908-8d70-6e699d1acb0c","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"441081ef-133a-41ec-8041-094e129707e3","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"17ee8d46-46bf-4ef0-8d02-82cbc4ef5a5e","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-02T23:21:27.855 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.852+0000 7f88ff9d5700 1 -- 172.21.15.174:0/60755336 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f88e004d410 msgr2=0x7f88e004f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:27.855 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.852+0000 7f88ff9d5700 1 --2- 172.21.15.174:0/60755336 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f88e004d410 0x7f88e004f8d0 secure :-1 s=READY pgs=18 cs=0 l=1 rx=0x7f88f40033f0 tx=0x7f88f4002850).stop 2020-04-02T23:21:27.855 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.852+0000 7f88ff9d5700 1 -- 172.21.15.174:0/60755336 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f88f80a4510 msgr2=0x7f88f807ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:27.856 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.852+0000 7f88ff9d5700 1 --2- 172.21.15.174:0/60755336 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f88f80a4510 0x7f88f807ea00 secure :-1 s=READY pgs=52 cs=0 l=1 rx=0x7f88f8122150 tx=0x7f88f0007a40).stop 2020-04-02T23:21:27.856 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.852+0000 7f88ff9d5700 1 -- 172.21.15.174:0/60755336 shutdown_connections 2020-04-02T23:21:27.856 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.852+0000 7f88ff9d5700 1 --2- 172.21.15.174:0/60755336 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f88f80a4510 0x7f88f807ea00 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:27.856 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.852+0000 7f88ff9d5700 1 --2- 172.21.15.174:0/60755336 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f88e004d410 0x7f88e004f8d0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:27.856 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.852+0000 7f88ff9d5700 1 -- 172.21.15.174:0/60755336 >> 172.21.15.174:0/60755336 conn(0x7f88f80aadc0 msgr2=0x7f88f8127b20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:27.856 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.852+0000 7f88ff9d5700 1 -- 172.21.15.174:0/60755336 shutdown_connections 2020-04-02T23:21:27.856 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:27.853+0000 7f88ff9d5700 1 -- 172.21.15.174:0/60755336 wait complete. 2020-04-02T23:21:27.866 DEBUG:teuthology.misc:0 of 8 OSDs are up 2020-04-02T23:21:28.343 INFO:tasks.ceph.osd.4.smithi196.stderr:2020-04-02T23:21:28.341+0000 7fc5a7542700 -1 osd.4 0 waiting for initial osdmap 2020-04-02T23:21:28.344 INFO:tasks.ceph.osd.7.smithi196.stderr:2020-04-02T23:21:28.341+0000 7f9db1441700 -1 osd.7 0 waiting for initial osdmap 2020-04-02T23:21:28.347 INFO:tasks.ceph.osd.0.smithi174.stderr:2020-04-02T23:21:28.345+0000 7f002355a700 -1 osd.0 0 waiting for initial osdmap 2020-04-02T23:21:28.348 INFO:tasks.ceph.osd.6.smithi196.stderr:2020-04-02T23:21:28.345+0000 7f385b999700 -1 osd.6 0 waiting for initial osdmap 2020-04-02T23:21:28.348 INFO:tasks.ceph.osd.5.smithi196.stderr:2020-04-02T23:21:28.346+0000 7fd90cb0e700 -1 osd.5 0 waiting for initial osdmap 2020-04-02T23:21:28.349 INFO:tasks.ceph.osd.1.smithi174.stderr:2020-04-02T23:21:28.345+0000 7fd383d04700 -1 osd.1 0 waiting for initial osdmap 2020-04-02T23:21:28.349 INFO:tasks.ceph.osd.3.smithi174.stderr:2020-04-02T23:21:28.346+0000 7f221aa54700 -1 osd.3 0 waiting for initial osdmap 2020-04-02T23:21:28.349 INFO:tasks.ceph.osd.2.smithi174.stderr:2020-04-02T23:21:28.347+0000 7f4c67436700 -1 osd.2 0 waiting for initial osdmap 2020-04-02T23:21:34.673 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:34.694 INFO:teuthology.orchestra.run.smithi174:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2020-04-02T23:21:34.843 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.835+0000 7fe44f613700 1 Processor -- start 2020-04-02T23:21:34.843 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.835+0000 7fe44f613700 1 -- start start 2020-04-02T23:21:34.844 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.836+0000 7fe44f613700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fe4480a4510 0x7fe448148a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:34.844 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.836+0000 7fe44f613700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4480a65c0 con 0x7fe448148e80 2020-04-02T23:21:34.844 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.836+0000 7fe44f613700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4480a3cf0 con 0x7fe44805bfc0 2020-04-02T23:21:34.844 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.836+0000 7fe44f613700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe448060620 con 0x7fe4480a4510 2020-04-02T23:21:34.844 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.836+0000 7fe44e3b1700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fe448148e80 0x7fe4481492f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:44508/0 (socket says 172.21.15.174:44508) 2020-04-02T23:21:34.844 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.836+0000 7fe44e3b1700 1 -- 172.21.15.174:0/1080460325 learned_addr learned my addr 172.21.15.174:0/1080460325 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:21:34.845 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.836+0000 7fe44d3af700 1 --2- 172.21.15.174:0/1080460325 >> v2:172.21.15.196:3300/0 conn(0x7fe4480a4510 0x7fe448148a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:34.845 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.836+0000 7fe44cbae700 1 -- 172.21.15.174:0/1080460325 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1252558984 0 0) 0x7fe440001450 con 0x7fe448148e80 2020-04-02T23:21:34.846 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.836+0000 7fe44cbae700 1 -- 172.21.15.174:0/1080460325 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe434003230 con 0x7fe448148e80 2020-04-02T23:21:34.846 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.837+0000 7fe44cbae700 1 -- 172.21.15.174:0/1080460325 <== mon.0 v1:172.21.15.174:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1411682138 0 0) 0x7fe434003230 con 0x7fe448148e80 2020-04-02T23:21:34.846 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.837+0000 7fe44cbae700 1 -- 172.21.15.174:0/1080460325 >> v2:172.21.15.196:3300/0 conn(0x7fe4480a4510 msgr2=0x7fe448148a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:34.846 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.837+0000 7fe44cbae700 1 --2- 172.21.15.174:0/1080460325 >> v2:172.21.15.196:3300/0 conn(0x7fe4480a4510 0x7fe448148a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:34.846 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.837+0000 7fe44cbae700 1 -- 172.21.15.174:0/1080460325 >> v1:172.21.15.196:6789/0 conn(0x7fe44805bfc0 legacy=0x7fe4480a35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:34.847 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.837+0000 7fe44cbae700 1 -- 172.21.15.174:0/1080460325 --> v1:172.21.15.174:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4480a1bf0 con 0x7fe448148e80 2020-04-02T23:21:34.847 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.837+0000 7fe44cbae700 1 -- 172.21.15.174:0/1080460325 <== mon.0 v1:172.21.15.174:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2811762909 0 0) 0x7fe440001be0 con 0x7fe448148e80 2020-04-02T23:21:34.847 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.837+0000 7fe44cbae700 1 -- 172.21.15.174:0/1080460325 >> v1:172.21.15.174:6789/0 conn(0x7fe448148e80 legacy=0x7fe4481492f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:34.847 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.837+0000 7fe44cbae700 1 --2- 172.21.15.174:0/1080460325 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe434003720 0x7fe434003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:34.847 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.837+0000 7fe44cbae700 1 --2- 172.21.15.174:0/1080460325 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe4340044d0 0x7fe434004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:34.847 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.837+0000 7fe44cbae700 1 --2- 172.21.15.174:0/1080460325 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe434004db0 0x7fe43400b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:34.847 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.837+0000 7fe44cbae700 1 -- 172.21.15.174:0/1080460325 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe448060620 con 0x7fe4340044d0 2020-04-02T23:21:34.847 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.837+0000 7fe44cbae700 1 -- 172.21.15.174:0/1080460325 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4340041c0 con 0x7fe434004db0 2020-04-02T23:21:34.848 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.837+0000 7fe44cbae700 1 -- 172.21.15.174:0/1080460325 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe43404fb90 con 0x7fe434003720 2020-04-02T23:21:34.848 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.837+0000 7fe44d3af700 1 --2- 172.21.15.174:0/1080460325 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe4340044d0 0x7fe434004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:34.848 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.837+0000 7fe44dbb0700 1 --2- 172.21.15.174:0/1080460325 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe434003720 0x7fe434003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:34.848 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.837+0000 7fe44e3b1700 1 --2- 172.21.15.174:0/1080460325 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe434004db0 0x7fe43400b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:34.848 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.837+0000 7fe44d3af700 1 -- 172.21.15.174:0/1080460325 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe434003720 msgr2=0x7fe434003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:34.848 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.837+0000 7fe44d3af700 1 --2- 172.21.15.174:0/1080460325 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe434003720 0x7fe434003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:34.848 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.837+0000 7fe44d3af700 1 -- 172.21.15.174:0/1080460325 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe434004db0 msgr2=0x7fe43400b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:34.848 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.837+0000 7fe44d3af700 1 --2- 172.21.15.174:0/1080460325 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe434004db0 0x7fe43400b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:34.849 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.837+0000 7fe44e3b1700 1 -- 172.21.15.174:0/1080460325 reap_dead start 2020-04-02T23:21:34.849 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.837+0000 7fe44d3af700 1 -- 172.21.15.174:0/1080460325 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe434003230 con 0x7fe4340044d0 2020-04-02T23:21:34.849 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.837+0000 7fe44d3af700 1 --2- 172.21.15.174:0/1080460325 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe4340044d0 0x7fe434004950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe438002f30 tx=0x7fe438010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:34.849 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.837+0000 7fe44d3af700 1 --2- 172.21.15.174:0/1080460325 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe4340044d0 0x7fe434004950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe438002f30 tx=0x7fe438010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:34.849 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.837+0000 7fe44d3af700 1 --2- 172.21.15.174:0/1080460325 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe4340044d0 0x7fe434004950 secure :-1 s=READY pgs=54 cs=0 l=1 rx=0x7fe438002f30 tx=0x7fe438010020).ready entity=mon.0 client_cookie=c1f05d0a0f1a5a50 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:34.849 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.837+0000 7fe44d3af700 1 --2- 172.21.15.174:0/1080460325 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe4340044d0 0x7fe434004950 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7fe438002f30 tx=0x7fe438010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:34.850 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.837+0000 7fe44d3af700 1 --2- 172.21.15.174:0/1080460325 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe4340044d0 0x7fe434004950 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7fe438002f30 tx=0x7fe438010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:34.850 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.837+0000 7fe44cbae700 1 -- 172.21.15.174:0/1080460325 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe438008d30 con 0x7fe4340044d0 2020-04-02T23:21:34.850 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.837+0000 7fe44d3af700 1 --2- 172.21.15.174:0/1080460325 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe4340044d0 0x7fe434004950 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7fe438002f30 tx=0x7fe438010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:34.850 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.837+0000 7fe44cbae700 1 -- 172.21.15.174:0/1080460325 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe438008e90 con 0x7fe4340044d0 2020-04-02T23:21:34.850 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.837+0000 7fe44cbae700 1 -- 172.21.15.174:0/1080460325 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe438010a50 con 0x7fe4340044d0 2020-04-02T23:21:34.850 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.837+0000 7fe44f613700 1 -- 172.21.15.174:0/1080460325 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe4340044d0 msgr2=0x7fe434004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:34.850 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.837+0000 7fe44f613700 1 --2- 172.21.15.174:0/1080460325 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe4340044d0 0x7fe434004950 secure :-1 s=READY pgs=54 cs=0 l=1 rx=0x7fe438002f30 tx=0x7fe438010020).stop 2020-04-02T23:21:34.851 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.838+0000 7fe44f613700 1 -- 172.21.15.174:0/1080460325 shutdown_connections 2020-04-02T23:21:34.851 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.838+0000 7fe44f613700 1 --2- 172.21.15.174:0/1080460325 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe4340044d0 0x7fe434004950 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:34.851 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.838+0000 7fe44f613700 1 -- 172.21.15.174:0/1080460325 >> 172.21.15.174:0/1080460325 conn(0x7fe4480aadc0 msgr2=0x7fe4480a6d90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:34.851 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.838+0000 7fe44f613700 1 -- 172.21.15.174:0/1080460325 shutdown_connections 2020-04-02T23:21:34.851 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.838+0000 7fe44f613700 1 -- 172.21.15.174:0/1080460325 wait complete. 2020-04-02T23:21:34.851 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.839+0000 7fe44f613700 1 Processor -- start 2020-04-02T23:21:34.851 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.839+0000 7fe44f613700 1 -- start start 2020-04-02T23:21:34.852 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.840+0000 7fe44f613700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe4340044d0 0x7fe4480a0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:34.852 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.840+0000 7fe44f613700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe448061c70 0x7fe4481240f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:34.852 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.840+0000 7fe44f613700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fe448124550 0x7fe448132570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:34.852 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.840+0000 7fe44f613700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe448132120 con 0x7fe4340044d0 2020-04-02T23:21:34.852 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.840+0000 7fe44f613700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4480a0600 con 0x7fe448124550 2020-04-02T23:21:34.852 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.840+0000 7fe44f613700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4480a4990 con 0x7fe448061c70 2020-04-02T23:21:34.852 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.840+0000 7fe44dbb0700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe4340044d0 0x7fe4480a0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:34.852 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.840+0000 7fe44dbb0700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe4340044d0 0x7fe4480a0080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:39480/0 (socket says 172.21.15.174:39480) 2020-04-02T23:21:34.853 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.840+0000 7fe44dbb0700 1 -- 172.21.15.174:0/3032463394 learned_addr learned my addr 172.21.15.174:0/3032463394 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:21:34.853 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.840+0000 7fe44d3af700 1 --2- 172.21.15.174:0/3032463394 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe448061c70 0x7fe4481240f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:34.853 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.840+0000 7fe44e3b1700 1 --2- 172.21.15.174:0/3032463394 >> v2:172.21.15.196:3300/0 conn(0x7fe448124550 0x7fe448132570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:34.853 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.840+0000 7fe44dbb0700 1 -- 172.21.15.174:0/3032463394 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe448061c70 msgr2=0x7fe4481240f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:34.853 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.840+0000 7fe44dbb0700 1 --2- 172.21.15.174:0/3032463394 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe448061c70 0x7fe4481240f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:34.853 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.840+0000 7fe44dbb0700 1 -- 172.21.15.174:0/3032463394 >> v2:172.21.15.196:3300/0 conn(0x7fe448124550 msgr2=0x7fe448132570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:34.853 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.840+0000 7fe44dbb0700 1 --2- 172.21.15.174:0/3032463394 >> v2:172.21.15.196:3300/0 conn(0x7fe448124550 0x7fe448132570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:34.854 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.840+0000 7fe44dbb0700 1 -- 172.21.15.174:0/3032463394 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4480620d0 con 0x7fe4340044d0 2020-04-02T23:21:34.854 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.840+0000 7fe44dbb0700 1 --2- 172.21.15.174:0/3032463394 >> v2:172.21.15.174:3300/0 conn(0x7fe4340044d0 0x7fe4480a0080 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe444001170 tx=0x7fe444014f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:34.854 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.840+0000 7fe44dbb0700 1 --2- 172.21.15.174:0/3032463394 >> v2:172.21.15.174:3300/0 conn(0x7fe4340044d0 0x7fe4480a0080 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe444001170 tx=0x7fe444014f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:34.854 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.840+0000 7fe44dbb0700 1 --2- 172.21.15.174:0/3032463394 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe4340044d0 0x7fe4480a0080 secure :-1 s=READY pgs=55 cs=0 l=1 rx=0x7fe444001170 tx=0x7fe444014f00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:34.854 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.840+0000 7fe44dbb0700 1 --2- 172.21.15.174:0/3032463394 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe4340044d0 0x7fe4480a0080 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7fe444001170 tx=0x7fe444014f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:34.854 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.840+0000 7fe44dbb0700 1 --2- 172.21.15.174:0/3032463394 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe4340044d0 0x7fe4480a0080 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7fe444001170 tx=0x7fe444014f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:34.854 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.840+0000 7fe43e7fc700 1 -- 172.21.15.174:0/3032463394 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe4440155f0 con 0x7fe4340044d0 2020-04-02T23:21:34.854 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.840+0000 7fe44dbb0700 1 --2- 172.21.15.174:0/3032463394 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe4340044d0 0x7fe4480a0080 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7fe444001170 tx=0x7fe444014f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:34.855 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.840+0000 7fe43e7fc700 1 -- 172.21.15.174:0/3032463394 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe444015750 con 0x7fe4340044d0 2020-04-02T23:21:34.855 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.840+0000 7fe44f613700 1 -- 172.21.15.174:0/3032463394 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4480a4b80 con 0x7fe4340044d0 2020-04-02T23:21:34.855 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.840+0000 7fe43e7fc700 1 -- 172.21.15.174:0/3032463394 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe444015b30 con 0x7fe4340044d0 2020-04-02T23:21:34.855 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.841+0000 7fe44f613700 1 -- 172.21.15.174:0/3032463394 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe44809f420 con 0x7fe4340044d0 2020-04-02T23:21:34.855 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.841+0000 7fe44dbb0700 1 --2- 172.21.15.174:0/3032463394 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe4340044d0 0x7fe4480a0080 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7fe444001170 tx=0x7fe444014f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:34.855 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.842+0000 7fe43e7fc700 1 -- 172.21.15.174:0/3032463394 <== mon.0 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fe4440064e0 con 0x7fe4340044d0 2020-04-02T23:21:34.855 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.842+0000 7fe44dbb0700 1 --2- 172.21.15.174:0/3032463394 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe4340044d0 0x7fe4480a0080 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7fe444001170 tx=0x7fe444014f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:34.856 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.842+0000 7fe44f613700 1 -- 172.21.15.174:0/3032463394 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe448056c50 con 0x7fe4340044d0 2020-04-02T23:21:34.856 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.842+0000 7fe43e7fc700 1 --2- 172.21.15.174:0/3032463394 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fe43004d5a0 0x7fe43004fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:34.856 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.842+0000 7fe43e7fc700 1 -- 172.21.15.174:0/3032463394 <== mon.0 v2:172.21.15.174:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4900+0+0 (secure 0 0 0) 0x7fe444064ad0 con 0x7fe4340044d0 2020-04-02T23:21:34.856 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.842+0000 7fe44d3af700 1 --2- 172.21.15.174:0/3032463394 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fe43004d5a0 0x7fe43004fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:34.857 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.842+0000 7fe44d3af700 1 --2- 172.21.15.174:0/3032463394 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fe43004d5a0 0x7fe43004fa60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe438002f30 tx=0x7fe438010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:34.857 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.842+0000 7fe44d3af700 1 --2- 172.21.15.174:0/3032463394 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fe43004d5a0 0x7fe43004fa60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe438002f30 tx=0x7fe438010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:34.857 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.842+0000 7fe44d3af700 1 --2- 172.21.15.174:0/3032463394 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fe43004d5a0 0x7fe43004fa60 secure :-1 s=READY pgs=43 cs=0 l=1 rx=0x7fe438002f30 tx=0x7fe438010020).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:34.857 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.845+0000 7fe44dbb0700 1 --2- 172.21.15.174:0/3032463394 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe4340044d0 0x7fe4480a0080 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7fe444001170 tx=0x7fe444014f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:34.858 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.845+0000 7fe43e7fc700 1 -- 172.21.15.174:0/3032463394 <== mon.0 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fe444040170 con 0x7fe4340044d0 2020-04-02T23:21:34.985 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.983+0000 7fe44f613700 1 -- 172.21.15.174:0/3032463394 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe44805ba20 con 0x7fe4340044d0 2020-04-02T23:21:34.985 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.984+0000 7fe44dbb0700 1 --2- 172.21.15.174:0/3032463394 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe4340044d0 0x7fe4480a0080 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7fe444001170 tx=0x7fe444014f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:34.986 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.984+0000 7fe43e7fc700 1 -- 172.21.15.174:0/3032463394 <== mon.0 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+11901 (secure 0 0 0) 0x7fe444043790 con 0x7fe4340044d0 2020-04-02T23:21:34.986 INFO:teuthology.misc.health.smithi174.stdout: 2020-04-02T23:21:34.986 INFO:teuthology.misc.health.smithi174.stdout:{"epoch":16,"fsid":"06504ece-4284-40ba-b298-58864abc4224","created":"2020-04-02T23:21:19.153932+0000","modified":"2020-04-02T23:21:31.361264+0000","last_up_change":"2020-04-02T23:21:29.337390+0000","last_in_change":"2020-04-02T23:21:29.337390+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-02T23:21:22.199702+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"c9d748ee-c52f-4f21-b8c9-2a53a937be1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":24590},{"type":"v1","addr":"172.21.15.174:6801","nonce":24590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":24590},{"type":"v1","addr":"172.21.15.174:6803","nonce":24590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":24590},{"type":"v1","addr":"172.21.15.174:6807","nonce":24590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":24590},{"type":"v1","addr":"172.21.15.174:6805","nonce":24590}]},"public_addr":"172.21.15.174:6801/24590","cluster_addr":"172.21.15.174:6803/24590","heartbeat_back_addr":"172.21.15.174:6807/24590","heartbeat_front_addr":"172.21.15.174:6805/24590","state":["exists","up"]},{"osd":1,"uuid":"27c05faf-11f5-4cef-9bde-1a6653a9e533","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":24754},{"type":"v1","addr":"172.21.15.174:6809","nonce":24754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":24754},{"type":"v1","addr":"172.21.15.174:6811","nonce":24754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":24754},{"type":"v1","addr":"172.21.15.174:6815","nonce":24754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":24754},{"type":"v1","addr":"172.21.15.174:6813","nonce":24754}]},"public_addr":"172.21.15.174:6809/24754","cluster_addr":"172.21.15.174:6811/24754","heartbeat_back_addr":"172.21.15.174:6815/24754","heartbeat_front_addr":"172.21.15.174:6813/24754","state":["exists","up"]},{"osd":2,"uuid":"02b1b455-b518-4393-b257-40c3a76af157","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":24781},{"type":"v1","addr":"172.21.15.174:6817","nonce":24781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":24781},{"type":"v1","addr":"172.21.15.174:6819","nonce":24781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":24781},{"type":"v1","addr":"172.21.15.174:6823","nonce":24781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":24781},{"type":"v1","addr":"172.21.15.174:6821","nonce":24781}]},"public_addr":"172.21.15.174:6817/24781","cluster_addr":"172.21.15.174:6819/24781","heartbeat_back_addr":"172.21.15.174:6823/24781","heartbeat_front_addr":"172.21.15.174:6821/24781","state":["exists","up"]},{"osd":3,"uuid":"d7fb3499-9e13-4076-b3cf-28f27eb62967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":24972},{"type":"v1","addr":"172.21.15.174:6825","nonce":24972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":24972},{"type":"v1","addr":"172.21.15.174:6827","nonce":24972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":24972},{"type":"v1","addr":"172.21.15.174:6831","nonce":24972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":24972},{"type":"v1","addr":"172.21.15.174:6829","nonce":24972}]},"public_addr":"172.21.15.174:6825/24972","cluster_addr":"172.21.15.174:6827/24972","heartbeat_back_addr":"172.21.15.174:6831/24972","heartbeat_front_addr":"172.21.15.174:6829/24972","state":["exists","up"]},{"osd":4,"uuid":"16923c47-2f21-43ea-9647-5ead4b1b2101","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":24034},{"type":"v1","addr":"172.21.15.196:6803","nonce":24034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":24034},{"type":"v1","addr":"172.21.15.196:6805","nonce":24034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":24034},{"type":"v1","addr":"172.21.15.196:6809","nonce":24034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":24034},{"type":"v1","addr":"172.21.15.196:6807","nonce":24034}]},"public_addr":"172.21.15.196:6803/24034","cluster_addr":"172.21.15.196:6805/24034","heartbeat_back_addr":"172.21.15.196:6809/24034","heartbeat_front_addr":"172.21.15.196:6807/24034","state":["exists","up"]},{"osd":5,"uuid":"7cf2859b-2226-4908-8d70-6e699d1acb0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":24190},{"type":"v1","addr":"172.21.15.196:6811","nonce":24190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":24190},{"type":"v1","addr":"172.21.15.196:6813","nonce":24190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":24190},{"type":"v1","addr":"172.21.15.196:6817","nonce":24190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":24190},{"type":"v1","addr":"172.21.15.196:6815","nonce":24190}]},"public_addr":"172.21.15.196:6811/24190","cluster_addr":"172.21.15.196:6813/24190","heartbeat_back_addr":"172.21.15.196:6817/24190","heartbeat_front_addr":"172.21.15.196:6815/24190","state":["exists","up"]},{"osd":6,"uuid":"441081ef-133a-41ec-8041-094e129707e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":24212},{"type":"v1","addr":"172.21.15.196:6819","nonce":24212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":24212},{"type":"v1","addr":"172.21.15.196:6821","nonce":24212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":24212},{"type":"v1","addr":"172.21.15.196:6825","nonce":24212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":24212},{"type":"v1","addr":"172.21.15.196:6823","nonce":24212}]},"public_addr":"172.21.15.196:6819/24212","cluster_addr":"172.21.15.196:6821/24212","heartbeat_back_addr":"172.21.15.196:6825/24212","heartbeat_front_addr":"172.21.15.196:6823/24212","state":["exists","up"]},{"osd":7,"uuid":"17ee8d46-46bf-4ef0-8d02-82cbc4ef5a5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":24408},{"type":"v1","addr":"172.21.15.196:6827","nonce":24408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":24408},{"type":"v1","addr":"172.21.15.196:6829","nonce":24408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":24408},{"type":"v1","addr":"172.21.15.196:6833","nonce":24408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":24408},{"type":"v1","addr":"172.21.15.196:6831","nonce":24408}]},"public_addr":"172.21.15.196:6827/24408","cluster_addr":"172.21.15.196:6829/24408","heartbeat_back_addr":"172.21.15.196:6833/24408","heartbeat_front_addr":"172.21.15.196:6831/24408","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.725574+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.732598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.775890+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.854998+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.545334+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.591623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.627501+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.614807+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-02T23:21:34.987 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.985+0000 7fe44f613700 1 -- 172.21.15.174:0/3032463394 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fe43004d5a0 msgr2=0x7fe43004fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:34.987 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.985+0000 7fe44f613700 1 --2- 172.21.15.174:0/3032463394 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fe43004d5a0 0x7fe43004fa60 secure :-1 s=READY pgs=43 cs=0 l=1 rx=0x7fe438002f30 tx=0x7fe438010020).stop 2020-04-02T23:21:34.987 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.985+0000 7fe44f613700 1 -- 172.21.15.174:0/3032463394 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe4340044d0 msgr2=0x7fe4480a0080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:34.988 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.985+0000 7fe44f613700 1 --2- 172.21.15.174:0/3032463394 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe4340044d0 0x7fe4480a0080 secure :-1 s=READY pgs=55 cs=0 l=1 rx=0x7fe444001170 tx=0x7fe444014f00).stop 2020-04-02T23:21:34.988 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.985+0000 7fe44f613700 1 -- 172.21.15.174:0/3032463394 shutdown_connections 2020-04-02T23:21:34.988 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.985+0000 7fe44f613700 1 --2- 172.21.15.174:0/3032463394 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fe43004d5a0 0x7fe43004fa60 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:34.988 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.985+0000 7fe44f613700 1 --2- 172.21.15.174:0/3032463394 >> v2:172.21.15.196:3300/0 conn(0x7fe448124550 0x7fe448132570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:34.988 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.985+0000 7fe44f613700 1 --2- 172.21.15.174:0/3032463394 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe4340044d0 0x7fe4480a0080 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:34.988 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.985+0000 7fe44f613700 1 --2- 172.21.15.174:0/3032463394 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe448061c70 0x7fe4481240f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:34.988 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.985+0000 7fe44f613700 1 -- 172.21.15.174:0/3032463394 >> 172.21.15.174:0/3032463394 conn(0x7fe4480aadc0 msgr2=0x7fe4480a2490 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:34.989 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.985+0000 7fe44f613700 1 -- 172.21.15.174:0/3032463394 shutdown_connections 2020-04-02T23:21:34.989 INFO:teuthology.misc.health.smithi174.stderr:2020-04-02T23:21:34.985+0000 7fe44f613700 1 -- 172.21.15.174:0/3032463394 wait complete. 2020-04-02T23:21:34.997 DEBUG:teuthology.misc:8 of 8 OSDs are up 2020-04-02T23:21:34.997 INFO:tasks.ceph:Creating RBD pool 2020-04-02T23:21:34.997 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:35.012 INFO:teuthology.orchestra.run.smithi174:> sudo ceph --cluster ceph osd pool create rbd 8 2020-04-02T23:21:35.161 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:35.157+0000 7fa9cf3c9700 1 Processor -- start 2020-04-02T23:21:35.161 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:35.157+0000 7fa9cf3c9700 1 -- start start 2020-04-02T23:21:35.161 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:35.157+0000 7fa9cf3c9700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa9c805bdd0 0x7fa9c80a3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:35.161 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:35.157+0000 7fa9cf3c9700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9c80a6440 con 0x7fa9c80a4380 2020-04-02T23:21:35.161 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:35.157+0000 7fa9cf3c9700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9c80a66e0 con 0x7fa9c80a5240 2020-04-02T23:21:35.161 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:35.157+0000 7fa9cf3c9700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9c80a3a60 con 0x7fa9c805bdd0 2020-04-02T23:21:35.162 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:35.157+0000 7fa9cd966700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa9c805bdd0 0x7fa9c80a3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:35.162 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:35.157+0000 7fa9cd165700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fa9c80a4380 0x7fa9c80a4b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:44526/0 (socket says 172.21.15.174:44526) 2020-04-02T23:21:35.162 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:35.158+0000 7fa9cd165700 1 -- 172.21.15.174:0/1948070924 learned_addr learned my addr 172.21.15.174:0/1948070924 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:21:35.162 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:35.158+0000 7fa9cd966700 1 -- 172.21.15.174:0/1948070924 >> v1:172.21.15.196:6789/0 conn(0x7fa9c80a5240 legacy=0x7fa9c814f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:35.162 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:35.158+0000 7fa9cd966700 1 -- 172.21.15.174:0/1948070924 >> v1:172.21.15.174:6789/0 conn(0x7fa9c80a4380 legacy=0x7fa9c80a4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:35.162 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:35.158+0000 7fa9cd966700 1 -- 172.21.15.174:0/1948070924 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9c80a6980 con 0x7fa9c805bdd0 2020-04-02T23:21:35.162 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:35.158+0000 7fa9cc964700 1 -- 172.21.15.174:0/1948070924 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 870503146 0 0) 0x7fa9c80a6440 con 0x7fa9c80a4380 2020-04-02T23:21:35.162 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:35.158+0000 7fa9cd966700 1 --2- 172.21.15.174:0/1948070924 >> v2:172.21.15.174:3300/0 conn(0x7fa9c805bdd0 0x7fa9c80a3f20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa9c4002f30 tx=0x7fa9c4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:35.163 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:35.158+0000 7fa9cd966700 1 --2- 172.21.15.174:0/1948070924 >> v2:172.21.15.174:3300/0 conn(0x7fa9c805bdd0 0x7fa9c80a3f20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa9c4002f30 tx=0x7fa9c4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:35.163 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:35.158+0000 7fa9cd966700 1 --2- 172.21.15.174:0/1948070924 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9c805bdd0 0x7fa9c80a3f20 secure :-1 s=READY pgs=57 cs=0 l=1 rx=0x7fa9c4002f30 tx=0x7fa9c4007a40).ready entity=mon.0 client_cookie=c972632cc3d3cf7c server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:35.163 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:35.158+0000 7fa9cd966700 1 --2- 172.21.15.174:0/1948070924 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9c805bdd0 0x7fa9c80a3f20 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7fa9c4002f30 tx=0x7fa9c4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:35.163 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:35.158+0000 7fa9cc964700 1 -- 172.21.15.174:0/1948070924 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9c4011470 con 0x7fa9c805bdd0 2020-04-02T23:21:35.163 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:35.158+0000 7fa9cd966700 1 --2- 172.21.15.174:0/1948070924 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9c805bdd0 0x7fa9c80a3f20 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7fa9c4002f30 tx=0x7fa9c4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:35.163 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:35.158+0000 7fa9cc964700 1 -- 172.21.15.174:0/1948070924 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9c40115d0 con 0x7fa9c805bdd0 2020-04-02T23:21:35.163 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:35.158+0000 7fa9cd966700 1 --2- 172.21.15.174:0/1948070924 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9c805bdd0 0x7fa9c80a3f20 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7fa9c4002f30 tx=0x7fa9c4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:35.163 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:35.158+0000 7fa9cc964700 1 -- 172.21.15.174:0/1948070924 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9c40119b0 con 0x7fa9c805bdd0 2020-04-02T23:21:35.164 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:35.158+0000 7fa9cf3c9700 1 -- 172.21.15.174:0/1948070924 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9c805bdd0 msgr2=0x7fa9c80a3f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:35.164 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:35.158+0000 7fa9cf3c9700 1 --2- 172.21.15.174:0/1948070924 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9c805bdd0 0x7fa9c80a3f20 secure :-1 s=READY pgs=57 cs=0 l=1 rx=0x7fa9c4002f30 tx=0x7fa9c4007a40).stop 2020-04-02T23:21:35.164 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:35.159+0000 7fa9cf3c9700 1 -- 172.21.15.174:0/1948070924 shutdown_connections 2020-04-02T23:21:35.164 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:35.159+0000 7fa9cf3c9700 1 --2- 172.21.15.174:0/1948070924 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9c805bdd0 0x7fa9c80a3f20 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:35.164 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:35.159+0000 7fa9cf3c9700 1 -- 172.21.15.174:0/1948070924 >> 172.21.15.174:0/1948070924 conn(0x7fa9c80a6d00 msgr2=0x7fa9c80a7110 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:35.165 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:35.159+0000 7fa9cf3c9700 1 -- 172.21.15.174:0/1948070924 shutdown_connections 2020-04-02T23:21:35.165 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:35.159+0000 7fa9cf3c9700 1 -- 172.21.15.174:0/1948070924 wait complete. 2020-04-02T23:21:35.179 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:35.160+0000 7fa9cf3c9700 1 Processor -- start 2020-04-02T23:21:35.179 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:35.160+0000 7fa9cf3c9700 1 -- start start 2020-04-02T23:21:35.179 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:35.160+0000 7fa9cf3c9700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa9c805bdd0 0x7fa9c8064fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:35.180 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:35.160+0000 7fa9cf3c9700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fa9c80a4380 0x7fa9c8132870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:35.180 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:35.160+0000 7fa9cf3c9700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa9c80a5240 0x7fa9c8132cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:35.180 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:35.160+0000 7fa9cf3c9700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9c8063aa0 con 0x7fa9c805bdd0 2020-04-02T23:21:35.180 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:35.160+0000 7fa9cf3c9700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9c80646d0 con 0x7fa9c80a4380 2020-04-02T23:21:35.180 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:35.160+0000 7fa9cf3c9700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9c8128bc0 con 0x7fa9c80a5240 2020-04-02T23:21:35.180 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:35.160+0000 7fa9cd966700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa9c805bdd0 0x7fa9c8064fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:35.180 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:35.160+0000 7fa9cd966700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa9c805bdd0 0x7fa9c8064fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:39492/0 (socket says 172.21.15.174:39492) 2020-04-02T23:21:35.181 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:35.160+0000 7fa9cd966700 1 -- 172.21.15.174:0/3552290486 learned_addr learned my addr 172.21.15.174:0/3552290486 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:21:35.181 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:35.160+0000 7fa9cd966700 1 -- 172.21.15.174:0/3552290486 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa9c80a5240 msgr2=0x7fa9c8132cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:35.181 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:35.160+0000 7fa9ce167700 1 --2- 172.21.15.174:0/3552290486 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa9c80a5240 0x7fa9c8132cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:35.181 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:35.160+0000 7fa9cd165700 1 --2- 172.21.15.174:0/3552290486 >> v2:172.21.15.196:3300/0 conn(0x7fa9c80a4380 0x7fa9c8132870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:35.181 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:35.161+0000 7fa9cd966700 1 --2- 172.21.15.174:0/3552290486 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa9c80a5240 0x7fa9c8132cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:35.181 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:35.161+0000 7fa9cd966700 1 -- 172.21.15.174:0/3552290486 >> v2:172.21.15.196:3300/0 conn(0x7fa9c80a4380 msgr2=0x7fa9c8132870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:35.181 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:35.161+0000 7fa9cd966700 1 --2- 172.21.15.174:0/3552290486 >> v2:172.21.15.196:3300/0 conn(0x7fa9c80a4380 0x7fa9c8132870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:35.181 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:35.161+0000 7fa9cd966700 1 -- 172.21.15.174:0/3552290486 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9c8062b90 con 0x7fa9c805bdd0 2020-04-02T23:21:35.182 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:35.161+0000 7fa9ce167700 1 --2- 172.21.15.174:0/3552290486 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa9c80a5240 0x7fa9c8132cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-04-02T23:21:35.182 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:35.161+0000 7fa9cd165700 1 --2- 172.21.15.174:0/3552290486 >> v2:172.21.15.196:3300/0 conn(0x7fa9c80a4380 0x7fa9c8132870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-04-02T23:21:35.182 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:35.161+0000 7fa9cd966700 1 --2- 172.21.15.174:0/3552290486 >> v2:172.21.15.174:3300/0 conn(0x7fa9c805bdd0 0x7fa9c8064fc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa9c4002f30 tx=0x7fa9c4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:35.182 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:35.161+0000 7fa9cd966700 1 --2- 172.21.15.174:0/3552290486 >> v2:172.21.15.174:3300/0 conn(0x7fa9c805bdd0 0x7fa9c8064fc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa9c4002f30 tx=0x7fa9c4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:35.182 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:35.161+0000 7fa9cd966700 1 --2- 172.21.15.174:0/3552290486 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9c805bdd0 0x7fa9c8064fc0 secure :-1 s=READY pgs=58 cs=0 l=1 rx=0x7fa9c4002f30 tx=0x7fa9c4007a40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:35.182 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:35.161+0000 7fa9cd966700 1 --2- 172.21.15.174:0/3552290486 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9c805bdd0 0x7fa9c8064fc0 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7fa9c4002f30 tx=0x7fa9c4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:35.182 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:35.161+0000 7fa9be7fc700 1 -- 172.21.15.174:0/3552290486 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9c4007340 con 0x7fa9c805bdd0 2020-04-02T23:21:35.183 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:35.161+0000 7fa9cd966700 1 --2- 172.21.15.174:0/3552290486 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9c805bdd0 0x7fa9c8064fc0 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7fa9c4002f30 tx=0x7fa9c4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:35.183 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:35.161+0000 7fa9cd966700 1 --2- 172.21.15.174:0/3552290486 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9c805bdd0 0x7fa9c8064fc0 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7fa9c4002f30 tx=0x7fa9c4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:35.183 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:35.161+0000 7fa9be7fc700 1 -- 172.21.15.174:0/3552290486 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9c40074a0 con 0x7fa9c805bdd0 2020-04-02T23:21:35.183 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:35.161+0000 7fa9cf3c9700 1 -- 172.21.15.174:0/3552290486 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9c8062dc0 con 0x7fa9c805bdd0 2020-04-02T23:21:35.183 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:35.161+0000 7fa9be7fc700 1 -- 172.21.15.174:0/3552290486 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9c40058b0 con 0x7fa9c805bdd0 2020-04-02T23:21:35.184 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:35.161+0000 7fa9cf3c9700 1 -- 172.21.15.174:0/3552290486 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9c8133130 con 0x7fa9c805bdd0 2020-04-02T23:21:35.184 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:35.161+0000 7fa9cd966700 1 --2- 172.21.15.174:0/3552290486 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9c805bdd0 0x7fa9c8064fc0 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7fa9c4002f30 tx=0x7fa9c4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:35.184 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:35.162+0000 7fa9be7fc700 1 -- 172.21.15.174:0/3552290486 <== mon.0 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fa9c4005b20 con 0x7fa9c805bdd0 2020-04-02T23:21:35.184 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:35.162+0000 7fa9cd966700 1 --2- 172.21.15.174:0/3552290486 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9c805bdd0 0x7fa9c8064fc0 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7fa9c4002f30 tx=0x7fa9c4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:35.184 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:35.162+0000 7fa9cf3c9700 1 -- 172.21.15.174:0/3552290486 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9c8056c50 con 0x7fa9c805bdd0 2020-04-02T23:21:35.184 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:35.162+0000 7fa9be7fc700 1 --2- 172.21.15.174:0/3552290486 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fa9b004d5a0 0x7fa9b004fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:35.184 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:35.162+0000 7fa9be7fc700 1 -- 172.21.15.174:0/3552290486 <== mon.0 v2:172.21.15.174:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4900+0+0 (secure 0 0 0) 0x7fa9c4061900 con 0x7fa9c805bdd0 2020-04-02T23:21:35.193 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:35.162+0000 7fa9cd165700 1 --2- 172.21.15.174:0/3552290486 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fa9b004d5a0 0x7fa9b004fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:35.193 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:35.162+0000 7fa9cd165700 1 --2- 172.21.15.174:0/3552290486 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fa9b004d5a0 0x7fa9b004fa60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa9b8000b80 tx=0x7fa9b80015e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:35.193 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:35.162+0000 7fa9cd165700 1 --2- 172.21.15.174:0/3552290486 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fa9b004d5a0 0x7fa9b004fa60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa9b8000b80 tx=0x7fa9b80015e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:35.193 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:35.162+0000 7fa9cd165700 1 --2- 172.21.15.174:0/3552290486 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fa9b004d5a0 0x7fa9b004fa60 secure :-1 s=READY pgs=44 cs=0 l=1 rx=0x7fa9b8000b80 tx=0x7fa9b80015e0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:35.194 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:35.165+0000 7fa9cd966700 1 --2- 172.21.15.174:0/3552290486 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9c805bdd0 0x7fa9c8064fc0 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7fa9c4002f30 tx=0x7fa9c4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:35.194 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:35.165+0000 7fa9be7fc700 1 -- 172.21.15.174:0/3552290486 <== mon.0 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fa9c403d0c0 con 0x7fa9c805bdd0 2020-04-02T23:21:35.304 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:35.303+0000 7fa9cf3c9700 1 -- 172.21.15.174:0/3552290486 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7fa9c807f230 con 0x7fa9c805bdd0 2020-04-02T23:21:36.128 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.127+0000 7fa9cd966700 1 --2- 172.21.15.174:0/3552290486 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9c805bdd0 0x7fa9c8064fc0 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7fa9c4002f30 tx=0x7fa9c4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:36.128 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.127+0000 7fa9be7fc700 1 -- 172.21.15.174:0/3552290486 <== mon.0 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v17) v1 ==== 109+0+0 (secure 0 0 0) 0x7fa9c40406e0 con 0x7fa9c805bdd0 2020-04-02T23:21:36.131 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.129+0000 7fa9cf3c9700 1 -- 172.21.15.174:0/3552290486 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fa9b004d5a0 msgr2=0x7fa9b004fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:36.131 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.129+0000 7fa9cf3c9700 1 --2- 172.21.15.174:0/3552290486 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fa9b004d5a0 0x7fa9b004fa60 secure :-1 s=READY pgs=44 cs=0 l=1 rx=0x7fa9b8000b80 tx=0x7fa9b80015e0).stop 2020-04-02T23:21:36.131 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.129+0000 7fa9cf3c9700 1 -- 172.21.15.174:0/3552290486 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9c805bdd0 msgr2=0x7fa9c8064fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:36.131 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.129+0000 7fa9cf3c9700 1 --2- 172.21.15.174:0/3552290486 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9c805bdd0 0x7fa9c8064fc0 secure :-1 s=READY pgs=58 cs=0 l=1 rx=0x7fa9c4002f30 tx=0x7fa9c4007a40).stop 2020-04-02T23:21:36.131 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.129+0000 7fa9cf3c9700 1 -- 172.21.15.174:0/3552290486 shutdown_connections 2020-04-02T23:21:36.131 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.129+0000 7fa9cf3c9700 1 --2- 172.21.15.174:0/3552290486 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fa9b004d5a0 0x7fa9b004fa60 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:36.132 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.129+0000 7fa9cf3c9700 1 --2- 172.21.15.174:0/3552290486 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa9c80a5240 0x7fa9c8132cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:36.132 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.129+0000 7fa9cf3c9700 1 --2- 172.21.15.174:0/3552290486 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9c805bdd0 0x7fa9c8064fc0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:36.132 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.129+0000 7fa9cf3c9700 1 --2- 172.21.15.174:0/3552290486 >> v2:172.21.15.196:3300/0 conn(0x7fa9c80a4380 0x7fa9c8132870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:36.132 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.129+0000 7fa9cf3c9700 1 -- 172.21.15.174:0/3552290486 >> 172.21.15.174:0/3552290486 conn(0x7fa9c80a6d00 msgr2=0x7fa9c80695c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:36.132 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.129+0000 7fa9cf3c9700 1 -- 172.21.15.174:0/3552290486 shutdown_connections 2020-04-02T23:21:36.132 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.129+0000 7fa9cf3c9700 1 -- 172.21.15.174:0/3552290486 wait complete. 2020-04-02T23:21:36.133 INFO:teuthology.orchestra.run.smithi174.stderr:pool 'rbd' created 2020-04-02T23:21:36.142 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:36.156 INFO:teuthology.orchestra.run.smithi174:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2020-04-02T23:21:36.314 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.305+0000 7f8ea776f700 1 Processor -- start 2020-04-02T23:21:36.314 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.305+0000 7f8ea776f700 1 -- start start 2020-04-02T23:21:36.314 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.305+0000 7f8ea776f700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8ea014a9a0 0x7f8ea014cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:36.315 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.305+0000 7f8ea776f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ea00a39a0 con 0x7f8ea014d1f0 2020-04-02T23:21:36.315 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.305+0000 7f8ea776f700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ea00a6440 con 0x7f8ea005bdd0 2020-04-02T23:21:36.315 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.305+0000 7f8ea776f700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea00a66e0 con 0x7f8ea014a9a0 2020-04-02T23:21:36.315 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.306+0000 7f8ea650d700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f8ea014d1f0 0x7f8ea014f5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:44542/0 (socket says 172.21.15.174:44542) 2020-04-02T23:21:36.315 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.306+0000 7f8ea650d700 1 -- 172.21.15.174:0/3198618110 learned_addr learned my addr 172.21.15.174:0/3198618110 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:21:36.315 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.306+0000 7f8ea550b700 1 --2- 172.21.15.174:0/3198618110 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8ea014a9a0 0x7f8ea014cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:36.315 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.306+0000 7f8ea4d0a700 1 -- 172.21.15.174:0/3198618110 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1143997872 0 0) 0x7f8ea00a39a0 con 0x7f8ea014d1f0 2020-04-02T23:21:36.316 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.306+0000 7f8ea4d0a700 1 -- 172.21.15.174:0/3198618110 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e8c003230 con 0x7f8ea014d1f0 2020-04-02T23:21:36.316 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.306+0000 7f8ea4d0a700 1 -- 172.21.15.174:0/3198618110 <== mon.0 v1:172.21.15.174:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1216120661 0 0) 0x7f8e8c003230 con 0x7f8ea014d1f0 2020-04-02T23:21:36.316 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.306+0000 7f8ea4d0a700 1 -- 172.21.15.174:0/3198618110 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8ea014a9a0 msgr2=0x7f8ea014cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:36.316 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.306+0000 7f8ea4d0a700 1 --2- 172.21.15.174:0/3198618110 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8ea014a9a0 0x7f8ea014cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:36.316 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.306+0000 7f8ea4d0a700 1 -- 172.21.15.174:0/3198618110 >> v1:172.21.15.196:6789/0 conn(0x7f8ea005bdd0 legacy=0x7f8ea00a3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:36.316 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.306+0000 7f8ea4d0a700 1 -- 172.21.15.174:0/3198618110 --> v1:172.21.15.174:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea00a6980 con 0x7f8ea014d1f0 2020-04-02T23:21:36.316 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.306+0000 7f8ea4d0a700 1 -- 172.21.15.174:0/3198618110 <== mon.0 v1:172.21.15.174:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2811762909 0 0) 0x7f8e98001a50 con 0x7f8ea014d1f0 2020-04-02T23:21:36.317 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.306+0000 7f8ea4d0a700 1 -- 172.21.15.174:0/3198618110 >> v1:172.21.15.174:6789/0 conn(0x7f8ea014d1f0 legacy=0x7f8ea014f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:36.317 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.306+0000 7f8ea4d0a700 1 --2- 172.21.15.174:0/3198618110 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8e8c003750 0x7f8e8c003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:36.317 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.306+0000 7f8ea4d0a700 1 --2- 172.21.15.174:0/3198618110 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8e8c004090 0x7f8e8c004570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:36.318 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.306+0000 7f8ea4d0a700 1 --2- 172.21.15.174:0/3198618110 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8ea014a9a0 0x7f8e8c004b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:36.318 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.306+0000 7f8ea4d0a700 1 -- 172.21.15.174:0/3198618110 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea00a66e0 con 0x7f8e8c003750 2020-04-02T23:21:36.318 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.306+0000 7f8ea4d0a700 1 -- 172.21.15.174:0/3198618110 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8c005010 con 0x7f8e8c004090 2020-04-02T23:21:36.318 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.306+0000 7f8ea4d0a700 1 -- 172.21.15.174:0/3198618110 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8c0051d0 con 0x7f8ea014a9a0 2020-04-02T23:21:36.318 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.306+0000 7f8ea5d0c700 1 --2- 172.21.15.174:0/3198618110 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8e8c003750 0x7f8e8c003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:36.318 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.306+0000 7f8ea650d700 1 --2- 172.21.15.174:0/3198618110 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8ea014a9a0 0x7f8e8c004b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:36.319 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.306+0000 7f8ea550b700 1 --2- 172.21.15.174:0/3198618110 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8e8c004090 0x7f8e8c004570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:36.319 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.306+0000 7f8ea5d0c700 1 -- 172.21.15.174:0/3198618110 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8ea014a9a0 msgr2=0x7f8e8c004b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:36.319 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.306+0000 7f8ea5d0c700 1 --2- 172.21.15.174:0/3198618110 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8ea014a9a0 0x7f8e8c004b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:36.320 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.306+0000 7f8ea5d0c700 1 -- 172.21.15.174:0/3198618110 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8e8c004090 msgr2=0x7f8e8c004570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:36.320 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.306+0000 7f8ea5d0c700 1 --2- 172.21.15.174:0/3198618110 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8e8c004090 0x7f8e8c004570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:36.320 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.306+0000 7f8ea5d0c700 1 -- 172.21.15.174:0/3198618110 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e8c003230 con 0x7f8e8c003750 2020-04-02T23:21:36.320 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.306+0000 7f8ea550b700 1 --2- 172.21.15.174:0/3198618110 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8e8c004090 0x7f8e8c004570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-02T23:21:36.320 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.307+0000 7f8ea5d0c700 1 --2- 172.21.15.174:0/3198618110 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8e8c003750 0x7f8e8c003b70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8ea00a3b30 tx=0x7f8e9400fcf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:36.320 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.307+0000 7f8ea5d0c700 1 --2- 172.21.15.174:0/3198618110 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8e8c003750 0x7f8e8c003b70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8ea00a3b30 tx=0x7f8e9400fcf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:36.321 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.307+0000 7f8ea5d0c700 1 --2- 172.21.15.174:0/3198618110 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8e8c003750 0x7f8e8c003b70 secure :-1 s=READY pgs=60 cs=0 l=1 rx=0x7f8ea00a3b30 tx=0x7f8e9400fcf0).ready entity=mon.0 client_cookie=76b197982fea9d94 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:36.321 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.307+0000 7f8ea5d0c700 1 --2- 172.21.15.174:0/3198618110 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8e8c003750 0x7f8e8c003b70 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7f8ea00a3b30 tx=0x7f8e9400fcf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:36.321 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.307+0000 7f8ea4d0a700 1 -- 172.21.15.174:0/3198618110 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e94003540 con 0x7f8e8c003750 2020-04-02T23:21:36.322 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.307+0000 7f8ea5d0c700 1 --2- 172.21.15.174:0/3198618110 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8e8c003750 0x7f8e8c003b70 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7f8ea00a3b30 tx=0x7f8e9400fcf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:36.322 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.307+0000 7f8ea4d0a700 1 -- 172.21.15.174:0/3198618110 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e940036a0 con 0x7f8e8c003750 2020-04-02T23:21:36.322 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.307+0000 7f8ea5d0c700 1 --2- 172.21.15.174:0/3198618110 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8e8c003750 0x7f8e8c003b70 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7f8ea00a3b30 tx=0x7f8e9400fcf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:36.323 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.307+0000 7f8ea4d0a700 1 -- 172.21.15.174:0/3198618110 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e94003ac0 con 0x7f8e8c003750 2020-04-02T23:21:36.323 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.307+0000 7f8ea776f700 1 -- 172.21.15.174:0/3198618110 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8e8c003750 msgr2=0x7f8e8c003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:36.324 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.307+0000 7f8ea776f700 1 --2- 172.21.15.174:0/3198618110 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8e8c003750 0x7f8e8c003b70 secure :-1 s=READY pgs=60 cs=0 l=1 rx=0x7f8ea00a3b30 tx=0x7f8e9400fcf0).stop 2020-04-02T23:21:36.324 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.307+0000 7f8ea650d700 1 -- 172.21.15.174:0/3198618110 reap_dead start 2020-04-02T23:21:36.324 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.307+0000 7f8ea776f700 1 -- 172.21.15.174:0/3198618110 shutdown_connections 2020-04-02T23:21:36.324 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.307+0000 7f8ea776f700 1 -- 172.21.15.174:0/3198618110 >> 172.21.15.174:0/3198618110 conn(0x7f8ea00a6d00 msgr2=0x7f8ea00a7110 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:36.325 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.307+0000 7f8ea776f700 1 -- 172.21.15.174:0/3198618110 shutdown_connections 2020-04-02T23:21:36.325 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.307+0000 7f8ea776f700 1 -- 172.21.15.174:0/3198618110 wait complete. 2020-04-02T23:21:36.325 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.308+0000 7f8ea776f700 1 Processor -- start 2020-04-02T23:21:36.325 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.308+0000 7f8ea776f700 1 -- start start 2020-04-02T23:21:36.325 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.309+0000 7f8ea776f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8ea009c5e0 0x7f8ea007e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:36.325 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.309+0000 7f8ea776f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ea009d650 con 0x7f8ea0132c90 2020-04-02T23:21:36.326 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.309+0000 7f8ea776f700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ea0123f00 con 0x7f8ea009e930 2020-04-02T23:21:36.326 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.309+0000 7f8ea776f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ea01241a0 con 0x7f8ea009c5e0 2020-04-02T23:21:36.326 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.309+0000 7f8ea550b700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f8ea0132c90 0x7f8ea007ddc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:44552/0 (socket says 172.21.15.174:44552) 2020-04-02T23:21:36.326 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.309+0000 7f8ea550b700 1 -- 172.21.15.174:0/2783527462 learned_addr learned my addr 172.21.15.174:0/2783527462 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:21:36.326 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.309+0000 7f8ea650d700 1 --2- 172.21.15.174:0/2783527462 >> v2:172.21.15.174:3300/0 conn(0x7f8ea009c5e0 0x7f8ea007e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:36.326 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.309+0000 7f8e927fc700 1 -- 172.21.15.174:0/2783527462 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 898794633 0 0) 0x7f8ea009d650 con 0x7f8ea0132c90 2020-04-02T23:21:36.326 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.309+0000 7f8e927fc700 1 -- 172.21.15.174:0/2783527462 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e88003230 con 0x7f8ea0132c90 2020-04-02T23:21:36.327 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.309+0000 7f8ea650d700 1 -- 172.21.15.174:0/2783527462 >> v1:172.21.15.196:6789/0 conn(0x7f8ea009e930 legacy=0x7f8ea0132580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:36.327 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.309+0000 7f8ea650d700 1 -- 172.21.15.174:0/2783527462 >> v1:172.21.15.174:6789/0 conn(0x7f8ea0132c90 legacy=0x7f8ea007ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:36.327 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.309+0000 7f8ea650d700 1 -- 172.21.15.174:0/2783527462 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea0124440 con 0x7f8ea009c5e0 2020-04-02T23:21:36.327 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.309+0000 7f8ea650d700 1 --2- 172.21.15.174:0/2783527462 >> v2:172.21.15.174:3300/0 conn(0x7f8ea009c5e0 0x7f8ea007e4d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8e98001450 tx=0x7f8e98001b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:36.327 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.309+0000 7f8ea650d700 1 --2- 172.21.15.174:0/2783527462 >> v2:172.21.15.174:3300/0 conn(0x7f8ea009c5e0 0x7f8ea007e4d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8e98001450 tx=0x7f8e98001b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:36.327 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.309+0000 7f8ea650d700 1 --2- 172.21.15.174:0/2783527462 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ea009c5e0 0x7f8ea007e4d0 secure :-1 s=READY pgs=62 cs=0 l=1 rx=0x7f8e98001450 tx=0x7f8e98001b50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:36.327 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.310+0000 7f8ea650d700 1 --2- 172.21.15.174:0/2783527462 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ea009c5e0 0x7f8ea007e4d0 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7f8e98001450 tx=0x7f8e98001b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:36.327 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.310+0000 7f8e927fc700 1 -- 172.21.15.174:0/2783527462 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e98011cb0 con 0x7f8ea009c5e0 2020-04-02T23:21:36.328 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.310+0000 7f8ea650d700 1 --2- 172.21.15.174:0/2783527462 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ea009c5e0 0x7f8ea007e4d0 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7f8e98001450 tx=0x7f8e98001b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:36.328 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.310+0000 7f8ea650d700 1 --2- 172.21.15.174:0/2783527462 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ea009c5e0 0x7f8ea007e4d0 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7f8e98001450 tx=0x7f8e98001b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:36.328 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.310+0000 7f8e927fc700 1 -- 172.21.15.174:0/2783527462 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e98011e10 con 0x7f8ea009c5e0 2020-04-02T23:21:36.328 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.310+0000 7f8e927fc700 1 -- 172.21.15.174:0/2783527462 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e9800e340 con 0x7f8ea009c5e0 2020-04-02T23:21:36.328 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.310+0000 7f8ea776f700 1 -- 172.21.15.174:0/2783527462 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ea009ed10 con 0x7f8ea009c5e0 2020-04-02T23:21:36.328 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.310+0000 7f8ea776f700 1 -- 172.21.15.174:0/2783527462 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ea007eaf0 con 0x7f8ea009c5e0 2020-04-02T23:21:36.328 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.310+0000 7f8ea650d700 1 --2- 172.21.15.174:0/2783527462 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ea009c5e0 0x7f8ea007e4d0 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7f8e98001450 tx=0x7f8e98001b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:36.329 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.311+0000 7f8ea776f700 1 -- 172.21.15.174:0/2783527462 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ea0123d60 con 0x7f8ea009c5e0 2020-04-02T23:21:36.329 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.311+0000 7f8e927fc700 1 -- 172.21.15.174:0/2783527462 <== mon.0 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f8e98004930 con 0x7f8ea009c5e0 2020-04-02T23:21:36.330 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.311+0000 7f8ea650d700 1 --2- 172.21.15.174:0/2783527462 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ea009c5e0 0x7f8ea007e4d0 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7f8e98001450 tx=0x7f8e98001b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:36.330 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.311+0000 7f8e927fc700 1 --2- 172.21.15.174:0/2783527462 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f8e8804d8d0 0x7f8e8804fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:36.330 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.311+0000 7f8e927fc700 1 -- 172.21.15.174:0/2783527462 <== mon.0 v2:172.21.15.174:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5242+0+0 (secure 0 0 0) 0x7f8e98060dc0 con 0x7f8ea009c5e0 2020-04-02T23:21:36.330 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.311+0000 7f8ea5d0c700 1 --2- 172.21.15.174:0/2783527462 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f8e8804d8d0 0x7f8e8804fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:36.330 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.311+0000 7f8ea5d0c700 1 --2- 172.21.15.174:0/2783527462 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f8e8804d8d0 0x7f8e8804fd90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8ea014cf20 tx=0x7f8e9400fcf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:36.331 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.312+0000 7f8ea5d0c700 1 --2- 172.21.15.174:0/2783527462 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f8e8804d8d0 0x7f8e8804fd90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8ea014cf20 tx=0x7f8e9400fcf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:36.331 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.312+0000 7f8ea5d0c700 1 --2- 172.21.15.174:0/2783527462 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f8e8804d8d0 0x7f8e8804fd90 secure :-1 s=READY pgs=45 cs=0 l=1 rx=0x7f8ea014cf20 tx=0x7f8e9400fcf0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:36.331 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.314+0000 7f8ea650d700 1 --2- 172.21.15.174:0/2783527462 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ea009c5e0 0x7f8ea007e4d0 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7f8e98001450 tx=0x7f8e98001b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:36.332 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.315+0000 7f8e927fc700 1 -- 172.21.15.174:0/2783527462 <== mon.0 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f8ea0123d60 con 0x7f8ea009c5e0 2020-04-02T23:21:36.452 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:36.451+0000 7f8ea776f700 1 -- 172.21.15.174:0/2783527462 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f8ea0123d60 con 0x7f8ea009c5e0 2020-04-02T23:21:37.133 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.131+0000 7f8ea650d700 1 --2- 172.21.15.174:0/2783527462 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ea009c5e0 0x7f8ea007e4d0 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7f8e98001450 tx=0x7f8e98001b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:37.133 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.131+0000 7f8e927fc700 1 -- 172.21.15.174:0/2783527462 <== mon.0 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v18) v1 ==== 173+0+0 (secure 0 0 0) 0x7f8ea0123d60 con 0x7f8ea009c5e0 2020-04-02T23:21:37.135 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.133+0000 7f8ea776f700 1 -- 172.21.15.174:0/2783527462 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f8e8804d8d0 msgr2=0x7f8e8804fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:37.135 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.133+0000 7f8ea776f700 1 --2- 172.21.15.174:0/2783527462 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f8e8804d8d0 0x7f8e8804fd90 secure :-1 s=READY pgs=45 cs=0 l=1 rx=0x7f8ea014cf20 tx=0x7f8e9400fcf0).stop 2020-04-02T23:21:37.135 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.133+0000 7f8ea776f700 1 -- 172.21.15.174:0/2783527462 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ea009c5e0 msgr2=0x7f8ea007e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:37.135 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.133+0000 7f8ea776f700 1 --2- 172.21.15.174:0/2783527462 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ea009c5e0 0x7f8ea007e4d0 secure :-1 s=READY pgs=62 cs=0 l=1 rx=0x7f8e98001450 tx=0x7f8e98001b50).stop 2020-04-02T23:21:37.135 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.133+0000 7f8ea776f700 1 -- 172.21.15.174:0/2783527462 shutdown_connections 2020-04-02T23:21:37.136 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.133+0000 7f8ea776f700 1 --2- 172.21.15.174:0/2783527462 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ea009c5e0 0x7f8ea007e4d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:37.136 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.133+0000 7f8ea776f700 1 --2- 172.21.15.174:0/2783527462 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f8e8804d8d0 0x7f8e8804fd90 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:37.136 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.133+0000 7f8ea776f700 1 -- 172.21.15.174:0/2783527462 >> 172.21.15.174:0/2783527462 conn(0x7f8ea00a6d00 msgr2=0x7f8ea00695c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:37.136 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.133+0000 7f8ea776f700 1 -- 172.21.15.174:0/2783527462 shutdown_connections 2020-04-02T23:21:37.136 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.133+0000 7f8ea776f700 1 -- 172.21.15.174:0/2783527462 wait complete. 2020-04-02T23:21:37.136 INFO:teuthology.orchestra.run.smithi174.stderr:enabled application 'rbd' on pool 'rbd' 2020-04-02T23:21:37.146 INFO:tasks.ceph:Setting up CephFS filesystem... 2020-04-02T23:21:37.146 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:37.164 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-02T23:21:37.320 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.309+0000 7f9fda8d5700 1 Processor -- start 2020-04-02T23:21:37.320 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.309+0000 7f9fda8d5700 1 -- start start 2020-04-02T23:21:37.320 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.310+0000 7f9fda8d5700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9fd40a7a60 0x7f9fd40a4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:37.320 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.310+0000 7f9fda8d5700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f9fd40a14f0 0x7f9fd40a3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:37.321 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.310+0000 7f9fda8d5700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9fd40a4060 0x7f9fd405ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:37.321 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.310+0000 7f9fda8d5700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fd40a5e70 con 0x7f9fd40a7a60 2020-04-02T23:21:37.321 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.310+0000 7f9fda8d5700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fd40a6aa0 con 0x7f9fd40a14f0 2020-04-02T23:21:37.321 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.310+0000 7f9fda8d5700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd40a5430 con 0x7f9fd40a4060 2020-04-02T23:21:37.321 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.310+0000 7f9fd3fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9fd40a7a60 0x7f9fd40a4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:37.321 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.310+0000 7f9fd3fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9fd40a7a60 0x7f9fd40a4e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:39520/0 (socket says 172.21.15.174:39520) 2020-04-02T23:21:37.321 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.310+0000 7f9fd3fff700 1 -- 172.21.15.174:0/3588137416 learned_addr learned my addr 172.21.15.174:0/3588137416 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:21:37.322 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.310+0000 7f9fd8e72700 1 --2- 172.21.15.174:0/3588137416 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9fd40a4060 0x7f9fd405ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:37.322 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.310+0000 7f9fd37fe700 1 --2- 172.21.15.174:0/3588137416 >> v2:172.21.15.196:3300/0 conn(0x7f9fd40a14f0 0x7f9fd40a3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:37.322 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.310+0000 7f9fd3fff700 1 -- 172.21.15.174:0/3588137416 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9fd40a4060 msgr2=0x7f9fd405ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:37.322 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.310+0000 7f9fd3fff700 1 --2- 172.21.15.174:0/3588137416 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9fd40a4060 0x7f9fd405ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:37.322 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.310+0000 7f9fd3fff700 1 -- 172.21.15.174:0/3588137416 >> v2:172.21.15.196:3300/0 conn(0x7f9fd40a14f0 msgr2=0x7f9fd40a3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:37.322 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.310+0000 7f9fd3fff700 1 --2- 172.21.15.174:0/3588137416 >> v2:172.21.15.196:3300/0 conn(0x7f9fd40a14f0 0x7f9fd40a3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:37.322 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.310+0000 7f9fd3fff700 1 -- 172.21.15.174:0/3588137416 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fd409ed60 con 0x7f9fd40a7a60 2020-04-02T23:21:37.323 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.310+0000 7f9fd37fe700 1 --2- 172.21.15.174:0/3588137416 >> v2:172.21.15.196:3300/0 conn(0x7f9fd40a14f0 0x7f9fd40a3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-02T23:21:37.323 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.310+0000 7f9fd3fff700 1 --2- 172.21.15.174:0/3588137416 >> v2:172.21.15.174:3300/0 conn(0x7f9fd40a7a60 0x7f9fd40a4e00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9fc4002f30 tx=0x7f9fc4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:37.323 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.310+0000 7f9fd3fff700 1 --2- 172.21.15.174:0/3588137416 >> v2:172.21.15.174:3300/0 conn(0x7f9fd40a7a60 0x7f9fd40a4e00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9fc4002f30 tx=0x7f9fc4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:37.323 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.310+0000 7f9fd3fff700 1 --2- 172.21.15.174:0/3588137416 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9fd40a7a60 0x7f9fd40a4e00 secure :-1 s=READY pgs=63 cs=0 l=1 rx=0x7f9fc4002f30 tx=0x7f9fc4007a40).ready entity=mon.0 client_cookie=c6d81e3111ef299e server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:37.323 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.311+0000 7f9fd3fff700 1 --2- 172.21.15.174:0/3588137416 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9fd40a7a60 0x7f9fd40a4e00 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7f9fc4002f30 tx=0x7f9fc4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:37.323 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.311+0000 7f9fd2ffd700 1 -- 172.21.15.174:0/3588137416 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9fc4011720 con 0x7f9fd40a7a60 2020-04-02T23:21:37.323 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.311+0000 7f9fd3fff700 1 --2- 172.21.15.174:0/3588137416 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9fd40a7a60 0x7f9fd40a4e00 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7f9fc4002f30 tx=0x7f9fc4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:37.323 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.311+0000 7f9fd2ffd700 1 -- 172.21.15.174:0/3588137416 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fc4011880 con 0x7f9fd40a7a60 2020-04-02T23:21:37.324 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.311+0000 7f9fd3fff700 1 --2- 172.21.15.174:0/3588137416 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9fd40a7a60 0x7f9fd40a4e00 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7f9fc4002f30 tx=0x7f9fc4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:37.324 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.311+0000 7f9fd2ffd700 1 -- 172.21.15.174:0/3588137416 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9fc4011c60 con 0x7f9fd40a7a60 2020-04-02T23:21:37.324 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.311+0000 7f9fda8d5700 1 -- 172.21.15.174:0/3588137416 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9fd40a7a60 msgr2=0x7f9fd40a4e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:37.324 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.311+0000 7f9fda8d5700 1 --2- 172.21.15.174:0/3588137416 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9fd40a7a60 0x7f9fd40a4e00 secure :-1 s=READY pgs=63 cs=0 l=1 rx=0x7f9fc4002f30 tx=0x7f9fc4007a40).stop 2020-04-02T23:21:37.324 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.311+0000 7f9fda8d5700 1 -- 172.21.15.174:0/3588137416 shutdown_connections 2020-04-02T23:21:37.324 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.311+0000 7f9fda8d5700 1 --2- 172.21.15.174:0/3588137416 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9fd40a4060 0x7f9fd405ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:37.326 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.311+0000 7f9fda8d5700 1 --2- 172.21.15.174:0/3588137416 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9fd40a7a60 0x7f9fd40a4e00 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:37.326 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.311+0000 7f9fda8d5700 1 --2- 172.21.15.174:0/3588137416 >> v2:172.21.15.196:3300/0 conn(0x7f9fd40a14f0 0x7f9fd40a3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:37.327 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.311+0000 7f9fda8d5700 1 -- 172.21.15.174:0/3588137416 >> 172.21.15.174:0/3588137416 conn(0x7f9fd40aaf80 msgr2=0x7f9fd40a6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:37.327 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.311+0000 7f9fda8d5700 1 -- 172.21.15.174:0/3588137416 shutdown_connections 2020-04-02T23:21:37.327 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.311+0000 7f9fda8d5700 1 -- 172.21.15.174:0/3588137416 wait complete. 2020-04-02T23:21:37.327 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.312+0000 7f9fda8d5700 1 Processor -- start 2020-04-02T23:21:37.327 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.312+0000 7f9fda8d5700 1 -- start start 2020-04-02T23:21:37.340 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.313+0000 7f9fda8d5700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9fd40a7a60 0x7f9fd4145520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:37.340 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.313+0000 7f9fda8d5700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fd40a1b00 con 0x7f9fd40a4060 2020-04-02T23:21:37.340 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.313+0000 7f9fda8d5700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fd40a1da0 con 0x7f9fd40a14f0 2020-04-02T23:21:37.341 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.313+0000 7f9fda8d5700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd40a2040 con 0x7f9fd40a7a60 2020-04-02T23:21:37.341 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.313+0000 7f9fd37fe700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f9fd40a4060 0x7f9fd409fe90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:44564/0 (socket says 172.21.15.174:44564) 2020-04-02T23:21:37.341 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.313+0000 7f9fd37fe700 1 -- 172.21.15.174:0/2163582729 learned_addr learned my addr 172.21.15.174:0/2163582729 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:21:37.341 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.313+0000 7f9fd8e72700 1 --2- 172.21.15.174:0/2163582729 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9fd40a7a60 0x7f9fd4145520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:37.341 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.313+0000 7f9fd17fa700 1 -- 172.21.15.174:0/2163582729 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2827253775 0 0) 0x7f9fd40a1b00 con 0x7f9fd40a4060 2020-04-02T23:21:37.342 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.313+0000 7f9fd17fa700 1 -- 172.21.15.174:0/2163582729 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fb4002fe0 con 0x7f9fd40a4060 2020-04-02T23:21:37.342 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.313+0000 7f9fd17fa700 1 -- 172.21.15.174:0/2163582729 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 740670858 0 0) 0x7f9fd40a1da0 con 0x7f9fd40a14f0 2020-04-02T23:21:37.342 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.313+0000 7f9fd17fa700 1 -- 172.21.15.174:0/2163582729 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fd40a1b00 con 0x7f9fd40a14f0 2020-04-02T23:21:37.342 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.313+0000 7f9fd17fa700 1 -- 172.21.15.174:0/2163582729 <== mon.0 v1:172.21.15.174:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2147994263 0 0) 0x7f9fb4002fe0 con 0x7f9fd40a4060 2020-04-02T23:21:37.342 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.313+0000 7f9fd17fa700 1 -- 172.21.15.174:0/2163582729 --> v1:172.21.15.174:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9fd40a1da0 con 0x7f9fd40a4060 2020-04-02T23:21:37.342 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.313+0000 7f9fd17fa700 1 -- 172.21.15.174:0/2163582729 <== mon.0 v1:172.21.15.174:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2811762909 0 0) 0x7f9fc80024c0 con 0x7f9fd40a4060 2020-04-02T23:21:37.343 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.313+0000 7f9fd17fa700 1 -- 172.21.15.174:0/2163582729 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9fd40a7a60 msgr2=0x7f9fd4145520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:37.343 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.313+0000 7f9fd17fa700 1 --2- 172.21.15.174:0/2163582729 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9fd40a7a60 0x7f9fd4145520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:37.343 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.313+0000 7f9fd17fa700 1 -- 172.21.15.174:0/2163582729 >> v1:172.21.15.196:6789/0 conn(0x7f9fd40a14f0 legacy=0x7f9fd4136570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:37.343 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.313+0000 7f9fd17fa700 1 -- 172.21.15.174:0/2163582729 >> v1:172.21.15.174:6789/0 conn(0x7f9fd40a4060 legacy=0x7f9fd409fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:37.343 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.313+0000 7f9fd17fa700 1 --2- 172.21.15.174:0/2163582729 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9fb4004b20 0x7f9fb4004f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:37.343 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.313+0000 7f9fd17fa700 1 --2- 172.21.15.174:0/2163582729 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9fb4003ab0 0x7f9fb4003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:37.343 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.313+0000 7f9fd17fa700 1 --2- 172.21.15.174:0/2163582729 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9fb4004350 0x7f9fb400b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:37.344 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.313+0000 7f9fd17fa700 1 -- 172.21.15.174:0/2163582729 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd40a2040 con 0x7f9fb4004b20 2020-04-02T23:21:37.344 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.313+0000 7f9fd17fa700 1 -- 172.21.15.174:0/2163582729 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb40047d0 con 0x7f9fb4003ab0 2020-04-02T23:21:37.344 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.313+0000 7f9fd17fa700 1 -- 172.21.15.174:0/2163582729 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb400bbb0 con 0x7f9fb4004350 2020-04-02T23:21:37.344 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.314+0000 7f9fd8e72700 1 --2- 172.21.15.174:0/2163582729 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9fd40a7a60 0x7f9fd4145520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:21:37.344 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.314+0000 7f9fd3fff700 1 --2- 172.21.15.174:0/2163582729 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9fb4004b20 0x7f9fb4004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:37.344 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.314+0000 7f9fd37fe700 1 --2- 172.21.15.174:0/2163582729 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9fb4003ab0 0x7f9fb4003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:37.345 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.314+0000 7f9fd8e72700 1 --2- 172.21.15.174:0/2163582729 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9fb4004350 0x7f9fb400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:37.345 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.314+0000 7f9fd3fff700 1 -- 172.21.15.174:0/2163582729 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9fb4004350 msgr2=0x7f9fb400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:37.345 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.314+0000 7f9fd3fff700 1 --2- 172.21.15.174:0/2163582729 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9fb4004350 0x7f9fb400b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:37.345 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.314+0000 7f9fd3fff700 1 -- 172.21.15.174:0/2163582729 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9fb4003ab0 msgr2=0x7f9fb4003ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:37.345 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.314+0000 7f9fd3fff700 1 --2- 172.21.15.174:0/2163582729 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9fb4003ab0 0x7f9fb4003ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:37.345 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.314+0000 7f9fd3fff700 1 -- 172.21.15.174:0/2163582729 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fd40a24e0 con 0x7f9fb4004b20 2020-04-02T23:21:37.345 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.314+0000 7f9fd8e72700 1 --2- 172.21.15.174:0/2163582729 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9fb4004350 0x7f9fb400b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-02T23:21:37.346 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.314+0000 7f9fda8d5700 1 -- 172.21.15.174:0/2163582729 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fd4136c80 con 0x7f9fb4004b20 2020-04-02T23:21:37.346 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.314+0000 7f9fd37fe700 1 --2- 172.21.15.174:0/2163582729 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9fb4003ab0 0x7f9fb4003ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-02T23:21:37.346 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.314+0000 7f9fd3fff700 1 --2- 172.21.15.174:0/2163582729 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9fb4004b20 0x7f9fb4004f40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9fc4007ed0 tx=0x7f9fc4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:37.346 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.314+0000 7f9fda8d5700 1 -- 172.21.15.174:0/2163582729 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fd4067180 con 0x7f9fb4004b20 2020-04-02T23:21:37.346 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.314+0000 7f9fd3fff700 1 --2- 172.21.15.174:0/2163582729 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9fb4004b20 0x7f9fb4004f40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9fc4007ed0 tx=0x7f9fc4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:37.346 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.314+0000 7f9fd3fff700 1 --2- 172.21.15.174:0/2163582729 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9fb4004b20 0x7f9fb4004f40 secure :-1 s=READY pgs=65 cs=0 l=1 rx=0x7f9fc4007ed0 tx=0x7f9fc4007a40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:37.346 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.314+0000 7f9fd3fff700 1 --2- 172.21.15.174:0/2163582729 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9fb4004b20 0x7f9fb4004f40 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f9fc4007ed0 tx=0x7f9fc4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:37.347 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.314+0000 7f9fd17fa700 1 -- 172.21.15.174:0/2163582729 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9fc4007340 con 0x7f9fb4004b20 2020-04-02T23:21:37.347 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.314+0000 7f9fd3fff700 1 --2- 172.21.15.174:0/2163582729 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9fb4004b20 0x7f9fb4004f40 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f9fc4007ed0 tx=0x7f9fc4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:37.347 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.314+0000 7f9fd3fff700 1 --2- 172.21.15.174:0/2163582729 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9fb4004b20 0x7f9fb4004f40 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f9fc4007ed0 tx=0x7f9fc4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:37.347 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.314+0000 7f9fd17fa700 1 -- 172.21.15.174:0/2163582729 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fc40074a0 con 0x7f9fb4004b20 2020-04-02T23:21:37.347 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.314+0000 7f9fd17fa700 1 -- 172.21.15.174:0/2163582729 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9fc40058d0 con 0x7f9fb4004b20 2020-04-02T23:21:37.347 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.315+0000 7f9fd3fff700 1 --2- 172.21.15.174:0/2163582729 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9fb4004b20 0x7f9fb4004f40 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f9fc4007ed0 tx=0x7f9fc4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:37.347 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.315+0000 7f9fda8d5700 1 -- 172.21.15.174:0/2163582729 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fb0003340 con 0x7f9fb4004b20 2020-04-02T23:21:37.348 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.315+0000 7f9fd17fa700 1 -- 172.21.15.174:0/2163582729 <== mon.0 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f9fc4005a30 con 0x7f9fb4004b20 2020-04-02T23:21:37.348 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.315+0000 7f9fd3fff700 1 --2- 172.21.15.174:0/2163582729 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9fb4004b20 0x7f9fb4004f40 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f9fc4007ed0 tx=0x7f9fc4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:37.348 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.315+0000 7f9fd17fa700 1 --2- 172.21.15.174:0/2163582729 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f9fb4055dd0 0x7f9fb4058290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:37.348 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.315+0000 7f9fd17fa700 1 -- 172.21.15.174:0/2163582729 <== mon.0 v2:172.21.15.174:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f9fc4061200 con 0x7f9fb4004b20 2020-04-02T23:21:37.348 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.316+0000 7f9fd37fe700 1 --2- 172.21.15.174:0/2163582729 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f9fb4055dd0 0x7f9fb4058290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:37.348 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.316+0000 7f9fd37fe700 1 --2- 172.21.15.174:0/2163582729 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f9fb4055dd0 0x7f9fb4058290 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9fc8007a40 tx=0x7f9fc8002bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:37.348 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.316+0000 7f9fd37fe700 1 --2- 172.21.15.174:0/2163582729 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f9fb4055dd0 0x7f9fb4058290 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9fc8007a40 tx=0x7f9fc8002bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:37.348 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.316+0000 7f9fd37fe700 1 --2- 172.21.15.174:0/2163582729 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f9fb4055dd0 0x7f9fb4058290 secure :-1 s=READY pgs=46 cs=0 l=1 rx=0x7f9fc8007a40 tx=0x7f9fc8002bf0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:37.349 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.319+0000 7f9fd3fff700 1 --2- 172.21.15.174:0/2163582729 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9fb4004b20 0x7f9fb4004f40 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f9fc4007ed0 tx=0x7f9fc4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:37.349 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.319+0000 7f9fd17fa700 1 -- 172.21.15.174:0/2163582729 <== mon.0 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f9fc403ca00 con 0x7f9fb4004b20 2020-04-02T23:21:37.457 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.455+0000 7f9fda8d5700 1 -- 172.21.15.174:0/2163582729 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9fb00021d0 con 0x7f9fb4004b20 2020-04-02T23:21:37.458 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.456+0000 7f9fd3fff700 1 --2- 172.21.15.174:0/2163582729 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9fb4004b20 0x7f9fb4004f40 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f9fc4007ed0 tx=0x7f9fc4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:37.458 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.456+0000 7f9fd17fa700 1 -- 172.21.15.174:0/2163582729 <== mon.0 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+13287 (secure 0 0 0) 0x7f9fc4040020 con 0x7f9fb4004b20 2020-04-02T23:21:37.459 INFO:teuthology.orchestra.run.smithi174.stdout: 2020-04-02T23:21:37.459 INFO:teuthology.orchestra.run.smithi174.stdout:{"epoch":18,"fsid":"06504ece-4284-40ba-b298-58864abc4224","created":"2020-04-02T23:21:19.153932+0000","modified":"2020-04-02T23:21:37.125880+0000","last_up_change":"2020-04-02T23:21:29.337390+0000","last_in_change":"2020-04-02T23:21:29.337390+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-02T23:21:22.199702+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-02T23:21:35.314601+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"c9d748ee-c52f-4f21-b8c9-2a53a937be1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":24590},{"type":"v1","addr":"172.21.15.174:6801","nonce":24590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":24590},{"type":"v1","addr":"172.21.15.174:6803","nonce":24590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":24590},{"type":"v1","addr":"172.21.15.174:6807","nonce":24590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":24590},{"type":"v1","addr":"172.21.15.174:6805","nonce":24590}]},"public_addr":"172.21.15.174:6801/24590","cluster_addr":"172.21.15.174:6803/24590","heartbeat_back_addr":"172.21.15.174:6807/24590","heartbeat_front_addr":"172.21.15.174:6805/24590","state":["exists","up"]},{"osd":1,"uuid":"27c05faf-11f5-4cef-9bde-1a6653a9e533","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":24754},{"type":"v1","addr":"172.21.15.174:6809","nonce":24754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":24754},{"type":"v1","addr":"172.21.15.174:6811","nonce":24754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":24754},{"type":"v1","addr":"172.21.15.174:6815","nonce":24754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":24754},{"type":"v1","addr":"172.21.15.174:6813","nonce":24754}]},"public_addr":"172.21.15.174:6809/24754","cluster_addr":"172.21.15.174:6811/24754","heartbeat_back_addr":"172.21.15.174:6815/24754","heartbeat_front_addr":"172.21.15.174:6813/24754","state":["exists","up"]},{"osd":2,"uuid":"02b1b455-b518-4393-b257-40c3a76af157","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":24781},{"type":"v1","addr":"172.21.15.174:6817","nonce":24781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":24781},{"type":"v1","addr":"172.21.15.174:6819","nonce":24781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":24781},{"type":"v1","addr":"172.21.15.174:6823","nonce":24781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":24781},{"type":"v1","addr":"172.21.15.174:6821","nonce":24781}]},"public_addr":"172.21.15.174:6817/24781","cluster_addr":"172.21.15.174:6819/24781","heartbeat_back_addr":"172.21.15.174:6823/24781","heartbeat_front_addr":"172.21.15.174:6821/24781","state":["exists","up"]},{"osd":3,"uuid":"d7fb3499-9e13-4076-b3cf-28f27eb62967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":24972},{"type":"v1","addr":"172.21.15.174:6825","nonce":24972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":24972},{"type":"v1","addr":"172.21.15.174:6827","nonce":24972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":24972},{"type":"v1","addr":"172.21.15.174:6831","nonce":24972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":24972},{"type":"v1","addr":"172.21.15.174:6829","nonce":24972}]},"public_addr":"172.21.15.174:6825/24972","cluster_addr":"172.21.15.174:6827/24972","heartbeat_back_addr":"172.21.15.174:6831/24972","heartbeat_front_addr":"172.21.15.174:6829/24972","state":["exists","up"]},{"osd":4,"uuid":"16923c47-2f21-43ea-9647-5ead4b1b2101","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":24034},{"type":"v1","addr":"172.21.15.196:6803","nonce":24034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":24034},{"type":"v1","addr":"172.21.15.196:6805","nonce":24034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":24034},{"type":"v1","addr":"172.21.15.196:6809","nonce":24034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":24034},{"type":"v1","addr":"172.21.15.196:6807","nonce":24034}]},"public_addr":"172.21.15.196:6803/24034","cluster_addr":"172.21.15.196:6805/24034","heartbeat_back_addr":"172.21.15.196:6809/24034","heartbeat_front_addr":"172.21.15.196:6807/24034","state":["exists","up"]},{"osd":5,"uuid":"7cf2859b-2226-4908-8d70-6e699d1acb0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":24190},{"type":"v1","addr":"172.21.15.196:6811","nonce":24190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":24190},{"type":"v1","addr":"172.21.15.196:6813","nonce":24190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":24190},{"type":"v1","addr":"172.21.15.196:6817","nonce":24190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":24190},{"type":"v1","addr":"172.21.15.196:6815","nonce":24190}]},"public_addr":"172.21.15.196:6811/24190","cluster_addr":"172.21.15.196:6813/24190","heartbeat_back_addr":"172.21.15.196:6817/24190","heartbeat_front_addr":"172.21.15.196:6815/24190","state":["exists","up"]},{"osd":6,"uuid":"441081ef-133a-41ec-8041-094e129707e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":24212},{"type":"v1","addr":"172.21.15.196:6819","nonce":24212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":24212},{"type":"v1","addr":"172.21.15.196:6821","nonce":24212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":24212},{"type":"v1","addr":"172.21.15.196:6825","nonce":24212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":24212},{"type":"v1","addr":"172.21.15.196:6823","nonce":24212}]},"public_addr":"172.21.15.196:6819/24212","cluster_addr":"172.21.15.196:6821/24212","heartbeat_back_addr":"172.21.15.196:6825/24212","heartbeat_front_addr":"172.21.15.196:6823/24212","state":["exists","up"]},{"osd":7,"uuid":"17ee8d46-46bf-4ef0-8d02-82cbc4ef5a5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":24408},{"type":"v1","addr":"172.21.15.196:6827","nonce":24408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":24408},{"type":"v1","addr":"172.21.15.196:6829","nonce":24408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":24408},{"type":"v1","addr":"172.21.15.196:6833","nonce":24408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":24408},{"type":"v1","addr":"172.21.15.196:6831","nonce":24408}]},"public_addr":"172.21.15.196:6827/24408","cluster_addr":"172.21.15.196:6829/24408","heartbeat_back_addr":"172.21.15.196:6833/24408","heartbeat_front_addr":"172.21.15.196:6831/24408","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.725574+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.732598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.775890+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.854998+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.545334+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.591623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.627501+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.614807+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-02T23:21:37.461 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.457+0000 7f9fda8d5700 1 -- 172.21.15.174:0/2163582729 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f9fb4055dd0 msgr2=0x7f9fb4058290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:37.461 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.457+0000 7f9fda8d5700 1 --2- 172.21.15.174:0/2163582729 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f9fb4055dd0 0x7f9fb4058290 secure :-1 s=READY pgs=46 cs=0 l=1 rx=0x7f9fc8007a40 tx=0x7f9fc8002bf0).stop 2020-04-02T23:21:37.461 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.457+0000 7f9fda8d5700 1 -- 172.21.15.174:0/2163582729 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9fb4004b20 msgr2=0x7f9fb4004f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:37.461 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.457+0000 7f9fda8d5700 1 --2- 172.21.15.174:0/2163582729 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9fb4004b20 0x7f9fb4004f40 secure :-1 s=READY pgs=65 cs=0 l=1 rx=0x7f9fc4007ed0 tx=0x7f9fc4007a40).stop 2020-04-02T23:21:37.461 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.457+0000 7f9fd8e72700 1 -- 172.21.15.174:0/2163582729 reap_dead start 2020-04-02T23:21:37.461 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.457+0000 7f9fd8e72700 1 -- 172.21.15.174:0/2163582729 reap_dead start 2020-04-02T23:21:37.462 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.458+0000 7f9fda8d5700 1 -- 172.21.15.174:0/2163582729 shutdown_connections 2020-04-02T23:21:37.462 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.458+0000 7f9fda8d5700 1 -- 172.21.15.174:0/2163582729 >> 172.21.15.174:0/2163582729 conn(0x7f9fd40aaf80 msgr2=0x7f9fd40695c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:37.462 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.458+0000 7f9fda8d5700 1 -- 172.21.15.174:0/2163582729 shutdown_connections 2020-04-02T23:21:37.462 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.458+0000 7f9fda8d5700 1 -- 172.21.15.174:0/2163582729 wait complete. 2020-04-02T23:21:37.470 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 1, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-02T23:21:22.199702+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 1, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 1, u'pg_num': 1, u'type': 1, u'grade_table': [], u'pool_name': u'device_health_metrics', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 1, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'mgr_devicehealth': {}}, u'options': {u'pg_num_min': 1}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'16', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool,creating', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-02T23:21:35.314601+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 32769, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-04-02T23:21:37.470 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:37.483 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-04-02T23:21:37.631 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.629+0000 7f38e4c1e700 1 Processor -- start 2020-04-02T23:21:37.631 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.630+0000 7f38e4c1e700 1 -- start start 2020-04-02T23:21:37.638 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.630+0000 7f38e4c1e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f38e00a7a60 0x7f38e00a38f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:37.638 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.630+0000 7f38e4c1e700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f38e00a1fe0 0x7f38e0138480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:37.638 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.630+0000 7f38e4c1e700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38e00a40d0 con 0x7f38e01388e0 2020-04-02T23:21:37.639 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.630+0000 7f38e4c1e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38e00a3ec0 con 0x7f38e00a7a60 2020-04-02T23:21:37.639 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.630+0000 7f38e4c1e700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38e00a4370 con 0x7f38e00a1fe0 2020-04-02T23:21:37.639 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.630+0000 7f38de59c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f38e00a7a60 0x7f38e00a38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:37.639 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.630+0000 7f38de59c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f38e00a7a60 0x7f38e00a38f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:39540/0 (socket says 172.21.15.174:39540) 2020-04-02T23:21:37.639 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.630+0000 7f38de59c700 1 -- 172.21.15.174:0/1223297700 learned_addr learned my addr 172.21.15.174:0/1223297700 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:21:37.639 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.631+0000 7f38ddd9b700 1 --2- 172.21.15.174:0/1223297700 >> v2:172.21.15.196:3300/0 conn(0x7f38e00a1fe0 0x7f38e0138480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:37.639 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.631+0000 7f38de59c700 1 -- 172.21.15.174:0/1223297700 >> v2:172.21.15.196:3300/0 conn(0x7f38e00a1fe0 msgr2=0x7f38e0138480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:37.640 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.631+0000 7f38de59c700 1 --2- 172.21.15.174:0/1223297700 >> v2:172.21.15.196:3300/0 conn(0x7f38e00a1fe0 0x7f38e0138480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:37.640 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.631+0000 7f38de59c700 1 -- 172.21.15.174:0/1223297700 >> v1:172.21.15.196:6789/0 conn(0x7f38e01388e0 legacy=0x7f38e012e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:37.640 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.631+0000 7f38de59c700 1 -- 172.21.15.174:0/1223297700 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38e0138d20 con 0x7f38e00a7a60 2020-04-02T23:21:37.640 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.631+0000 7f38ddd9b700 1 --2- 172.21.15.174:0/1223297700 >> v2:172.21.15.196:3300/0 conn(0x7f38e00a1fe0 0x7f38e0138480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-02T23:21:37.640 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.631+0000 7f38de59c700 1 --2- 172.21.15.174:0/1223297700 >> v2:172.21.15.174:3300/0 conn(0x7f38e00a7a60 0x7f38e00a38f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f38c8002f30 tx=0x7f38c8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:37.640 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.631+0000 7f38de59c700 1 --2- 172.21.15.174:0/1223297700 >> v2:172.21.15.174:3300/0 conn(0x7f38e00a7a60 0x7f38e00a38f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f38c8002f30 tx=0x7f38c8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:37.640 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.631+0000 7f38de59c700 1 --2- 172.21.15.174:0/1223297700 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38e00a7a60 0x7f38e00a38f0 secure :-1 s=READY pgs=66 cs=0 l=1 rx=0x7f38c8002f30 tx=0x7f38c8007a40).ready entity=mon.0 client_cookie=869e3cc1e2d6ea0f server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:37.640 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.631+0000 7f38de59c700 1 --2- 172.21.15.174:0/1223297700 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38e00a7a60 0x7f38e00a38f0 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7f38c8002f30 tx=0x7f38c8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:37.641 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.631+0000 7f38dd59a700 1 -- 172.21.15.174:0/1223297700 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f38c8011720 con 0x7f38e00a7a60 2020-04-02T23:21:37.641 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.631+0000 7f38de59c700 1 --2- 172.21.15.174:0/1223297700 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38e00a7a60 0x7f38e00a38f0 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7f38c8002f30 tx=0x7f38c8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:37.641 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.631+0000 7f38de59c700 1 --2- 172.21.15.174:0/1223297700 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38e00a7a60 0x7f38e00a38f0 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7f38c8002f30 tx=0x7f38c8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:37.641 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.631+0000 7f38dd59a700 1 -- 172.21.15.174:0/1223297700 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38c8011880 con 0x7f38e00a7a60 2020-04-02T23:21:37.641 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.631+0000 7f38dd59a700 1 -- 172.21.15.174:0/1223297700 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f38c8011c60 con 0x7f38e00a7a60 2020-04-02T23:21:37.641 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.631+0000 7f38e4c1e700 1 -- 172.21.15.174:0/1223297700 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38e00a7a60 msgr2=0x7f38e00a38f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:37.641 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.631+0000 7f38e4c1e700 1 --2- 172.21.15.174:0/1223297700 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38e00a7a60 0x7f38e00a38f0 secure :-1 s=READY pgs=66 cs=0 l=1 rx=0x7f38c8002f30 tx=0x7f38c8007a40).stop 2020-04-02T23:21:37.642 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.632+0000 7f38e4c1e700 1 -- 172.21.15.174:0/1223297700 shutdown_connections 2020-04-02T23:21:37.642 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.632+0000 7f38e4c1e700 1 --2- 172.21.15.174:0/1223297700 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38e00a7a60 0x7f38e00a38f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:37.642 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.632+0000 7f38e4c1e700 1 --2- 172.21.15.174:0/1223297700 >> v2:172.21.15.196:3300/0 conn(0x7f38e00a1fe0 0x7f38e0138480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:37.642 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.632+0000 7f38e4c1e700 1 -- 172.21.15.174:0/1223297700 >> 172.21.15.174:0/1223297700 conn(0x7f38e00aaf80 msgr2=0x7f38e00a6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:37.642 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.632+0000 7f38e4c1e700 1 -- 172.21.15.174:0/1223297700 shutdown_connections 2020-04-02T23:21:37.642 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.632+0000 7f38e4c1e700 1 -- 172.21.15.174:0/1223297700 wait complete. 2020-04-02T23:21:37.642 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.632+0000 7f38e4c1e700 1 Processor -- start 2020-04-02T23:21:37.642 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.632+0000 7f38e4c1e700 1 -- start start 2020-04-02T23:21:37.643 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.633+0000 7f38e4c1e700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f38e00a7a60 0x7f38e012ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:37.643 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.633+0000 7f38e4c1e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38e009eac0 con 0x7f38e00a1fe0 2020-04-02T23:21:37.643 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.633+0000 7f38e4c1e700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38e009ed60 con 0x7f38e01388e0 2020-04-02T23:21:37.643 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.633+0000 7f38e4c1e700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38e0067430 con 0x7f38e00a7a60 2020-04-02T23:21:37.644 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.633+0000 7f38de59c700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f38e00a1fe0 0x7f38e012d6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:44580/0 (socket says 172.21.15.174:44580) 2020-04-02T23:21:37.644 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.633+0000 7f38de59c700 1 -- 172.21.15.174:0/2658010220 learned_addr learned my addr 172.21.15.174:0/2658010220 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:21:37.644 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.633+0000 7f38ddd9b700 1 --2- 172.21.15.174:0/2658010220 >> v2:172.21.15.196:3300/0 conn(0x7f38e00a7a60 0x7f38e012ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:37.644 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.633+0000 7f38d77fe700 1 -- 172.21.15.174:0/2658010220 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3401392568 0 0) 0x7f38e009eac0 con 0x7f38e00a1fe0 2020-04-02T23:21:37.644 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.633+0000 7f38d77fe700 1 -- 172.21.15.174:0/2658010220 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38c4002fe0 con 0x7f38e00a1fe0 2020-04-02T23:21:37.645 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.633+0000 7f38ddd9b700 1 -- 172.21.15.174:0/2658010220 >> v1:172.21.15.196:6789/0 conn(0x7f38e01388e0 legacy=0x7f38e0150040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:37.645 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.633+0000 7f38ddd9b700 1 -- 172.21.15.174:0/2658010220 >> v1:172.21.15.174:6789/0 conn(0x7f38e00a1fe0 legacy=0x7f38e012d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:37.645 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.633+0000 7f38d77fe700 1 -- 172.21.15.174:0/2658010220 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2615136208 0 0) 0x7f38e009ed60 con 0x7f38e01388e0 2020-04-02T23:21:37.645 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.633+0000 7f38ddd9b700 1 -- 172.21.15.174:0/2658010220 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38e0067570 con 0x7f38e00a7a60 2020-04-02T23:21:37.645 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.634+0000 7f38ddd9b700 1 --2- 172.21.15.174:0/2658010220 >> v2:172.21.15.196:3300/0 conn(0x7f38e00a7a60 0x7f38e012ddc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f38d0002f30 tx=0x7f38d0010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:37.645 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.634+0000 7f38ddd9b700 1 --2- 172.21.15.174:0/2658010220 >> v2:172.21.15.196:3300/0 conn(0x7f38e00a7a60 0x7f38e012ddc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f38d0002f30 tx=0x7f38d0010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:37.646 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.634+0000 7f38ddd9b700 1 --2- 172.21.15.174:0/2658010220 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f38e00a7a60 0x7f38e012ddc0 secure :-1 s=READY pgs=59 cs=0 l=1 rx=0x7f38d0002f30 tx=0x7f38d0010a90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:37.646 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.634+0000 7f38ddd9b700 1 --2- 172.21.15.174:0/2658010220 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f38e00a7a60 0x7f38e012ddc0 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f38d0002f30 tx=0x7f38d0010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:37.646 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.634+0000 7f38d77fe700 1 -- 172.21.15.174:0/2658010220 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f38d0005e90 con 0x7f38e00a7a60 2020-04-02T23:21:37.646 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.634+0000 7f38ddd9b700 1 --2- 172.21.15.174:0/2658010220 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f38e00a7a60 0x7f38e012ddc0 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f38d0002f30 tx=0x7f38d0010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:37.646 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.634+0000 7f38e4c1e700 1 -- 172.21.15.174:0/2658010220 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38e009e670 con 0x7f38e00a7a60 2020-04-02T23:21:37.646 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.634+0000 7f38d77fe700 1 -- 172.21.15.174:0/2658010220 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38d0007160 con 0x7f38e00a7a60 2020-04-02T23:21:37.646 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.634+0000 7f38ddd9b700 1 --2- 172.21.15.174:0/2658010220 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f38e00a7a60 0x7f38e012ddc0 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f38d0002f30 tx=0x7f38d0010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:37.647 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.634+0000 7f38d77fe700 1 -- 172.21.15.174:0/2658010220 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f38d0007580 con 0x7f38e00a7a60 2020-04-02T23:21:37.647 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.634+0000 7f38e4c1e700 1 -- 172.21.15.174:0/2658010220 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38e0135af0 con 0x7f38e00a7a60 2020-04-02T23:21:37.647 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.635+0000 7f38ddd9b700 1 --2- 172.21.15.174:0/2658010220 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f38e00a7a60 0x7f38e012ddc0 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f38d0002f30 tx=0x7f38d0010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:37.647 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.635+0000 7f38e4c1e700 1 -- 172.21.15.174:0/2658010220 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38e0056c50 con 0x7f38e00a7a60 2020-04-02T23:21:37.647 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.635+0000 7f38d77fe700 1 -- 172.21.15.174:0/2658010220 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f38d000e170 con 0x7f38e00a7a60 2020-04-02T23:21:37.647 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.635+0000 7f38ddd9b700 1 --2- 172.21.15.174:0/2658010220 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f38e00a7a60 0x7f38e012ddc0 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f38d0002f30 tx=0x7f38d0010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:37.647 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.635+0000 7f38d77fe700 1 --2- 172.21.15.174:0/2658010220 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f38c404d850 0x7f38c404fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:37.647 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.635+0000 7f38d77fe700 1 -- 172.21.15.174:0/2658010220 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f38d0007e40 con 0x7f38e00a7a60 2020-04-02T23:21:37.648 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.635+0000 7f38de59c700 1 --2- 172.21.15.174:0/2658010220 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f38c404d850 0x7f38c404fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:37.648 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.636+0000 7f38de59c700 1 --2- 172.21.15.174:0/2658010220 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f38c404d850 0x7f38c404fd10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f38e009f610 tx=0x7f38c8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:37.648 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.636+0000 7f38de59c700 1 --2- 172.21.15.174:0/2658010220 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f38c404d850 0x7f38c404fd10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f38e009f610 tx=0x7f38c8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:37.648 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.636+0000 7f38de59c700 1 --2- 172.21.15.174:0/2658010220 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f38c404d850 0x7f38c404fd10 secure :-1 s=READY pgs=47 cs=0 l=1 rx=0x7f38e009f610 tx=0x7f38c8007a40).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:37.649 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.639+0000 7f38ddd9b700 1 --2- 172.21.15.174:0/2658010220 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f38e00a7a60 0x7f38e012ddc0 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f38d0002f30 tx=0x7f38d0010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:37.649 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.639+0000 7f38d77fe700 1 -- 172.21.15.174:0/2658010220 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f38d003c210 con 0x7f38e00a7a60 2020-04-02T23:21:37.785 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.783+0000 7f38e4c1e700 1 -- 172.21.15.174:0/2658010220 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f38e0067570 con 0x7f38e00a7a60 2020-04-02T23:21:37.785 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.784+0000 7f38ddd9b700 1 --2- 172.21.15.174:0/2658010220 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f38e00a7a60 0x7f38e012ddc0 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f38d0002f30 tx=0x7f38d0010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:37.785 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.784+0000 7f38d77fe700 1 -- 172.21.15.174:0/2658010220 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v18) v1 ==== 110+0+10 (secure 0 0 0) 0x7f38d000a020 con 0x7f38e00a7a60 2020-04-02T23:21:37.786 INFO:teuthology.orchestra.run.smithi174.stdout:pg_num: 1 2020-04-02T23:21:37.787 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.785+0000 7f38e4c1e700 1 -- 172.21.15.174:0/2658010220 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f38c404d850 msgr2=0x7f38c404fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:37.787 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.785+0000 7f38e4c1e700 1 --2- 172.21.15.174:0/2658010220 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f38c404d850 0x7f38c404fd10 secure :-1 s=READY pgs=47 cs=0 l=1 rx=0x7f38e009f610 tx=0x7f38c8007a40).stop 2020-04-02T23:21:37.787 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.785+0000 7f38e4c1e700 1 -- 172.21.15.174:0/2658010220 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f38e00a7a60 msgr2=0x7f38e012ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:37.788 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.785+0000 7f38e4c1e700 1 --2- 172.21.15.174:0/2658010220 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f38e00a7a60 0x7f38e012ddc0 secure :-1 s=READY pgs=59 cs=0 l=1 rx=0x7f38d0002f30 tx=0x7f38d0010a90).stop 2020-04-02T23:21:37.788 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.785+0000 7f38e4c1e700 1 -- 172.21.15.174:0/2658010220 shutdown_connections 2020-04-02T23:21:37.788 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.785+0000 7f38e4c1e700 1 --2- 172.21.15.174:0/2658010220 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f38c404d850 0x7f38c404fd10 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:37.788 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.785+0000 7f38e4c1e700 1 --2- 172.21.15.174:0/2658010220 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f38e00a7a60 0x7f38e012ddc0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:37.788 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.785+0000 7f38e4c1e700 1 -- 172.21.15.174:0/2658010220 >> 172.21.15.174:0/2658010220 conn(0x7f38e00aaf80 msgr2=0x7f38e00a8350 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:37.788 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.786+0000 7f38e4c1e700 1 -- 172.21.15.174:0/2658010220 shutdown_connections 2020-04-02T23:21:37.797 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.786+0000 7f38e4c1e700 1 -- 172.21.15.174:0/2658010220 wait complete. 2020-04-02T23:21:37.798 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:37.812 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-04-02T23:21:37.959 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.958+0000 7f24505ca700 1 Processor -- start 2020-04-02T23:21:37.959 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.958+0000 7f24505ca700 1 -- start start 2020-04-02T23:21:37.965 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.959+0000 7f24505ca700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f24480a7a60 0x7f24480a38f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:37.966 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.959+0000 7f24505ca700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f24480a1fe0 0x7f2448138480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:37.966 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.959+0000 7f24505ca700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f24481388e0 0x7f244812e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:37.966 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.959+0000 7f24505ca700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24480a3ec0 con 0x7f24480a7a60 2020-04-02T23:21:37.966 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.959+0000 7f24505ca700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24480a40d0 con 0x7f24480a1fe0 2020-04-02T23:21:37.966 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.959+0000 7f24505ca700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24480a4370 con 0x7f24481388e0 2020-04-02T23:21:37.966 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.959+0000 7f244e366700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f24480a7a60 0x7f24480a38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:37.966 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.959+0000 7f244e366700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f24480a7a60 0x7f24480a38f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:39550/0 (socket says 172.21.15.174:39550) 2020-04-02T23:21:37.967 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.959+0000 7f244e366700 1 -- 172.21.15.174:0/2227804951 learned_addr learned my addr 172.21.15.174:0/2227804951 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:21:37.967 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.959+0000 7f244eb67700 1 --2- 172.21.15.174:0/2227804951 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f24481388e0 0x7f244812e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:37.967 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.959+0000 7f244db65700 1 --2- 172.21.15.174:0/2227804951 >> v2:172.21.15.196:3300/0 conn(0x7f24480a1fe0 0x7f2448138480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:37.967 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.959+0000 7f244e366700 1 -- 172.21.15.174:0/2227804951 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f24481388e0 msgr2=0x7f244812e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:37.968 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.959+0000 7f244e366700 1 --2- 172.21.15.174:0/2227804951 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f24481388e0 0x7f244812e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:37.968 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.959+0000 7f244e366700 1 -- 172.21.15.174:0/2227804951 >> v2:172.21.15.196:3300/0 conn(0x7f24480a1fe0 msgr2=0x7f2448138480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:37.968 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.959+0000 7f244e366700 1 --2- 172.21.15.174:0/2227804951 >> v2:172.21.15.196:3300/0 conn(0x7f24480a1fe0 0x7f2448138480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:37.968 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.959+0000 7f244e366700 1 -- 172.21.15.174:0/2227804951 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2448138d70 con 0x7f24480a7a60 2020-04-02T23:21:37.968 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.959+0000 7f244db65700 1 --2- 172.21.15.174:0/2227804951 >> v2:172.21.15.196:3300/0 conn(0x7f24480a1fe0 0x7f2448138480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-02T23:21:37.968 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.959+0000 7f244eb67700 1 --2- 172.21.15.174:0/2227804951 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f24481388e0 0x7f244812e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-02T23:21:37.968 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.959+0000 7f244e366700 1 --2- 172.21.15.174:0/2227804951 >> v2:172.21.15.174:3300/0 conn(0x7f24480a7a60 0x7f24480a38f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f24400032b0 tx=0x7f2440007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:37.969 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.959+0000 7f244e366700 1 --2- 172.21.15.174:0/2227804951 >> v2:172.21.15.174:3300/0 conn(0x7f24480a7a60 0x7f24480a38f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f24400032b0 tx=0x7f2440007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:37.969 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.959+0000 7f244e366700 1 --2- 172.21.15.174:0/2227804951 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f24480a7a60 0x7f24480a38f0 secure :-1 s=READY pgs=68 cs=0 l=1 rx=0x7f24400032b0 tx=0x7f2440007dc0).ready entity=mon.0 client_cookie=7fd01c9df0ceeb05 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:37.969 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.959+0000 7f244e366700 1 --2- 172.21.15.174:0/2227804951 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f24480a7a60 0x7f24480a38f0 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7f24400032b0 tx=0x7f2440007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:37.969 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.959+0000 7f244d364700 1 -- 172.21.15.174:0/2227804951 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f244000a160 con 0x7f24480a7a60 2020-04-02T23:21:37.969 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.959+0000 7f244e366700 1 --2- 172.21.15.174:0/2227804951 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f24480a7a60 0x7f24480a38f0 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7f24400032b0 tx=0x7f2440007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:37.969 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.959+0000 7f244d364700 1 -- 172.21.15.174:0/2227804951 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f244000a2c0 con 0x7f24480a7a60 2020-04-02T23:21:37.970 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.959+0000 7f244e366700 1 --2- 172.21.15.174:0/2227804951 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f24480a7a60 0x7f24480a38f0 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7f24400032b0 tx=0x7f2440007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:37.970 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.959+0000 7f244d364700 1 -- 172.21.15.174:0/2227804951 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f244000a660 con 0x7f24480a7a60 2020-04-02T23:21:37.973 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.959+0000 7f24505ca700 1 -- 172.21.15.174:0/2227804951 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f24480a7a60 msgr2=0x7f24480a38f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:37.973 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.959+0000 7f24505ca700 1 --2- 172.21.15.174:0/2227804951 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f24480a7a60 0x7f24480a38f0 secure :-1 s=READY pgs=68 cs=0 l=1 rx=0x7f24400032b0 tx=0x7f2440007dc0).stop 2020-04-02T23:21:37.973 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.960+0000 7f24505ca700 1 -- 172.21.15.174:0/2227804951 shutdown_connections 2020-04-02T23:21:37.973 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.960+0000 7f24505ca700 1 --2- 172.21.15.174:0/2227804951 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f24481388e0 0x7f244812e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:37.973 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.960+0000 7f24505ca700 1 --2- 172.21.15.174:0/2227804951 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f24480a7a60 0x7f24480a38f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:37.974 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.960+0000 7f24505ca700 1 --2- 172.21.15.174:0/2227804951 >> v2:172.21.15.196:3300/0 conn(0x7f24480a1fe0 0x7f2448138480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:37.974 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.960+0000 7f24505ca700 1 -- 172.21.15.174:0/2227804951 >> 172.21.15.174:0/2227804951 conn(0x7f24480aaf80 msgr2=0x7f24480a6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:37.974 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.960+0000 7f24505ca700 1 -- 172.21.15.174:0/2227804951 shutdown_connections 2020-04-02T23:21:37.974 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.960+0000 7f24505ca700 1 -- 172.21.15.174:0/2227804951 wait complete. 2020-04-02T23:21:37.974 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.961+0000 7f24505ca700 1 Processor -- start 2020-04-02T23:21:37.974 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.961+0000 7f24505ca700 1 -- start start 2020-04-02T23:21:37.974 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.961+0000 7f24505ca700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f24480a1fe0 0x7f24480a02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:37.975 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.961+0000 7f24505ca700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f24480a7a60 0x7f24480a0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:37.975 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.961+0000 7f24505ca700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f24481388e0 0x7f24480a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:37.975 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.961+0000 7f24505ca700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2448134b40 con 0x7f24481388e0 2020-04-02T23:21:37.975 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.961+0000 7f24505ca700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2448134d70 con 0x7f24480a7a60 2020-04-02T23:21:37.975 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.961+0000 7f24505ca700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24480a0740 con 0x7f24480a1fe0 2020-04-02T23:21:37.975 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.961+0000 7f244eb67700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f24481388e0 0x7f24480a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:37.975 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.961+0000 7f244eb67700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f24481388e0 0x7f24480a0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:39560/0 (socket says 172.21.15.174:39560) 2020-04-02T23:21:37.975 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.961+0000 7f244eb67700 1 -- 172.21.15.174:0/2645682666 learned_addr learned my addr 172.21.15.174:0/2645682666 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:21:37.976 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.962+0000 7f244db65700 1 --2- 172.21.15.174:0/2645682666 >> v2:172.21.15.196:3300/0 conn(0x7f24480a7a60 0x7f24480a0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:37.976 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.962+0000 7f244e366700 1 --2- 172.21.15.174:0/2645682666 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f24480a1fe0 0x7f24480a02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:37.976 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.962+0000 7f244eb67700 1 -- 172.21.15.174:0/2645682666 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f24480a1fe0 msgr2=0x7f24480a02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:37.976 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.962+0000 7f244eb67700 1 --2- 172.21.15.174:0/2645682666 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f24480a1fe0 0x7f24480a02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:37.976 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.962+0000 7f244eb67700 1 -- 172.21.15.174:0/2645682666 >> v2:172.21.15.196:3300/0 conn(0x7f24480a7a60 msgr2=0x7f24480a0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:37.976 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.962+0000 7f244eb67700 1 --2- 172.21.15.174:0/2645682666 >> v2:172.21.15.196:3300/0 conn(0x7f24480a7a60 0x7f24480a0930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:37.976 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.962+0000 7f244eb67700 1 -- 172.21.15.174:0/2645682666 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f244809e440 con 0x7f24481388e0 2020-04-02T23:21:37.977 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.962+0000 7f244db65700 1 --2- 172.21.15.174:0/2645682666 >> v2:172.21.15.196:3300/0 conn(0x7f24480a7a60 0x7f24480a0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-02T23:21:37.977 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.962+0000 7f244eb67700 1 --2- 172.21.15.174:0/2645682666 >> v2:172.21.15.174:3300/0 conn(0x7f24481388e0 0x7f24480a0d90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2448135710 tx=0x7f2444010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:37.977 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.962+0000 7f244eb67700 1 --2- 172.21.15.174:0/2645682666 >> v2:172.21.15.174:3300/0 conn(0x7f24481388e0 0x7f24480a0d90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2448135710 tx=0x7f2444010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:37.977 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.962+0000 7f244eb67700 1 --2- 172.21.15.174:0/2645682666 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f24481388e0 0x7f24480a0d90 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7f2448135710 tx=0x7f2444010ab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:37.977 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.962+0000 7f244eb67700 1 --2- 172.21.15.174:0/2645682666 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f24481388e0 0x7f24480a0d90 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f2448135710 tx=0x7f2444010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:37.977 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.962+0000 7f243b7fe700 1 -- 172.21.15.174:0/2645682666 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2444005e90 con 0x7f24481388e0 2020-04-02T23:21:37.978 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.962+0000 7f244eb67700 1 --2- 172.21.15.174:0/2645682666 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f24481388e0 0x7f24480a0d90 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f2448135710 tx=0x7f2444010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:37.978 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.962+0000 7f244eb67700 1 --2- 172.21.15.174:0/2645682666 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f24481388e0 0x7f24480a0d90 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f2448135710 tx=0x7f2444010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:37.978 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.962+0000 7f243b7fe700 1 -- 172.21.15.174:0/2645682666 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2444007160 con 0x7f24481388e0 2020-04-02T23:21:37.978 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.962+0000 7f243b7fe700 1 -- 172.21.15.174:0/2645682666 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f24440074c0 con 0x7f24481388e0 2020-04-02T23:21:37.978 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.962+0000 7f24505ca700 1 -- 172.21.15.174:0/2645682666 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24481357f0 con 0x7f24481388e0 2020-04-02T23:21:37.978 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.962+0000 7f24505ca700 1 -- 172.21.15.174:0/2645682666 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24481348c0 con 0x7f24481388e0 2020-04-02T23:21:37.978 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.963+0000 7f244eb67700 1 --2- 172.21.15.174:0/2645682666 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f24481388e0 0x7f24480a0d90 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f2448135710 tx=0x7f2444010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:37.978 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.963+0000 7f243b7fe700 1 -- 172.21.15.174:0/2645682666 <== mon.0 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f2444012110 con 0x7f24481388e0 2020-04-02T23:21:37.979 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.963+0000 7f244eb67700 1 --2- 172.21.15.174:0/2645682666 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f24481388e0 0x7f24480a0d90 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f2448135710 tx=0x7f2444010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:37.979 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.963+0000 7f24505ca700 1 -- 172.21.15.174:0/2645682666 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2448056c50 con 0x7f24481388e0 2020-04-02T23:21:37.979 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.963+0000 7f243b7fe700 1 --2- 172.21.15.174:0/2645682666 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f242804d540 0x7f242804fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:37.979 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.963+0000 7f243b7fe700 1 -- 172.21.15.174:0/2645682666 <== mon.0 v2:172.21.15.174:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f2444060f80 con 0x7f24481388e0 2020-04-02T23:21:37.979 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.963+0000 7f244e366700 1 --2- 172.21.15.174:0/2645682666 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f242804d540 0x7f242804fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:37.979 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.964+0000 7f244e366700 1 --2- 172.21.15.174:0/2645682666 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f242804d540 0x7f242804fa00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f24400032b0 tx=0x7f2440007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:37.979 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.964+0000 7f244e366700 1 --2- 172.21.15.174:0/2645682666 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f242804d540 0x7f242804fa00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f24400032b0 tx=0x7f2440007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:37.980 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.964+0000 7f244e366700 1 --2- 172.21.15.174:0/2645682666 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f242804d540 0x7f242804fa00 secure :-1 s=READY pgs=48 cs=0 l=1 rx=0x7f24400032b0 tx=0x7f2440007dc0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:37.980 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.967+0000 7f244eb67700 1 --2- 172.21.15.174:0/2645682666 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f24481388e0 0x7f24480a0d90 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f2448135710 tx=0x7f2444010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:37.981 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:37.967+0000 7f243b7fe700 1 -- 172.21.15.174:0/2645682666 <== mon.0 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f244403c620 con 0x7f24481388e0 2020-04-02T23:21:38.104 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.102+0000 7f24505ca700 1 -- 172.21.15.174:0/2645682666 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f244805a690 con 0x7f24481388e0 2020-04-02T23:21:38.105 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.103+0000 7f244eb67700 1 --2- 172.21.15.174:0/2645682666 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f24481388e0 0x7f24480a0d90 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f2448135710 tx=0x7f2444010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:38.105 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.103+0000 7f243b7fe700 1 -- 172.21.15.174:0/2645682666 <== mon.0 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v18) v1 ==== 92+0+10 (secure 0 0 0) 0x7f244400a0e0 con 0x7f24481388e0 2020-04-02T23:21:38.105 INFO:teuthology.orchestra.run.smithi174.stdout:pg_num: 8 2020-04-02T23:21:38.106 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.104+0000 7f24505ca700 1 -- 172.21.15.174:0/2645682666 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f242804d540 msgr2=0x7f242804fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:38.106 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.104+0000 7f24505ca700 1 --2- 172.21.15.174:0/2645682666 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f242804d540 0x7f242804fa00 secure :-1 s=READY pgs=48 cs=0 l=1 rx=0x7f24400032b0 tx=0x7f2440007dc0).stop 2020-04-02T23:21:38.106 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.104+0000 7f24505ca700 1 -- 172.21.15.174:0/2645682666 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f24481388e0 msgr2=0x7f24480a0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:38.106 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.104+0000 7f24505ca700 1 --2- 172.21.15.174:0/2645682666 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f24481388e0 0x7f24480a0d90 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7f2448135710 tx=0x7f2444010ab0).stop 2020-04-02T23:21:38.107 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.104+0000 7f24505ca700 1 -- 172.21.15.174:0/2645682666 shutdown_connections 2020-04-02T23:21:38.107 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.104+0000 7f24505ca700 1 --2- 172.21.15.174:0/2645682666 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f242804d540 0x7f242804fa00 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:38.107 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.104+0000 7f24505ca700 1 --2- 172.21.15.174:0/2645682666 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f24481388e0 0x7f24480a0d90 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:38.107 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.104+0000 7f24505ca700 1 --2- 172.21.15.174:0/2645682666 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f24480a1fe0 0x7f24480a02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:38.107 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.104+0000 7f24505ca700 1 --2- 172.21.15.174:0/2645682666 >> v2:172.21.15.196:3300/0 conn(0x7f24480a7a60 0x7f24480a0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:38.107 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.104+0000 7f24505ca700 1 -- 172.21.15.174:0/2645682666 >> 172.21.15.174:0/2645682666 conn(0x7f24480aaf80 msgr2=0x7f2448137650 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:38.107 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.104+0000 7f24505ca700 1 -- 172.21.15.174:0/2645682666 shutdown_connections 2020-04-02T23:21:38.108 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.104+0000 7f24505ca700 1 -- 172.21.15.174:0/2645682666 wait complete. 2020-04-02T23:21:38.116 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:38.137 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2020-04-02T23:21:38.285 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.280+0000 7fe5f386f700 1 Processor -- start 2020-04-02T23:21:38.285 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.281+0000 7fe5f386f700 1 -- start start 2020-04-02T23:21:38.286 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.281+0000 7fe5f386f700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe5ec0a5900 0x7fe5ec135030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:38.286 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.281+0000 7fe5f386f700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fe5ec12e970 0x7fe5ec13ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:38.286 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.281+0000 7fe5f386f700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5ec134420 con 0x7fe5ec05ac00 2020-04-02T23:21:38.286 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.281+0000 7fe5f386f700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5ec0a49d0 con 0x7fe5ec12e970 2020-04-02T23:21:38.286 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.281+0000 7fe5f386f700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ec05b080 con 0x7fe5ec0a5900 2020-04-02T23:21:38.286 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.281+0000 7fe5f160b700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe5ec0a5900 0x7fe5ec135030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:38.287 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.281+0000 7fe5f1e0c700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fe5ec12e970 0x7fe5ec13ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:38.287 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.282+0000 7fe5f1e0c700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fe5ec12e970 0x7fe5ec13ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.174:47660/0 (socket says 172.21.15.174:47660) 2020-04-02T23:21:38.287 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.282+0000 7fe5f1e0c700 1 -- 172.21.15.174:0/3443995870 learned_addr learned my addr 172.21.15.174:0/3443995870 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:21:38.287 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.282+0000 7fe5f160b700 1 -- 172.21.15.174:0/3443995870 >> v2:172.21.15.196:3300/0 conn(0x7fe5ec12e970 msgr2=0x7fe5ec13ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:38.287 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.282+0000 7fe5f160b700 1 --2- 172.21.15.174:0/3443995870 >> v2:172.21.15.196:3300/0 conn(0x7fe5ec12e970 0x7fe5ec13ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:38.287 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.282+0000 7fe5f160b700 1 -- 172.21.15.174:0/3443995870 >> v1:172.21.15.196:6789/0 conn(0x7fe5ec05ac00 legacy=0x7fe5ec12e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:38.287 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.282+0000 7fe5f160b700 1 -- 172.21.15.174:0/3443995870 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5ec134650 con 0x7fe5ec0a5900 2020-04-02T23:21:38.287 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.282+0000 7fe5f1e0c700 1 --2- 172.21.15.174:0/3443995870 >> v2:172.21.15.196:3300/0 conn(0x7fe5ec12e970 0x7fe5ec13ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:21:38.288 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.282+0000 7fe5f160b700 1 --2- 172.21.15.174:0/3443995870 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe5ec0a5900 0x7fe5ec135030 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe5dc002f30 tx=0x7fe5dc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:38.288 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.282+0000 7fe5f160b700 1 --2- 172.21.15.174:0/3443995870 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe5ec0a5900 0x7fe5ec135030 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe5dc002f30 tx=0x7fe5dc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:38.288 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.282+0000 7fe5f160b700 1 --2- 172.21.15.174:0/3443995870 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe5ec0a5900 0x7fe5ec135030 secure :-1 s=READY pgs=20 cs=0 l=1 rx=0x7fe5dc002f30 tx=0x7fe5dc007a40).ready entity=mon.2 client_cookie=36fc59e486f2a540 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:38.288 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.282+0000 7fe5f160b700 1 --2- 172.21.15.174:0/3443995870 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe5ec0a5900 0x7fe5ec135030 secure :-1 s=THROTTLE_DONE pgs=20 cs=0 l=1 rx=0x7fe5dc002f30 tx=0x7fe5dc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:38.288 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.282+0000 7fe5dbfff700 1 -- 172.21.15.174:0/3443995870 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5dc0124d0 con 0x7fe5ec0a5900 2020-04-02T23:21:38.288 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.282+0000 7fe5f160b700 1 --2- 172.21.15.174:0/3443995870 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe5ec0a5900 0x7fe5ec135030 secure :-1 s=THROTTLE_DONE pgs=20 cs=0 l=1 rx=0x7fe5dc002f30 tx=0x7fe5dc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:38.289 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.282+0000 7fe5f160b700 1 --2- 172.21.15.174:0/3443995870 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe5ec0a5900 0x7fe5ec135030 secure :-1 s=THROTTLE_DONE pgs=20 cs=0 l=1 rx=0x7fe5dc002f30 tx=0x7fe5dc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:38.289 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.282+0000 7fe5dbfff700 1 -- 172.21.15.174:0/3443995870 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5dc012630 con 0x7fe5ec0a5900 2020-04-02T23:21:38.289 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.282+0000 7fe5dbfff700 1 -- 172.21.15.174:0/3443995870 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5dc012a50 con 0x7fe5ec0a5900 2020-04-02T23:21:38.289 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.282+0000 7fe5f386f700 1 -- 172.21.15.174:0/3443995870 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe5ec0a5900 msgr2=0x7fe5ec135030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:38.289 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.282+0000 7fe5f386f700 1 --2- 172.21.15.174:0/3443995870 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe5ec0a5900 0x7fe5ec135030 secure :-1 s=READY pgs=20 cs=0 l=1 rx=0x7fe5dc002f30 tx=0x7fe5dc007a40).stop 2020-04-02T23:21:38.289 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.283+0000 7fe5f386f700 1 -- 172.21.15.174:0/3443995870 shutdown_connections 2020-04-02T23:21:38.290 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.283+0000 7fe5f386f700 1 --2- 172.21.15.174:0/3443995870 >> v2:172.21.15.196:3300/0 conn(0x7fe5ec12e970 0x7fe5ec13ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:38.290 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.283+0000 7fe5f386f700 1 --2- 172.21.15.174:0/3443995870 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe5ec0a5900 0x7fe5ec135030 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:38.290 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.283+0000 7fe5f386f700 1 -- 172.21.15.174:0/3443995870 >> 172.21.15.174:0/3443995870 conn(0x7fe5ec0aaf80 msgr2=0x7fe5ec0a6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:38.290 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.283+0000 7fe5f386f700 1 -- 172.21.15.174:0/3443995870 shutdown_connections 2020-04-02T23:21:38.290 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.283+0000 7fe5f386f700 1 -- 172.21.15.174:0/3443995870 wait complete. 2020-04-02T23:21:38.291 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.284+0000 7fe5f386f700 1 Processor -- start 2020-04-02T23:21:38.291 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.284+0000 7fe5f386f700 1 -- start start 2020-04-02T23:21:38.294 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.284+0000 7fe5f386f700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe5ec0a5900 0x7fe5ec137360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:38.294 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.284+0000 7fe5f386f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5ec137c00 con 0x7fe5ec12a220 2020-04-02T23:21:38.295 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.284+0000 7fe5f386f700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5ec1379b0 con 0x7fe5ec05ac00 2020-04-02T23:21:38.295 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.284+0000 7fe5f386f700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ec1377c0 con 0x7fe5ec0a5900 2020-04-02T23:21:38.295 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.284+0000 7fe5f1e0c700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fe5ec12a220 0x7fe5ec12a6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:44612/0 (socket says 172.21.15.174:44612) 2020-04-02T23:21:38.295 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.284+0000 7fe5f1e0c700 1 -- 172.21.15.174:0/1355516171 learned_addr learned my addr 172.21.15.174:0/1355516171 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:21:38.295 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.284+0000 7fe5f0e0a700 1 --2- 172.21.15.174:0/1355516171 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe5ec0a5900 0x7fe5ec137360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:38.295 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.285+0000 7fe5da7fc700 1 -- 172.21.15.174:0/1355516171 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2585933454 0 0) 0x7fe5ec137c00 con 0x7fe5ec12a220 2020-04-02T23:21:38.295 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.285+0000 7fe5da7fc700 1 -- 172.21.15.174:0/1355516171 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5cc002fe0 con 0x7fe5ec12a220 2020-04-02T23:21:38.296 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.285+0000 7fe5da7fc700 1 -- 172.21.15.174:0/1355516171 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3868711150 0 0) 0x7fe5ec1379b0 con 0x7fe5ec05ac00 2020-04-02T23:21:38.296 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.285+0000 7fe5da7fc700 1 -- 172.21.15.174:0/1355516171 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5ec137c00 con 0x7fe5ec05ac00 2020-04-02T23:21:38.296 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.285+0000 7fe5f0e0a700 1 -- 172.21.15.174:0/1355516171 >> v1:172.21.15.196:6789/0 conn(0x7fe5ec05ac00 legacy=0x7fe5ec12c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:38.296 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.285+0000 7fe5da7fc700 1 -- 172.21.15.174:0/1355516171 <== mon.0 v1:172.21.15.174:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 841321838 0 0) 0x7fe5cc002fe0 con 0x7fe5ec12a220 2020-04-02T23:21:38.296 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.285+0000 7fe5f0e0a700 1 -- 172.21.15.174:0/1355516171 >> v1:172.21.15.174:6789/0 conn(0x7fe5ec12a220 legacy=0x7fe5ec12a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:38.296 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.285+0000 7fe5f0e0a700 1 -- 172.21.15.174:0/1355516171 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5ec12cb00 con 0x7fe5ec0a5900 2020-04-02T23:21:38.296 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.285+0000 7fe5f0e0a700 1 --2- 172.21.15.174:0/1355516171 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe5ec0a5900 0x7fe5ec137360 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe5ec0a51a0 tx=0x7fe5e8010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:38.297 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.285+0000 7fe5f0e0a700 1 --2- 172.21.15.174:0/1355516171 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe5ec0a5900 0x7fe5ec137360 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe5ec0a51a0 tx=0x7fe5e8010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:38.297 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.285+0000 7fe5f0e0a700 1 --2- 172.21.15.174:0/1355516171 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe5ec0a5900 0x7fe5ec137360 secure :-1 s=READY pgs=21 cs=0 l=1 rx=0x7fe5ec0a51a0 tx=0x7fe5e8010910).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:38.297 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.285+0000 7fe5f0e0a700 1 --2- 172.21.15.174:0/1355516171 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe5ec0a5900 0x7fe5ec137360 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7fe5ec0a51a0 tx=0x7fe5e8010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:38.297 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.285+0000 7fe5da7fc700 1 -- 172.21.15.174:0/1355516171 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5e8001ea0 con 0x7fe5ec0a5900 2020-04-02T23:21:38.297 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.285+0000 7fe5f0e0a700 1 --2- 172.21.15.174:0/1355516171 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe5ec0a5900 0x7fe5ec137360 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7fe5ec0a51a0 tx=0x7fe5e8010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:38.297 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.285+0000 7fe5f0e0a700 1 --2- 172.21.15.174:0/1355516171 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe5ec0a5900 0x7fe5ec137360 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7fe5ec0a51a0 tx=0x7fe5e8010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:38.297 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.285+0000 7fe5da7fc700 1 -- 172.21.15.174:0/1355516171 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5e800ca10 con 0x7fe5ec0a5900 2020-04-02T23:21:38.297 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.285+0000 7fe5da7fc700 1 -- 172.21.15.174:0/1355516171 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5e4001810 con 0x7fe5ec0a5900 2020-04-02T23:21:38.298 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.285+0000 7fe5f386f700 1 -- 172.21.15.174:0/1355516171 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5ec136b40 con 0x7fe5ec0a5900 2020-04-02T23:21:38.298 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.285+0000 7fe5f386f700 1 -- 172.21.15.174:0/1355516171 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5ec135ab0 con 0x7fe5ec0a5900 2020-04-02T23:21:38.298 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.286+0000 7fe5f0e0a700 1 --2- 172.21.15.174:0/1355516171 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe5ec0a5900 0x7fe5ec137360 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7fe5ec0a51a0 tx=0x7fe5e8010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:38.298 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.286+0000 7fe5da7fc700 1 -- 172.21.15.174:0/1355516171 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fe5e80064e0 con 0x7fe5ec0a5900 2020-04-02T23:21:38.298 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.286+0000 7fe5f0e0a700 1 --2- 172.21.15.174:0/1355516171 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe5ec0a5900 0x7fe5ec137360 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7fe5ec0a51a0 tx=0x7fe5e8010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:38.298 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.286+0000 7fe5f386f700 1 -- 172.21.15.174:0/1355516171 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5ec067280 con 0x7fe5ec0a5900 2020-04-02T23:21:38.298 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.286+0000 7fe5da7fc700 1 --2- 172.21.15.174:0/1355516171 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fe5cc04da10 0x7fe5cc04fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:38.299 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.287+0000 7fe5da7fc700 1 -- 172.21.15.174:0/1355516171 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fe5e80604e0 con 0x7fe5ec0a5900 2020-04-02T23:21:38.299 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.287+0000 7fe5f160b700 1 --2- 172.21.15.174:0/1355516171 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fe5cc04da10 0x7fe5cc04fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:38.299 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.287+0000 7fe5f160b700 1 --2- 172.21.15.174:0/1355516171 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fe5cc04da10 0x7fe5cc04fed0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe5dc0088e0 tx=0x7fe5dc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:38.299 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.287+0000 7fe5f160b700 1 --2- 172.21.15.174:0/1355516171 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fe5cc04da10 0x7fe5cc04fed0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe5dc0088e0 tx=0x7fe5dc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:38.299 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.287+0000 7fe5f160b700 1 --2- 172.21.15.174:0/1355516171 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fe5cc04da10 0x7fe5cc04fed0 secure :-1 s=READY pgs=49 cs=0 l=1 rx=0x7fe5dc0088e0 tx=0x7fe5dc007a40).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:38.300 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.290+0000 7fe5f0e0a700 1 --2- 172.21.15.174:0/1355516171 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe5ec0a5900 0x7fe5ec137360 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7fe5ec0a51a0 tx=0x7fe5e8010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:38.300 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.290+0000 7fe5da7fc700 1 -- 172.21.15.174:0/1355516171 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fe5e803bbc0 con 0x7fe5ec0a5900 2020-04-02T23:21:38.430 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.428+0000 7fe5f386f700 1 -- 172.21.15.174:0/1355516171 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fe5ec056c50 con 0x7fe5ec0a5900 2020-04-02T23:21:38.430 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.429+0000 7fe5f0e0a700 1 --2- 172.21.15.174:0/1355516171 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe5ec0a5900 0x7fe5ec137360 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7fe5ec0a51a0 tx=0x7fe5e8010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:38.431 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.429+0000 7fe5da7fc700 1 -- 172.21.15.174:0/1355516171 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) v1 ==== 84+0+143 (secure 0 0 0) 0x7fe5e803f1e0 con 0x7fe5ec0a5900 2020-04-02T23:21:38.431 INFO:teuthology.orchestra.run.smithi174.stdout: 2020-04-02T23:21:38.431 INFO:teuthology.orchestra.run.smithi174.stdout:[ 2020-04-02T23:21:38.431 INFO:teuthology.orchestra.run.smithi174.stdout: { 2020-04-02T23:21:38.431 INFO:teuthology.orchestra.run.smithi174.stdout: "poolnum": 1, 2020-04-02T23:21:38.432 INFO:teuthology.orchestra.run.smithi174.stdout: "poolname": "device_health_metrics" 2020-04-02T23:21:38.432 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2020-04-02T23:21:38.432 INFO:teuthology.orchestra.run.smithi174.stdout: { 2020-04-02T23:21:38.432 INFO:teuthology.orchestra.run.smithi174.stdout: "poolnum": 2, 2020-04-02T23:21:38.432 INFO:teuthology.orchestra.run.smithi174.stdout: "poolname": "rbd" 2020-04-02T23:21:38.432 INFO:teuthology.orchestra.run.smithi174.stdout: } 2020-04-02T23:21:38.432 INFO:teuthology.orchestra.run.smithi174.stdout:] 2020-04-02T23:21:38.433 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.430+0000 7fe5f386f700 1 -- 172.21.15.174:0/1355516171 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fe5cc04da10 msgr2=0x7fe5cc04fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:38.434 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.430+0000 7fe5f386f700 1 --2- 172.21.15.174:0/1355516171 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fe5cc04da10 0x7fe5cc04fed0 secure :-1 s=READY pgs=49 cs=0 l=1 rx=0x7fe5dc0088e0 tx=0x7fe5dc007a40).stop 2020-04-02T23:21:38.434 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.430+0000 7fe5f386f700 1 -- 172.21.15.174:0/1355516171 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe5ec0a5900 msgr2=0x7fe5ec137360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:38.434 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.430+0000 7fe5f386f700 1 --2- 172.21.15.174:0/1355516171 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe5ec0a5900 0x7fe5ec137360 secure :-1 s=READY pgs=21 cs=0 l=1 rx=0x7fe5ec0a51a0 tx=0x7fe5e8010910).stop 2020-04-02T23:21:38.434 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.430+0000 7fe5f386f700 1 -- 172.21.15.174:0/1355516171 shutdown_connections 2020-04-02T23:21:38.434 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.430+0000 7fe5f386f700 1 --2- 172.21.15.174:0/1355516171 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fe5cc04da10 0x7fe5cc04fed0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:38.434 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.430+0000 7fe5f386f700 1 --2- 172.21.15.174:0/1355516171 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe5ec0a5900 0x7fe5ec137360 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:38.446 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.430+0000 7fe5f386f700 1 -- 172.21.15.174:0/1355516171 >> 172.21.15.174:0/1355516171 conn(0x7fe5ec0aaf80 msgr2=0x7fe5ec05b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:38.446 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.430+0000 7fe5f386f700 1 -- 172.21.15.174:0/1355516171 shutdown_connections 2020-04-02T23:21:38.446 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.430+0000 7fe5f386f700 1 -- 172.21.15.174:0/1355516171 wait complete. 2020-04-02T23:21:38.447 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2020-04-02T23:21:38.447 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:38.460 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2020-04-02T23:21:38.607 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.604+0000 7f53df2fd700 1 Processor -- start 2020-04-02T23:21:38.607 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.605+0000 7f53df2fd700 1 -- start start 2020-04-02T23:21:38.614 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.605+0000 7f53df2fd700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f53d80a7a60 0x7f53d80a38f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:38.614 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.605+0000 7f53df2fd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f53d8138b90 0x7f53d8134d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:38.614 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.605+0000 7f53df2fd700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53d80a40d0 con 0x7f53d80a1fe0 2020-04-02T23:21:38.615 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.605+0000 7f53df2fd700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53d80a3ec0 con 0x7f53d8138b90 2020-04-02T23:21:38.615 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.605+0000 7f53df2fd700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53d80a4370 con 0x7f53d80a7a60 2020-04-02T23:21:38.616 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.605+0000 7f53dd89a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f53d8138b90 0x7f53d8134d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:38.616 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.605+0000 7f53dd89a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f53d8138b90 0x7f53d8134d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:39578/0 (socket says 172.21.15.174:39578) 2020-04-02T23:21:38.616 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.605+0000 7f53dd89a700 1 -- 172.21.15.174:0/1403831236 learned_addr learned my addr 172.21.15.174:0/1403831236 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:21:38.616 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.606+0000 7f53dd099700 1 --2- 172.21.15.174:0/1403831236 >> v2:172.21.15.196:3300/0 conn(0x7f53d80a7a60 0x7f53d80a38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:38.616 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.606+0000 7f53dd89a700 1 -- 172.21.15.174:0/1403831236 >> v2:172.21.15.196:3300/0 conn(0x7f53d80a7a60 msgr2=0x7f53d80a38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:38.616 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.606+0000 7f53dd89a700 1 --2- 172.21.15.174:0/1403831236 >> v2:172.21.15.196:3300/0 conn(0x7f53d80a7a60 0x7f53d80a38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:38.616 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.606+0000 7f53dd89a700 1 -- 172.21.15.174:0/1403831236 >> v1:172.21.15.196:6789/0 conn(0x7f53d80a1fe0 legacy=0x7f53d8138480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:38.617 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.606+0000 7f53dd89a700 1 -- 172.21.15.174:0/1403831236 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d80a2470 con 0x7f53d8138b90 2020-04-02T23:21:38.617 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.606+0000 7f53dd099700 1 --2- 172.21.15.174:0/1403831236 >> v2:172.21.15.196:3300/0 conn(0x7f53d80a7a60 0x7f53d80a38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-02T23:21:38.617 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.606+0000 7f53dd89a700 1 --2- 172.21.15.174:0/1403831236 >> v2:172.21.15.174:3300/0 conn(0x7f53d8138b90 0x7f53d8134d60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f53d00032b0 tx=0x7f53d0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:38.617 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.606+0000 7f53dd89a700 1 --2- 172.21.15.174:0/1403831236 >> v2:172.21.15.174:3300/0 conn(0x7f53d8138b90 0x7f53d8134d60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f53d00032b0 tx=0x7f53d0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:38.617 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.606+0000 7f53dd89a700 1 --2- 172.21.15.174:0/1403831236 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f53d8138b90 0x7f53d8134d60 secure :-1 s=READY pgs=71 cs=0 l=1 rx=0x7f53d00032b0 tx=0x7f53d0007dc0).ready entity=mon.0 client_cookie=f06d838309f7d59f server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:38.617 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.606+0000 7f53dd89a700 1 --2- 172.21.15.174:0/1403831236 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f53d8138b90 0x7f53d8134d60 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7f53d00032b0 tx=0x7f53d0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:38.617 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.606+0000 7f53c7fff700 1 -- 172.21.15.174:0/1403831236 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53d000a160 con 0x7f53d8138b90 2020-04-02T23:21:38.617 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.606+0000 7f53dd89a700 1 --2- 172.21.15.174:0/1403831236 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f53d8138b90 0x7f53d8134d60 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7f53d00032b0 tx=0x7f53d0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:38.618 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.606+0000 7f53dd89a700 1 --2- 172.21.15.174:0/1403831236 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f53d8138b90 0x7f53d8134d60 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7f53d00032b0 tx=0x7f53d0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:38.618 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.606+0000 7f53c7fff700 1 -- 172.21.15.174:0/1403831236 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53d000a2c0 con 0x7f53d8138b90 2020-04-02T23:21:38.618 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.606+0000 7f53c7fff700 1 -- 172.21.15.174:0/1403831236 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53d000a6a0 con 0x7f53d8138b90 2020-04-02T23:21:38.618 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.606+0000 7f53df2fd700 1 -- 172.21.15.174:0/1403831236 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f53d8138b90 msgr2=0x7f53d8134d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:38.618 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.606+0000 7f53df2fd700 1 --2- 172.21.15.174:0/1403831236 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f53d8138b90 0x7f53d8134d60 secure :-1 s=READY pgs=71 cs=0 l=1 rx=0x7f53d00032b0 tx=0x7f53d0007dc0).stop 2020-04-02T23:21:38.618 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.606+0000 7f53df2fd700 1 -- 172.21.15.174:0/1403831236 shutdown_connections 2020-04-02T23:21:38.618 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.606+0000 7f53df2fd700 1 --2- 172.21.15.174:0/1403831236 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f53d8138b90 0x7f53d8134d60 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:38.619 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.606+0000 7f53df2fd700 1 --2- 172.21.15.174:0/1403831236 >> v2:172.21.15.196:3300/0 conn(0x7f53d80a7a60 0x7f53d80a38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:38.619 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.607+0000 7f53df2fd700 1 -- 172.21.15.174:0/1403831236 >> 172.21.15.174:0/1403831236 conn(0x7f53d80aaf80 msgr2=0x7f53d80a6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:38.619 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.607+0000 7f53df2fd700 1 -- 172.21.15.174:0/1403831236 shutdown_connections 2020-04-02T23:21:38.619 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.607+0000 7f53df2fd700 1 -- 172.21.15.174:0/1403831236 wait complete. 2020-04-02T23:21:38.619 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.607+0000 7f53df2fd700 1 Processor -- start 2020-04-02T23:21:38.619 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.607+0000 7f53df2fd700 1 -- start start 2020-04-02T23:21:38.619 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.608+0000 7f53df2fd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f53d80a1fe0 0x7f53d812f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:38.619 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.608+0000 7f53df2fd700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f53d8138b90 0x7f53d812ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:38.620 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.608+0000 7f53df2fd700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53d81305a0 con 0x7f53d80a7a60 2020-04-02T23:21:38.620 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.608+0000 7f53df2fd700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53d8135ed0 con 0x7f53d80a1fe0 2020-04-02T23:21:38.620 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.608+0000 7f53df2fd700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53d81307d0 con 0x7f53d8138b90 2020-04-02T23:21:38.620 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.608+0000 7f53dd099700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f53d80a1fe0 0x7f53d812f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:38.620 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.608+0000 7f53dc898700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f53d80a7a60 0x7f53d812d6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:44622/0 (socket says 172.21.15.174:44622) 2020-04-02T23:21:38.620 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.608+0000 7f53dd099700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f53d80a1fe0 0x7f53d812f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:39582/0 (socket says 172.21.15.174:39582) 2020-04-02T23:21:38.620 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.608+0000 7f53dc898700 1 -- 172.21.15.174:0/2295571089 learned_addr learned my addr 172.21.15.174:0/2295571089 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:21:38.621 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.608+0000 7f53dd89a700 1 --2- 172.21.15.174:0/2295571089 >> v2:172.21.15.196:3300/0 conn(0x7f53d8138b90 0x7f53d812ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:38.621 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.608+0000 7f53dd099700 1 -- 172.21.15.174:0/2295571089 >> v2:172.21.15.196:3300/0 conn(0x7f53d8138b90 msgr2=0x7f53d812ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:38.621 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.608+0000 7f53dd099700 1 --2- 172.21.15.174:0/2295571089 >> v2:172.21.15.196:3300/0 conn(0x7f53d8138b90 0x7f53d812ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:38.621 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.608+0000 7f53dd099700 1 -- 172.21.15.174:0/2295571089 >> v1:172.21.15.174:6789/0 conn(0x7f53d80a7a60 legacy=0x7f53d812d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:38.621 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.608+0000 7f53c67fc700 1 -- 172.21.15.174:0/2295571089 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 641645623 0 0) 0x7f53d81305a0 con 0x7f53d80a7a60 2020-04-02T23:21:38.621 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.608+0000 7f53dd099700 1 -- 172.21.15.174:0/2295571089 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d8130a70 con 0x7f53d80a1fe0 2020-04-02T23:21:38.621 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.608+0000 7f53dd099700 1 --2- 172.21.15.174:0/2295571089 >> v2:172.21.15.174:3300/0 conn(0x7f53d80a1fe0 0x7f53d812f790 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f53d81438d0 tx=0x7f53c8010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:38.622 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.609+0000 7f53dd099700 1 --2- 172.21.15.174:0/2295571089 >> v2:172.21.15.174:3300/0 conn(0x7f53d80a1fe0 0x7f53d812f790 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f53d81438d0 tx=0x7f53c8010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:38.622 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.609+0000 7f53dd099700 1 --2- 172.21.15.174:0/2295571089 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f53d80a1fe0 0x7f53d812f790 secure :-1 s=READY pgs=73 cs=0 l=1 rx=0x7f53d81438d0 tx=0x7f53c8010a50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:38.622 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.609+0000 7f53dd099700 1 --2- 172.21.15.174:0/2295571089 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f53d80a1fe0 0x7f53d812f790 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f53d81438d0 tx=0x7f53c8010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:38.622 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.609+0000 7f53c67fc700 1 -- 172.21.15.174:0/2295571089 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53c8005e90 con 0x7f53d80a1fe0 2020-04-02T23:21:38.622 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.609+0000 7f53dd099700 1 --2- 172.21.15.174:0/2295571089 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f53d80a1fe0 0x7f53d812f790 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f53d81438d0 tx=0x7f53c8010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:38.622 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.609+0000 7f53dd099700 1 --2- 172.21.15.174:0/2295571089 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f53d80a1fe0 0x7f53d812f790 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f53d81438d0 tx=0x7f53c8010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:38.622 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.609+0000 7f53c67fc700 1 -- 172.21.15.174:0/2295571089 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c8007160 con 0x7f53d80a1fe0 2020-04-02T23:21:38.622 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.609+0000 7f53df2fd700 1 -- 172.21.15.174:0/2295571089 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53d8130d10 con 0x7f53d80a1fe0 2020-04-02T23:21:38.623 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.609+0000 7f53c67fc700 1 -- 172.21.15.174:0/2295571089 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53c8007540 con 0x7f53d80a1fe0 2020-04-02T23:21:38.623 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.609+0000 7f53df2fd700 1 -- 172.21.15.174:0/2295571089 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53d805b0d0 con 0x7f53d80a1fe0 2020-04-02T23:21:38.623 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.609+0000 7f53dd099700 1 --2- 172.21.15.174:0/2295571089 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f53d80a1fe0 0x7f53d812f790 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f53d81438d0 tx=0x7f53c8010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:38.623 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.610+0000 7f53c67fc700 1 -- 172.21.15.174:0/2295571089 <== mon.0 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f53c800e0e0 con 0x7f53d80a1fe0 2020-04-02T23:21:38.623 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.610+0000 7f53dd099700 1 --2- 172.21.15.174:0/2295571089 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f53d80a1fe0 0x7f53d812f790 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f53d81438d0 tx=0x7f53c8010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:38.623 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.610+0000 7f53df2fd700 1 -- 172.21.15.174:0/2295571089 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53d8056c50 con 0x7f53d80a1fe0 2020-04-02T23:21:38.623 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.610+0000 7f53c67fc700 1 --2- 172.21.15.174:0/2295571089 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f53b804d3e0 0x7f53b804f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:38.624 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.610+0000 7f53c67fc700 1 -- 172.21.15.174:0/2295571089 <== mon.0 v2:172.21.15.174:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f53c8007e40 con 0x7f53d80a1fe0 2020-04-02T23:21:38.624 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.610+0000 7f53dc898700 1 --2- 172.21.15.174:0/2295571089 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f53b804d3e0 0x7f53b804f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:38.624 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.610+0000 7f53dc898700 1 --2- 172.21.15.174:0/2295571089 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f53b804d3e0 0x7f53b804f8a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f53d40012f0 tx=0x7f53d4001860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:38.624 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.610+0000 7f53dc898700 1 --2- 172.21.15.174:0/2295571089 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f53b804d3e0 0x7f53b804f8a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f53d40012f0 tx=0x7f53d4001860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:38.624 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.610+0000 7f53dc898700 1 --2- 172.21.15.174:0/2295571089 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f53b804d3e0 0x7f53b804f8a0 secure :-1 s=READY pgs=50 cs=0 l=1 rx=0x7f53d40012f0 tx=0x7f53d4001860).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:38.625 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.613+0000 7f53dd099700 1 --2- 172.21.15.174:0/2295571089 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f53d80a1fe0 0x7f53d812f790 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f53d81438d0 tx=0x7f53c8010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:38.625 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.613+0000 7f53c67fc700 1 -- 172.21.15.174:0/2295571089 <== mon.0 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f53c803c540 con 0x7f53d80a1fe0 2020-04-02T23:21:38.752 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:38.750+0000 7f53df2fd700 1 -- 172.21.15.174:0/2295571089 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f53d80a38a0 con 0x7f53d80a1fe0 2020-04-02T23:21:39.144 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.142+0000 7f53dd099700 1 --2- 172.21.15.174:0/2295571089 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f53d80a1fe0 0x7f53d812f790 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f53d81438d0 tx=0x7f53c8010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:39.145 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.142+0000 7f53c67fc700 1 -- 172.21.15.174:0/2295571089 <== mon.0 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v20) v1 ==== 133+0+0 (secure 0 0 0) 0x7f53c800a0e0 con 0x7f53d80a1fe0 2020-04-02T23:21:39.146 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.144+0000 7f53df2fd700 1 -- 172.21.15.174:0/2295571089 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f53b804d3e0 msgr2=0x7f53b804f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:39.147 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.144+0000 7f53df2fd700 1 --2- 172.21.15.174:0/2295571089 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f53b804d3e0 0x7f53b804f8a0 secure :-1 s=READY pgs=50 cs=0 l=1 rx=0x7f53d40012f0 tx=0x7f53d4001860).stop 2020-04-02T23:21:39.147 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.144+0000 7f53df2fd700 1 -- 172.21.15.174:0/2295571089 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f53d80a1fe0 msgr2=0x7f53d812f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:39.147 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.144+0000 7f53df2fd700 1 --2- 172.21.15.174:0/2295571089 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f53d80a1fe0 0x7f53d812f790 secure :-1 s=READY pgs=73 cs=0 l=1 rx=0x7f53d81438d0 tx=0x7f53c8010a50).stop 2020-04-02T23:21:39.147 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.144+0000 7f53df2fd700 1 -- 172.21.15.174:0/2295571089 shutdown_connections 2020-04-02T23:21:39.147 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.144+0000 7f53df2fd700 1 --2- 172.21.15.174:0/2295571089 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f53b804d3e0 0x7f53b804f8a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:39.147 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.144+0000 7f53df2fd700 1 --2- 172.21.15.174:0/2295571089 >> v2:172.21.15.196:3300/0 conn(0x7f53d8138b90 0x7f53d812ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:39.147 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.144+0000 7f53df2fd700 1 --2- 172.21.15.174:0/2295571089 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f53d80a1fe0 0x7f53d812f790 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:39.148 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.144+0000 7f53df2fd700 1 -- 172.21.15.174:0/2295571089 >> 172.21.15.174:0/2295571089 conn(0x7f53d80aaf80 msgr2=0x7f53d81371f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:39.148 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.144+0000 7f53df2fd700 1 -- 172.21.15.174:0/2295571089 shutdown_connections 2020-04-02T23:21:39.148 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.144+0000 7f53df2fd700 1 -- 172.21.15.174:0/2295571089 wait complete. 2020-04-02T23:21:39.148 INFO:teuthology.orchestra.run.smithi174.stderr:pool 'cephfs_metadata' created 2020-04-02T23:21:39.157 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:39.171 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 2020-04-02T23:21:39.319 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.317+0000 7f56116ef700 1 Processor -- start 2020-04-02T23:21:39.320 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.317+0000 7f56116ef700 1 -- start start 2020-04-02T23:21:39.322 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.318+0000 7f56116ef700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f560c0a5900 0x7f560c135030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:39.322 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.318+0000 7f56116ef700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f560c134420 con 0x7f560c12e970 2020-04-02T23:21:39.322 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.318+0000 7f56116ef700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f560c0a49d0 con 0x7f560c05ac00 2020-04-02T23:21:39.323 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.318+0000 7f56116ef700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f560c05b0b0 con 0x7f560c0a5900 2020-04-02T23:21:39.323 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.318+0000 7f560affd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f560c0a5900 0x7f560c135030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:39.323 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.318+0000 7f560affd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f560c0a5900 0x7f560c135030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:39590/0 (socket says 172.21.15.174:39590) 2020-04-02T23:21:39.323 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.318+0000 7f560b7fe700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f560c12e970 0x7f560c13ed90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:44632/0 (socket says 172.21.15.174:44632) 2020-04-02T23:21:39.323 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.318+0000 7f560affd700 1 -- 172.21.15.174:0/2572393363 learned_addr learned my addr 172.21.15.174:0/2572393363 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:21:39.323 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.318+0000 7f560affd700 1 -- 172.21.15.174:0/2572393363 >> v1:172.21.15.196:6789/0 conn(0x7f560c05ac00 legacy=0x7f560c12e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:39.323 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.318+0000 7f560affd700 1 -- 172.21.15.174:0/2572393363 >> v1:172.21.15.174:6789/0 conn(0x7f560c12e970 legacy=0x7f560c13ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:39.324 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.318+0000 7f560affd700 1 -- 172.21.15.174:0/2572393363 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f560c134650 con 0x7f560c0a5900 2020-04-02T23:21:39.324 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.318+0000 7f5609ffb700 1 -- 172.21.15.174:0/2572393363 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1285143409 0 0) 0x7f560c134420 con 0x7f560c12e970 2020-04-02T23:21:39.324 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.318+0000 7f560affd700 1 --2- 172.21.15.174:0/2572393363 >> v2:172.21.15.174:3300/0 conn(0x7f560c0a5900 0x7f560c135030 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f560c09e3e0 tx=0x7f5600007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:39.324 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.318+0000 7f560affd700 1 --2- 172.21.15.174:0/2572393363 >> v2:172.21.15.174:3300/0 conn(0x7f560c0a5900 0x7f560c135030 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f560c09e3e0 tx=0x7f5600007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:39.324 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.318+0000 7f560affd700 1 --2- 172.21.15.174:0/2572393363 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f560c0a5900 0x7f560c135030 secure :-1 s=READY pgs=75 cs=0 l=1 rx=0x7f560c09e3e0 tx=0x7f5600007a40).ready entity=mon.0 client_cookie=e11a5d698f6fb608 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:39.324 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.318+0000 7f560affd700 1 --2- 172.21.15.174:0/2572393363 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f560c0a5900 0x7f560c135030 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7f560c09e3e0 tx=0x7f5600007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:39.324 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.318+0000 7f5609ffb700 1 -- 172.21.15.174:0/2572393363 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56000116e0 con 0x7f560c0a5900 2020-04-02T23:21:39.325 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.318+0000 7f560affd700 1 --2- 172.21.15.174:0/2572393363 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f560c0a5900 0x7f560c135030 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7f560c09e3e0 tx=0x7f5600007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:39.325 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.318+0000 7f5609ffb700 1 -- 172.21.15.174:0/2572393363 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5600011840 con 0x7f560c0a5900 2020-04-02T23:21:39.325 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.318+0000 7f560affd700 1 --2- 172.21.15.174:0/2572393363 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f560c0a5900 0x7f560c135030 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7f560c09e3e0 tx=0x7f5600007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:39.325 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.319+0000 7f5609ffb700 1 -- 172.21.15.174:0/2572393363 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5600011c20 con 0x7f560c0a5900 2020-04-02T23:21:39.325 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.319+0000 7f56116ef700 1 -- 172.21.15.174:0/2572393363 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f560c0a5900 msgr2=0x7f560c135030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:39.325 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.319+0000 7f56116ef700 1 --2- 172.21.15.174:0/2572393363 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f560c0a5900 0x7f560c135030 secure :-1 s=READY pgs=75 cs=0 l=1 rx=0x7f560c09e3e0 tx=0x7f5600007a40).stop 2020-04-02T23:21:39.325 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.319+0000 7f56116ef700 1 -- 172.21.15.174:0/2572393363 shutdown_connections 2020-04-02T23:21:39.325 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.319+0000 7f56116ef700 1 --2- 172.21.15.174:0/2572393363 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f560c0a5900 0x7f560c135030 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:39.326 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.319+0000 7f56116ef700 1 -- 172.21.15.174:0/2572393363 >> 172.21.15.174:0/2572393363 conn(0x7f560c0aaf80 msgr2=0x7f560c0a6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:39.326 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.319+0000 7f56116ef700 1 -- 172.21.15.174:0/2572393363 shutdown_connections 2020-04-02T23:21:39.326 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.319+0000 7f56116ef700 1 -- 172.21.15.174:0/2572393363 wait complete. 2020-04-02T23:21:39.326 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.320+0000 7f56116ef700 1 Processor -- start 2020-04-02T23:21:39.326 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.320+0000 7f56116ef700 1 -- start start 2020-04-02T23:21:39.331 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.320+0000 7f56116ef700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f560c0a5900 0x7f560c09e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:39.331 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.320+0000 7f56116ef700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f560c09ee20 0x7f560c137c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:39.331 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.320+0000 7f56116ef700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f560c1424c0 con 0x7f560c05ac00 2020-04-02T23:21:39.331 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.320+0000 7f56116ef700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f560c0a01c0 con 0x7f560c09ee20 2020-04-02T23:21:39.332 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.321+0000 7f56116ef700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f560c141670 con 0x7f560c0a5900 2020-04-02T23:21:39.332 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.321+0000 7f560affd700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f560c05ac00 0x7f560c141db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:44634/0 (socket says 172.21.15.174:44634) 2020-04-02T23:21:39.332 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.321+0000 7f560affd700 1 -- 172.21.15.174:0/3894544795 learned_addr learned my addr 172.21.15.174:0/3894544795 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:21:39.332 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.321+0000 7f55fbfff700 1 -- 172.21.15.174:0/3894544795 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 833358222 0 0) 0x7f560c1424c0 con 0x7f560c05ac00 2020-04-02T23:21:39.332 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.321+0000 7f55fbfff700 1 -- 172.21.15.174:0/3894544795 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55e8002fe0 con 0x7f560c05ac00 2020-04-02T23:21:39.332 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.321+0000 7f560b7fe700 1 --2- 172.21.15.174:0/3894544795 >> v2:172.21.15.196:3300/0 conn(0x7f560c09ee20 0x7f560c137c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:39.332 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.321+0000 7f560a7fc700 1 --2- 172.21.15.174:0/3894544795 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f560c0a5900 0x7f560c09e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:39.333 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.321+0000 7f55fbfff700 1 -- 172.21.15.174:0/3894544795 <== mon.0 v1:172.21.15.174:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1071702830 0 0) 0x7f55e8002fe0 con 0x7f560c05ac00 2020-04-02T23:21:39.333 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.321+0000 7f55fbfff700 1 -- 172.21.15.174:0/3894544795 --> v1:172.21.15.174:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f560c1424c0 con 0x7f560c05ac00 2020-04-02T23:21:39.333 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.321+0000 7f55fbfff700 1 -- 172.21.15.174:0/3894544795 <== mon.0 v1:172.21.15.174:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2811762909 0 0) 0x7f5600011ea0 con 0x7f560c05ac00 2020-04-02T23:21:39.333 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.321+0000 7f55fbfff700 1 -- 172.21.15.174:0/3894544795 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f560c0a5900 msgr2=0x7f560c09e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:39.333 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.321+0000 7f55fbfff700 1 --2- 172.21.15.174:0/3894544795 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f560c0a5900 0x7f560c09e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:39.333 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.321+0000 7f55fbfff700 1 -- 172.21.15.174:0/3894544795 >> v2:172.21.15.196:3300/0 conn(0x7f560c09ee20 msgr2=0x7f560c137c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:39.333 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.321+0000 7f55fbfff700 1 --2- 172.21.15.174:0/3894544795 >> v2:172.21.15.196:3300/0 conn(0x7f560c09ee20 0x7f560c137c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:39.334 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.321+0000 7f55fbfff700 1 -- 172.21.15.174:0/3894544795 >> v1:172.21.15.174:6789/0 conn(0x7f560c05ac00 legacy=0x7f560c141db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:39.334 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.321+0000 7f55fbfff700 1 --2- 172.21.15.174:0/3894544795 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f55e80049b0 0x7f55e8004dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:39.334 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.321+0000 7f55fbfff700 1 --2- 172.21.15.174:0/3894544795 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55e80052a0 0x7f55e8003980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:39.334 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.321+0000 7f55fbfff700 1 --2- 172.21.15.174:0/3894544795 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f55e8003f80 0x7f55e8004400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:39.334 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.321+0000 7f55fbfff700 1 -- 172.21.15.174:0/3894544795 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f560c0a01c0 con 0x7f55e80052a0 2020-04-02T23:21:39.334 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.321+0000 7f55fbfff700 1 -- 172.21.15.174:0/3894544795 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f560c141670 con 0x7f55e8003f80 2020-04-02T23:21:39.334 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.321+0000 7f55fbfff700 1 -- 172.21.15.174:0/3894544795 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55e800b990 con 0x7f55e80049b0 2020-04-02T23:21:39.334 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.321+0000 7f560b7fe700 1 --2- 172.21.15.174:0/3894544795 >> v2:172.21.15.196:3300/0 conn(0x7f560c09ee20 0x7f560c137c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-02T23:21:39.335 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.321+0000 7f560a7fc700 1 --2- 172.21.15.174:0/3894544795 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f560c0a5900 0x7f560c09e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-02T23:21:39.335 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.321+0000 7f560affd700 1 --2- 172.21.15.174:0/3894544795 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f55e80049b0 0x7f55e8004dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:39.335 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.321+0000 7f560a7fc700 1 --2- 172.21.15.174:0/3894544795 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55e80052a0 0x7f55e8003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:39.335 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.321+0000 7f560b7fe700 1 --2- 172.21.15.174:0/3894544795 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f55e8003f80 0x7f55e8004400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:39.335 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.321+0000 7f560a7fc700 1 -- 172.21.15.174:0/3894544795 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f55e80049b0 msgr2=0x7f55e8004dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:39.335 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.321+0000 7f560a7fc700 1 --2- 172.21.15.174:0/3894544795 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f55e80049b0 0x7f55e8004dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:39.335 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.321+0000 7f560a7fc700 1 -- 172.21.15.174:0/3894544795 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f55e8003f80 msgr2=0x7f55e8004400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:39.336 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.321+0000 7f560a7fc700 1 --2- 172.21.15.174:0/3894544795 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f55e8003f80 0x7f55e8004400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:39.336 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.321+0000 7f560a7fc700 1 -- 172.21.15.174:0/3894544795 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f560c141910 con 0x7f55e80052a0 2020-04-02T23:21:39.336 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.321+0000 7f56116ef700 1 -- 172.21.15.174:0/3894544795 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f560c136790 con 0x7f55e80052a0 2020-04-02T23:21:39.336 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.322+0000 7f560a7fc700 1 --2- 172.21.15.174:0/3894544795 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55e80052a0 0x7f55e8003980 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f55fc001f50 tx=0x7f55fc002e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:39.336 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.322+0000 7f56116ef700 1 -- 172.21.15.174:0/3894544795 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f560c09fd90 con 0x7f55e80052a0 2020-04-02T23:21:39.336 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.322+0000 7f560a7fc700 1 --2- 172.21.15.174:0/3894544795 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55e80052a0 0x7f55e8003980 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f55fc001f50 tx=0x7f55fc002e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:39.336 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.322+0000 7f560a7fc700 1 --2- 172.21.15.174:0/3894544795 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55e80052a0 0x7f55e8003980 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7f55fc001f50 tx=0x7f55fc002e70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:39.337 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.322+0000 7f560a7fc700 1 --2- 172.21.15.174:0/3894544795 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55e80052a0 0x7f55e8003980 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f55fc001f50 tx=0x7f55fc002e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:39.337 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.322+0000 7f55fbfff700 1 -- 172.21.15.174:0/3894544795 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55fc00ca10 con 0x7f55e80052a0 2020-04-02T23:21:39.337 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.322+0000 7f560a7fc700 1 --2- 172.21.15.174:0/3894544795 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55e80052a0 0x7f55e8003980 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f55fc001f50 tx=0x7f55fc002e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:39.337 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.322+0000 7f560a7fc700 1 --2- 172.21.15.174:0/3894544795 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55e80052a0 0x7f55e8003980 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f55fc001f50 tx=0x7f55fc002e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:39.337 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.322+0000 7f55fbfff700 1 -- 172.21.15.174:0/3894544795 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55fc00cb70 con 0x7f55e80052a0 2020-04-02T23:21:39.337 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.322+0000 7f55fbfff700 1 -- 172.21.15.174:0/3894544795 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55fc0064e0 con 0x7f55e80052a0 2020-04-02T23:21:39.338 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.322+0000 7f560a7fc700 1 --2- 172.21.15.174:0/3894544795 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55e80052a0 0x7f55e8003980 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f55fc001f50 tx=0x7f55fc002e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:39.338 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.322+0000 7f56116ef700 1 -- 172.21.15.174:0/3894544795 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55ec003340 con 0x7f55e80052a0 2020-04-02T23:21:39.338 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.323+0000 7f55fbfff700 1 -- 172.21.15.174:0/3894544795 <== mon.0 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f55fc006640 con 0x7f55e80052a0 2020-04-02T23:21:39.338 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.323+0000 7f560a7fc700 1 --2- 172.21.15.174:0/3894544795 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55e80052a0 0x7f55e8003980 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f55fc001f50 tx=0x7f55fc002e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:39.338 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.323+0000 7f55fbfff700 1 --2- 172.21.15.174:0/3894544795 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f55e8055db0 0x7f55e8058270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:39.338 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.323+0000 7f55fbfff700 1 -- 172.21.15.174:0/3894544795 <== mon.0 v2:172.21.15.174:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f55fc060950 con 0x7f55e80052a0 2020-04-02T23:21:39.338 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.323+0000 7f560affd700 1 --2- 172.21.15.174:0/3894544795 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f55e8055db0 0x7f55e8058270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:39.338 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.324+0000 7f560affd700 1 --2- 172.21.15.174:0/3894544795 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f55e8055db0 0x7f55e8058270 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5600008320 tx=0x7f5600008fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:39.339 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.324+0000 7f560affd700 1 --2- 172.21.15.174:0/3894544795 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f55e8055db0 0x7f55e8058270 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5600008320 tx=0x7f5600008fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:39.339 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.324+0000 7f560affd700 1 --2- 172.21.15.174:0/3894544795 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f55e8055db0 0x7f55e8058270 secure :-1 s=READY pgs=51 cs=0 l=1 rx=0x7f5600008320 tx=0x7f5600008fa0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:39.339 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.327+0000 7f560a7fc700 1 --2- 172.21.15.174:0/3894544795 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55e80052a0 0x7f55e8003980 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f55fc001f50 tx=0x7f55fc002e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:39.339 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.327+0000 7f55fbfff700 1 -- 172.21.15.174:0/3894544795 <== mon.0 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f55fc03c170 con 0x7f55e80052a0 2020-04-02T23:21:39.465 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:39.462+0000 7f56116ef700 1 -- 172.21.15.174:0/3894544795 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f55ec002200 con 0x7f55e80052a0 2020-04-02T23:21:40.156 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.153+0000 7f560a7fc700 1 --2- 172.21.15.174:0/3894544795 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55e80052a0 0x7f55e8003980 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f55fc001f50 tx=0x7f55fc002e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:40.156 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.153+0000 7f55fbfff700 1 -- 172.21.15.174:0/3894544795 <== mon.0 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v21) v1 ==== 125+0+0 (secure 0 0 0) 0x7f55fc03f790 con 0x7f55e80052a0 2020-04-02T23:21:40.160 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.157+0000 7f56116ef700 1 -- 172.21.15.174:0/3894544795 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f55e8055db0 msgr2=0x7f55e8058270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:40.160 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.157+0000 7f56116ef700 1 --2- 172.21.15.174:0/3894544795 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f55e8055db0 0x7f55e8058270 secure :-1 s=READY pgs=51 cs=0 l=1 rx=0x7f5600008320 tx=0x7f5600008fa0).stop 2020-04-02T23:21:40.161 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.157+0000 7f560b7fe700 1 -- 172.21.15.174:0/3894544795 reap_dead start 2020-04-02T23:21:40.161 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.157+0000 7f56116ef700 1 -- 172.21.15.174:0/3894544795 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55e80052a0 msgr2=0x7f55e8003980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:40.161 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.157+0000 7f56116ef700 1 --2- 172.21.15.174:0/3894544795 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55e80052a0 0x7f55e8003980 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7f55fc001f50 tx=0x7f55fc002e70).stop 2020-04-02T23:21:40.161 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.158+0000 7f56116ef700 1 -- 172.21.15.174:0/3894544795 shutdown_connections 2020-04-02T23:21:40.161 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.158+0000 7f56116ef700 1 --2- 172.21.15.174:0/3894544795 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55e80052a0 0x7f55e8003980 secure :-1 s=CLOSED pgs=77 cs=0 l=1 rx=0x7f55fc001f50 tx=0x7f55fc002e70).stop 2020-04-02T23:21:40.161 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.158+0000 7f56116ef700 1 -- 172.21.15.174:0/3894544795 >> 172.21.15.174:0/3894544795 conn(0x7f560c0aaf80 msgr2=0x7f560c05b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:40.161 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.158+0000 7f56116ef700 1 -- 172.21.15.174:0/3894544795 shutdown_connections 2020-04-02T23:21:40.162 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.158+0000 7f56116ef700 1 -- 172.21.15.174:0/3894544795 wait complete. 2020-04-02T23:21:40.162 INFO:teuthology.orchestra.run.smithi174.stderr:pool 'cephfs_data' created 2020-04-02T23:21:40.173 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:40.188 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2020-04-02T23:21:40.342 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.339+0000 7fdb94e82700 1 Processor -- start 2020-04-02T23:21:40.342 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.339+0000 7fdb94e82700 1 -- start start 2020-04-02T23:21:40.347 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.340+0000 7fdb94e82700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fdb900a5900 0x7fdb90135030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:40.347 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.340+0000 7fdb94e82700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fdb9005ac00 0x7fdb9012e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:40.347 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.340+0000 7fdb94e82700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdb9012e6c0 0x7fdb901379f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:40.348 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.340+0000 7fdb94e82700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb9005b0b0 con 0x7fdb9005ac00 2020-04-02T23:21:40.348 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.340+0000 7fdb94e82700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb90134420 con 0x7fdb900a5900 2020-04-02T23:21:40.348 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.340+0000 7fdb94e82700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb900a49d0 con 0x7fdb9012e6c0 2020-04-02T23:21:40.348 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.340+0000 7fdb8dd9b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fdb9005ac00 0x7fdb9012e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:40.348 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.340+0000 7fdb8dd9b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fdb9005ac00 0x7fdb9012e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:39610/0 (socket says 172.21.15.174:39610) 2020-04-02T23:21:40.348 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.340+0000 7fdb8dd9b700 1 -- 172.21.15.174:0/2253496293 learned_addr learned my addr 172.21.15.174:0/2253496293 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:21:40.348 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.340+0000 7fdb8ed9d700 1 --2- 172.21.15.174:0/2253496293 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdb9012e6c0 0x7fdb901379f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:40.349 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.340+0000 7fdb8e59c700 1 --2- 172.21.15.174:0/2253496293 >> v2:172.21.15.196:3300/0 conn(0x7fdb900a5900 0x7fdb90135030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:40.349 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.341+0000 7fdb8dd9b700 1 -- 172.21.15.174:0/2253496293 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdb9012e6c0 msgr2=0x7fdb901379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:40.349 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.341+0000 7fdb8dd9b700 1 --2- 172.21.15.174:0/2253496293 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdb9012e6c0 0x7fdb901379f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:40.349 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.341+0000 7fdb8dd9b700 1 -- 172.21.15.174:0/2253496293 >> v2:172.21.15.196:3300/0 conn(0x7fdb900a5900 msgr2=0x7fdb90135030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:40.349 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.341+0000 7fdb8dd9b700 1 --2- 172.21.15.174:0/2253496293 >> v2:172.21.15.196:3300/0 conn(0x7fdb900a5900 0x7fdb90135030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:40.349 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.341+0000 7fdb8dd9b700 1 -- 172.21.15.174:0/2253496293 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb90134650 con 0x7fdb9005ac00 2020-04-02T23:21:40.349 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.341+0000 7fdb8dd9b700 1 --2- 172.21.15.174:0/2253496293 >> v2:172.21.15.174:3300/0 conn(0x7fdb9005ac00 0x7fdb9012e260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdb80002f30 tx=0x7fdb80007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:40.350 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.341+0000 7fdb8dd9b700 1 --2- 172.21.15.174:0/2253496293 >> v2:172.21.15.174:3300/0 conn(0x7fdb9005ac00 0x7fdb9012e260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdb80002f30 tx=0x7fdb80007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:40.350 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.341+0000 7fdb8dd9b700 1 --2- 172.21.15.174:0/2253496293 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdb9005ac00 0x7fdb9012e260 secure :-1 s=READY pgs=78 cs=0 l=1 rx=0x7fdb80002f30 tx=0x7fdb80007a40).ready entity=mon.0 client_cookie=4d00fc6dc376977 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:40.350 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.341+0000 7fdb8dd9b700 1 --2- 172.21.15.174:0/2253496293 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdb9005ac00 0x7fdb9012e260 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7fdb80002f30 tx=0x7fdb80007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:40.350 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.341+0000 7fdb8d59a700 1 -- 172.21.15.174:0/2253496293 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb800115c0 con 0x7fdb9005ac00 2020-04-02T23:21:40.350 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.341+0000 7fdb8dd9b700 1 --2- 172.21.15.174:0/2253496293 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdb9005ac00 0x7fdb9012e260 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7fdb80002f30 tx=0x7fdb80007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:40.350 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.341+0000 7fdb8d59a700 1 -- 172.21.15.174:0/2253496293 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb80011720 con 0x7fdb9005ac00 2020-04-02T23:21:40.350 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.341+0000 7fdb8dd9b700 1 --2- 172.21.15.174:0/2253496293 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdb9005ac00 0x7fdb9012e260 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7fdb80002f30 tx=0x7fdb80007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:40.350 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.341+0000 7fdb8d59a700 1 -- 172.21.15.174:0/2253496293 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb80011b00 con 0x7fdb9005ac00 2020-04-02T23:21:40.351 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.341+0000 7fdb94e82700 1 -- 172.21.15.174:0/2253496293 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdb9005ac00 msgr2=0x7fdb9012e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:40.351 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.341+0000 7fdb94e82700 1 --2- 172.21.15.174:0/2253496293 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdb9005ac00 0x7fdb9012e260 secure :-1 s=READY pgs=78 cs=0 l=1 rx=0x7fdb80002f30 tx=0x7fdb80007a40).stop 2020-04-02T23:21:40.351 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.342+0000 7fdb94e82700 1 -- 172.21.15.174:0/2253496293 shutdown_connections 2020-04-02T23:21:40.351 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.342+0000 7fdb94e82700 1 --2- 172.21.15.174:0/2253496293 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdb9012e6c0 0x7fdb901379f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:40.351 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.342+0000 7fdb94e82700 1 --2- 172.21.15.174:0/2253496293 >> v2:172.21.15.196:3300/0 conn(0x7fdb900a5900 0x7fdb90135030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:40.351 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.342+0000 7fdb94e82700 1 --2- 172.21.15.174:0/2253496293 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdb9005ac00 0x7fdb9012e260 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:40.351 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.342+0000 7fdb94e82700 1 -- 172.21.15.174:0/2253496293 >> 172.21.15.174:0/2253496293 conn(0x7fdb900aaf80 msgr2=0x7fdb900a6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:40.351 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.342+0000 7fdb94e82700 1 -- 172.21.15.174:0/2253496293 shutdown_connections 2020-04-02T23:21:40.352 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.342+0000 7fdb94e82700 1 -- 172.21.15.174:0/2253496293 wait complete. 2020-04-02T23:21:40.352 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.342+0000 7fdb94e82700 1 Processor -- start 2020-04-02T23:21:40.352 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.342+0000 7fdb94e82700 1 -- start start 2020-04-02T23:21:40.352 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.343+0000 7fdb94e82700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdb900a5900 0x7fdb9012ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:40.352 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.343+0000 7fdb94e82700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fdb9012e6c0 0x7fdb901315e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:40.352 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.343+0000 7fdb94e82700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb90130be0 con 0x7fdb9005ac00 2020-04-02T23:21:40.352 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.343+0000 7fdb94e82700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb901309f0 con 0x7fdb9012e6c0 2020-04-02T23:21:40.353 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.343+0000 7fdb94e82700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb90130e80 con 0x7fdb900a5900 2020-04-02T23:21:40.353 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.343+0000 7fdb8e59c700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fdb9005ac00 0x7fdb90146ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:44654/0 (socket says 172.21.15.174:44654) 2020-04-02T23:21:40.353 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.343+0000 7fdb8e59c700 1 -- 172.21.15.174:0/2680791343 learned_addr learned my addr 172.21.15.174:0/2680791343 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:21:40.353 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.343+0000 7fdb8dd9b700 1 --2- 172.21.15.174:0/2680791343 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdb900a5900 0x7fdb9012ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:40.353 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.343+0000 7fdb8ed9d700 1 --2- 172.21.15.174:0/2680791343 >> v2:172.21.15.196:3300/0 conn(0x7fdb9012e6c0 0x7fdb901315e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:40.353 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.343+0000 7fdb7f7fe700 1 -- 172.21.15.174:0/2680791343 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3704253549 0 0) 0x7fdb90130be0 con 0x7fdb9005ac00 2020-04-02T23:21:40.354 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.343+0000 7fdb7f7fe700 1 -- 172.21.15.174:0/2680791343 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb6c002fe0 con 0x7fdb9005ac00 2020-04-02T23:21:40.354 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.343+0000 7fdb8ed9d700 1 -- 172.21.15.174:0/2680791343 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdb900a5900 msgr2=0x7fdb9012ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:40.354 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.343+0000 7fdb8ed9d700 1 --2- 172.21.15.174:0/2680791343 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdb900a5900 0x7fdb9012ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:40.354 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.343+0000 7fdb8ed9d700 1 -- 172.21.15.174:0/2680791343 >> v1:172.21.15.174:6789/0 conn(0x7fdb9005ac00 legacy=0x7fdb90146ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:40.354 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.343+0000 7fdb8ed9d700 1 -- 172.21.15.174:0/2680791343 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb90131120 con 0x7fdb9012e6c0 2020-04-02T23:21:40.354 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.344+0000 7fdb8dd9b700 1 --2- 172.21.15.174:0/2680791343 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdb900a5900 0x7fdb9012ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:21:40.354 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.344+0000 7fdb8ed9d700 1 --2- 172.21.15.174:0/2680791343 >> v2:172.21.15.196:3300/0 conn(0x7fdb9012e6c0 0x7fdb901315e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdb880032b0 tx=0x7fdb88010e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:40.355 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.344+0000 7fdb8ed9d700 1 --2- 172.21.15.174:0/2680791343 >> v2:172.21.15.196:3300/0 conn(0x7fdb9012e6c0 0x7fdb901315e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdb880032b0 tx=0x7fdb88010e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:40.355 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.344+0000 7fdb8ed9d700 1 --2- 172.21.15.174:0/2680791343 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdb9012e6c0 0x7fdb901315e0 secure :-1 s=READY pgs=64 cs=0 l=1 rx=0x7fdb880032b0 tx=0x7fdb88010e20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:40.355 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.344+0000 7fdb8ed9d700 1 --2- 172.21.15.174:0/2680791343 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdb9012e6c0 0x7fdb901315e0 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7fdb880032b0 tx=0x7fdb88010e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:40.355 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.344+0000 7fdb7f7fe700 1 -- 172.21.15.174:0/2680791343 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb8800eb40 con 0x7fdb9012e6c0 2020-04-02T23:21:40.355 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.344+0000 7fdb8ed9d700 1 --2- 172.21.15.174:0/2680791343 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdb9012e6c0 0x7fdb901315e0 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7fdb880032b0 tx=0x7fdb88010e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:40.355 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.344+0000 7fdb7f7fe700 1 -- 172.21.15.174:0/2680791343 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb8800eca0 con 0x7fdb9012e6c0 2020-04-02T23:21:40.355 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.344+0000 7fdb8ed9d700 1 --2- 172.21.15.174:0/2680791343 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdb9012e6c0 0x7fdb901315e0 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7fdb880032b0 tx=0x7fdb88010e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:40.355 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.344+0000 7fdb94e82700 1 -- 172.21.15.174:0/2680791343 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb90147600 con 0x7fdb9012e6c0 2020-04-02T23:21:40.356 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.344+0000 7fdb7f7fe700 1 -- 172.21.15.174:0/2680791343 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb8800ee10 con 0x7fdb9012e6c0 2020-04-02T23:21:40.356 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.344+0000 7fdb94e82700 1 -- 172.21.15.174:0/2680791343 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb900a05f0 con 0x7fdb9012e6c0 2020-04-02T23:21:40.356 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.345+0000 7fdb8ed9d700 1 --2- 172.21.15.174:0/2680791343 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdb9012e6c0 0x7fdb901315e0 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7fdb880032b0 tx=0x7fdb88010e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:40.357 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.345+0000 7fdb94e82700 1 -- 172.21.15.174:0/2680791343 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb90056c50 con 0x7fdb9012e6c0 2020-04-02T23:21:40.357 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.345+0000 7fdb7f7fe700 1 -- 172.21.15.174:0/2680791343 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fdb88010140 con 0x7fdb9012e6c0 2020-04-02T23:21:40.357 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.345+0000 7fdb8ed9d700 1 --2- 172.21.15.174:0/2680791343 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdb9012e6c0 0x7fdb901315e0 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7fdb880032b0 tx=0x7fdb88010e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:40.358 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.345+0000 7fdb7f7fe700 1 --2- 172.21.15.174:0/2680791343 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fdb6c04d8f0 0x7fdb6c04fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:40.358 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.345+0000 7fdb7f7fe700 1 -- 172.21.15.174:0/2680791343 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5957+0+0 (secure 0 0 0) 0x7fdb88061490 con 0x7fdb9012e6c0 2020-04-02T23:21:40.358 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.346+0000 7fdb8e59c700 1 --2- 172.21.15.174:0/2680791343 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fdb6c04d8f0 0x7fdb6c04fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:40.358 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.346+0000 7fdb8e59c700 1 --2- 172.21.15.174:0/2680791343 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fdb6c04d8f0 0x7fdb6c04fdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdb84002f30 tx=0x7fdb84008810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:40.358 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.346+0000 7fdb8e59c700 1 --2- 172.21.15.174:0/2680791343 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fdb6c04d8f0 0x7fdb6c04fdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdb84002f30 tx=0x7fdb84008810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:40.358 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.346+0000 7fdb8e59c700 1 --2- 172.21.15.174:0/2680791343 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fdb6c04d8f0 0x7fdb6c04fdb0 secure :-1 s=READY pgs=52 cs=0 l=1 rx=0x7fdb84002f30 tx=0x7fdb84008810).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:40.358 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.349+0000 7fdb8ed9d700 1 --2- 172.21.15.174:0/2680791343 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdb9012e6c0 0x7fdb901315e0 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7fdb880032b0 tx=0x7fdb88010e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:40.359 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.349+0000 7fdb7f7fe700 1 -- 172.21.15.174:0/2680791343 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fdb8803cb10 con 0x7fdb9012e6c0 2020-04-02T23:21:40.541 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.532+0000 7fdb94e82700 1 -- 172.21.15.174:0/2680791343 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7fdb9005a690 con 0x7fdb9012e6c0 2020-04-02T23:21:40.546 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.538+0000 7fdb8ed9d700 1 --2- 172.21.15.174:0/2680791343 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdb9012e6c0 0x7fdb901315e0 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7fdb880032b0 tx=0x7fdb88010e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:40.547 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.538+0000 7fdb7f7fe700 1 -- 172.21.15.174:0/2680791343 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 3 and data pool 4 v2) v1 ==== 187+0+0 (secure 0 0 0) 0x7fdb88040130 con 0x7fdb9012e6c0 2020-04-02T23:21:40.547 INFO:tasks.ceph.mon.a.smithi174.stderr:2020-04-02T23:21:40.533+0000 7f5b36ea4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2020-04-02T23:21:40.548 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.540+0000 7fdb94e82700 1 -- 172.21.15.174:0/2680791343 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fdb6c04d8f0 msgr2=0x7fdb6c04fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:40.548 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.540+0000 7fdb94e82700 1 --2- 172.21.15.174:0/2680791343 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fdb6c04d8f0 0x7fdb6c04fdb0 secure :-1 s=READY pgs=52 cs=0 l=1 rx=0x7fdb84002f30 tx=0x7fdb84008810).stop 2020-04-02T23:21:40.548 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.540+0000 7fdb94e82700 1 -- 172.21.15.174:0/2680791343 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdb9012e6c0 msgr2=0x7fdb901315e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:40.549 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.540+0000 7fdb94e82700 1 --2- 172.21.15.174:0/2680791343 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdb9012e6c0 0x7fdb901315e0 secure :-1 s=READY pgs=64 cs=0 l=1 rx=0x7fdb880032b0 tx=0x7fdb88010e20).stop 2020-04-02T23:21:40.549 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.540+0000 7fdb94e82700 1 -- 172.21.15.174:0/2680791343 shutdown_connections 2020-04-02T23:21:40.549 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.540+0000 7fdb94e82700 1 --2- 172.21.15.174:0/2680791343 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fdb6c04d8f0 0x7fdb6c04fdb0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:40.549 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.540+0000 7fdb94e82700 1 --2- 172.21.15.174:0/2680791343 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdb9012e6c0 0x7fdb901315e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:40.549 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.540+0000 7fdb94e82700 1 --2- 172.21.15.174:0/2680791343 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdb900a5900 0x7fdb9012ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:40.549 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.540+0000 7fdb94e82700 1 -- 172.21.15.174:0/2680791343 >> 172.21.15.174:0/2680791343 conn(0x7fdb900aaf80 msgr2=0x7fdb9005b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:40.549 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.540+0000 7fdb94e82700 1 -- 172.21.15.174:0/2680791343 shutdown_connections 2020-04-02T23:21:40.549 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.540+0000 7fdb94e82700 1 -- 172.21.15.174:0/2680791343 wait complete. 2020-04-02T23:21:40.550 INFO:teuthology.orchestra.run.smithi174.stderr:new fs with metadata pool 3 and data pool 4 2020-04-02T23:21:40.569 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:40.583 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-02T23:21:40.730 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.727+0000 7f002e6a3700 1 Processor -- start 2020-04-02T23:21:40.730 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.727+0000 7f002e6a3700 1 -- start start 2020-04-02T23:21:40.735 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.728+0000 7f002e6a3700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f00280a62e0 0x7f002805ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:40.735 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.728+0000 7f002e6a3700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f002813b600 0x7f002813ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:40.735 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.728+0000 7f002e6a3700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00280a9150 con 0x7f00280a5f00 2020-04-02T23:21:40.736 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.728+0000 7f002e6a3700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00280aa720 con 0x7f002813b600 2020-04-02T23:21:40.736 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.728+0000 7f002e6a3700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00280a6770 con 0x7f00280a62e0 2020-04-02T23:21:40.736 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.728+0000 7f002cc40700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f002813b600 0x7f002813ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:40.736 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.728+0000 7f002cc40700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f002813b600 0x7f002813ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:39628/0 (socket says 172.21.15.174:39628) 2020-04-02T23:21:40.736 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.728+0000 7f002cc40700 1 -- 172.21.15.174:0/384071978 learned_addr learned my addr 172.21.15.174:0/384071978 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:21:40.736 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.728+0000 7f001ffff700 1 --2- 172.21.15.174:0/384071978 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f00280a62e0 0x7f002805ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:40.736 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.728+0000 7f002cc40700 1 -- 172.21.15.174:0/384071978 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f00280a62e0 msgr2=0x7f002805ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:40.737 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.728+0000 7f002cc40700 1 --2- 172.21.15.174:0/384071978 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f00280a62e0 0x7f002805ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:40.737 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.728+0000 7f002cc40700 1 -- 172.21.15.174:0/384071978 >> v1:172.21.15.196:6789/0 conn(0x7f00280a5f00 legacy=0x7f00280a9a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:40.737 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.728+0000 7f002cc40700 1 -- 172.21.15.174:0/384071978 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f002805c3b0 con 0x7f002813b600 2020-04-02T23:21:40.737 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.728+0000 7f002cc40700 1 --2- 172.21.15.174:0/384071978 >> v2:172.21.15.174:3300/0 conn(0x7f002813b600 0x7f002813ba90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f00280aa1a0 tx=0x7f0020008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:40.737 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.728+0000 7f002cc40700 1 --2- 172.21.15.174:0/384071978 >> v2:172.21.15.174:3300/0 conn(0x7f002813b600 0x7f002813ba90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f00280aa1a0 tx=0x7f0020008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:40.737 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.728+0000 7f002cc40700 1 --2- 172.21.15.174:0/384071978 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f002813b600 0x7f002813ba90 secure :-1 s=READY pgs=80 cs=0 l=1 rx=0x7f00280aa1a0 tx=0x7f0020008c60).ready entity=mon.0 client_cookie=73f39bdb2d2ddd7c server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:40.737 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.728+0000 7f002cc40700 1 --2- 172.21.15.174:0/384071978 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f002813b600 0x7f002813ba90 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7f00280aa1a0 tx=0x7f0020008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:40.738 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.728+0000 7f00277fe700 1 -- 172.21.15.174:0/384071978 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f002000a160 con 0x7f002813b600 2020-04-02T23:21:40.738 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.729+0000 7f002cc40700 1 --2- 172.21.15.174:0/384071978 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f002813b600 0x7f002813ba90 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7f00280aa1a0 tx=0x7f0020008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:40.738 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.729+0000 7f002cc40700 1 --2- 172.21.15.174:0/384071978 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f002813b600 0x7f002813ba90 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7f00280aa1a0 tx=0x7f0020008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:40.738 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.729+0000 7f00277fe700 1 -- 172.21.15.174:0/384071978 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f002000a2c0 con 0x7f002813b600 2020-04-02T23:21:40.738 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.729+0000 7f00277fe700 1 -- 172.21.15.174:0/384071978 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f002000a6a0 con 0x7f002813b600 2020-04-02T23:21:40.738 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.729+0000 7f002e6a3700 1 -- 172.21.15.174:0/384071978 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f002813b600 msgr2=0x7f002813ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:40.738 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.729+0000 7f002e6a3700 1 --2- 172.21.15.174:0/384071978 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f002813b600 0x7f002813ba90 secure :-1 s=READY pgs=80 cs=0 l=1 rx=0x7f00280aa1a0 tx=0x7f0020008c60).stop 2020-04-02T23:21:40.738 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.729+0000 7f002e6a3700 1 -- 172.21.15.174:0/384071978 shutdown_connections 2020-04-02T23:21:40.739 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.729+0000 7f002e6a3700 1 --2- 172.21.15.174:0/384071978 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f002813b600 0x7f002813ba90 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:40.739 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.729+0000 7f002e6a3700 1 --2- 172.21.15.174:0/384071978 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f00280a62e0 0x7f002805ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:40.739 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.729+0000 7f002e6a3700 1 -- 172.21.15.174:0/384071978 >> 172.21.15.174:0/384071978 conn(0x7f00280ab320 msgr2=0x7f00280ab730 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:40.739 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.729+0000 7f002e6a3700 1 -- 172.21.15.174:0/384071978 shutdown_connections 2020-04-02T23:21:40.739 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.729+0000 7f002e6a3700 1 -- 172.21.15.174:0/384071978 wait complete. 2020-04-02T23:21:40.740 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.730+0000 7f002e6a3700 1 Processor -- start 2020-04-02T23:21:40.740 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.730+0000 7f002e6a3700 1 -- start start 2020-04-02T23:21:40.740 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.730+0000 7f002e6a3700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f00280a5f00 0x7f002812ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:40.740 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.730+0000 7f002e6a3700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f002813b600 0x7f002814fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:40.740 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.731+0000 7f002e6a3700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0028132ec0 con 0x7f00280a62e0 2020-04-02T23:21:40.740 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.731+0000 7f002e6a3700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0028139200 con 0x7f00280a5f00 2020-04-02T23:21:40.740 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.731+0000 7f002e6a3700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00280a8950 con 0x7f002813b600 2020-04-02T23:21:40.740 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.731+0000 7f0027fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f00280a5f00 0x7f002812ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:40.741 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.731+0000 7f0027fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f00280a5f00 0x7f002812ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:39630/0 (socket says 172.21.15.174:39630) 2020-04-02T23:21:40.741 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.731+0000 7f0027fff700 1 -- 172.21.15.174:0/223980837 learned_addr learned my addr 172.21.15.174:0/223980837 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:21:40.741 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.731+0000 7f002cc40700 1 --2- 172.21.15.174:0/223980837 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f002813b600 0x7f002814fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:40.741 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.731+0000 7f0027fff700 1 -- 172.21.15.174:0/223980837 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f002813b600 msgr2=0x7f002814fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:40.741 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.731+0000 7f0027fff700 1 --2- 172.21.15.174:0/223980837 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f002813b600 0x7f002814fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:40.741 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.731+0000 7f0027fff700 1 -- 172.21.15.174:0/223980837 >> v1:172.21.15.196:6789/0 conn(0x7f00280a62e0 legacy=0x7f00280a77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:40.741 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.731+0000 7f0027fff700 1 -- 172.21.15.174:0/223980837 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00280a6b70 con 0x7f00280a5f00 2020-04-02T23:21:40.742 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.731+0000 7f002cc40700 1 --2- 172.21.15.174:0/223980837 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f002813b600 0x7f002814fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-04-02T23:21:40.742 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.731+0000 7f0027fff700 1 --2- 172.21.15.174:0/223980837 >> v2:172.21.15.174:3300/0 conn(0x7f00280a5f00 0x7f002812ee10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f00280a6b00 tx=0x7f00280445b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:40.742 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.731+0000 7f0027fff700 1 --2- 172.21.15.174:0/223980837 >> v2:172.21.15.174:3300/0 conn(0x7f00280a5f00 0x7f002812ee10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f00280a6b00 tx=0x7f00280445b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:40.742 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.731+0000 7f0027fff700 1 --2- 172.21.15.174:0/223980837 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f00280a5f00 0x7f002812ee10 secure :-1 s=READY pgs=81 cs=0 l=1 rx=0x7f00280a6b00 tx=0x7f00280445b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:40.742 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.731+0000 7f0027fff700 1 --2- 172.21.15.174:0/223980837 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f00280a5f00 0x7f002812ee10 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f00280a6b00 tx=0x7f00280445b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:40.742 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.731+0000 7f0027fff700 1 --2- 172.21.15.174:0/223980837 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f00280a5f00 0x7f002812ee10 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f00280a6b00 tx=0x7f00280445b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:40.743 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.731+0000 7f0025ffb700 1 -- 172.21.15.174:0/223980837 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f001800cc70 con 0x7f00280a5f00 2020-04-02T23:21:40.743 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.731+0000 7f0027fff700 1 --2- 172.21.15.174:0/223980837 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f00280a5f00 0x7f002812ee10 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f00280a6b00 tx=0x7f00280445b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:40.743 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.731+0000 7f0025ffb700 1 -- 172.21.15.174:0/223980837 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f001800cdd0 con 0x7f00280a5f00 2020-04-02T23:21:40.743 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.731+0000 7f002e6a3700 1 -- 172.21.15.174:0/223980837 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00280a6e10 con 0x7f00280a5f00 2020-04-02T23:21:40.743 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.731+0000 7f0025ffb700 1 -- 172.21.15.174:0/223980837 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f001800e350 con 0x7f00280a5f00 2020-04-02T23:21:40.743 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.731+0000 7f002e6a3700 1 -- 172.21.15.174:0/223980837 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0028137730 con 0x7f00280a5f00 2020-04-02T23:21:40.743 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.732+0000 7f0027fff700 1 --2- 172.21.15.174:0/223980837 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f00280a5f00 0x7f002812ee10 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f00280a6b00 tx=0x7f00280445b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:40.743 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.732+0000 7f002e6a3700 1 -- 172.21.15.174:0/223980837 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0028056c50 con 0x7f00280a5f00 2020-04-02T23:21:40.744 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.732+0000 7f0025ffb700 1 -- 172.21.15.174:0/223980837 <== mon.0 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f0018010310 con 0x7f00280a5f00 2020-04-02T23:21:40.744 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.732+0000 7f0027fff700 1 --2- 172.21.15.174:0/223980837 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f00280a5f00 0x7f002812ee10 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f00280a6b00 tx=0x7f00280445b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:40.744 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.732+0000 7f0025ffb700 1 --2- 172.21.15.174:0/223980837 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f000c04d600 0x7f000c04fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:40.744 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.733+0000 7f0025ffb700 1 -- 172.21.15.174:0/223980837 <== mon.0 v2:172.21.15.174:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0018060df0 con 0x7f00280a5f00 2020-04-02T23:21:40.744 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.733+0000 7f001ffff700 1 --2- 172.21.15.174:0/223980837 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f000c04d600 0x7f000c04fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:40.744 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.733+0000 7f001ffff700 1 --2- 172.21.15.174:0/223980837 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f000c04d600 0x7f000c04fac0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0010002f30 tx=0x7f0010008d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:40.744 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.733+0000 7f001ffff700 1 --2- 172.21.15.174:0/223980837 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f000c04d600 0x7f000c04fac0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0010002f30 tx=0x7f0010008d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:40.744 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.733+0000 7f001ffff700 1 --2- 172.21.15.174:0/223980837 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f000c04d600 0x7f000c04fac0 secure :-1 s=READY pgs=53 cs=0 l=1 rx=0x7f0010002f30 tx=0x7f0010008d90).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:40.745 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.736+0000 7f0027fff700 1 --2- 172.21.15.174:0/223980837 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f00280a5f00 0x7f002812ee10 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f00280a6b00 tx=0x7f00280445b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:40.745 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.736+0000 7f0025ffb700 1 -- 172.21.15.174:0/223980837 <== mon.0 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f0018064e60 con 0x7f00280a5f00 2020-04-02T23:21:40.876 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.874+0000 7f002e6a3700 1 -- 172.21.15.174:0/223980837 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0028135a10 con 0x7f00280a5f00 2020-04-02T23:21:40.877 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.875+0000 7f0027fff700 1 --2- 172.21.15.174:0/223980837 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f00280a5f00 0x7f002812ee10 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f00280a6b00 tx=0x7f00280445b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:40.877 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.875+0000 7f0025ffb700 1 -- 172.21.15.174:0/223980837 <== mon.0 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16147 (secure 0 0 0) 0x7f001803c490 con 0x7f00280a5f00 2020-04-02T23:21:40.878 INFO:teuthology.orchestra.run.smithi174.stdout: 2020-04-02T23:21:40.878 INFO:teuthology.orchestra.run.smithi174.stdout:{"epoch":22,"fsid":"06504ece-4284-40ba-b298-58864abc4224","created":"2020-04-02T23:21:19.153932+0000","modified":"2020-04-02T23:21:40.534167+0000","last_up_change":"2020-04-02T23:21:29.337390+0000","last_in_change":"2020-04-02T23:21:29.337390+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-02T23:21:22.199702+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-02T23:21:35.314601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-04-02T23:21:38.762876+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-04-02T23:21:39.474986+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c9d748ee-c52f-4f21-b8c9-2a53a937be1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":24590},{"type":"v1","addr":"172.21.15.174:6801","nonce":24590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":24590},{"type":"v1","addr":"172.21.15.174:6803","nonce":24590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":24590},{"type":"v1","addr":"172.21.15.174:6807","nonce":24590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":24590},{"type":"v1","addr":"172.21.15.174:6805","nonce":24590}]},"public_addr":"172.21.15.174:6801/24590","cluster_addr":"172.21.15.174:6803/24590","heartbeat_back_addr":"172.21.15.174:6807/24590","heartbeat_front_addr":"172.21.15.174:6805/24590","state":["exists","up"]},{"osd":1,"uuid":"27c05faf-11f5-4cef-9bde-1a6653a9e533","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":24754},{"type":"v1","addr":"172.21.15.174:6809","nonce":24754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":24754},{"type":"v1","addr":"172.21.15.174:6811","nonce":24754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":24754},{"type":"v1","addr":"172.21.15.174:6815","nonce":24754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":24754},{"type":"v1","addr":"172.21.15.174:6813","nonce":24754}]},"public_addr":"172.21.15.174:6809/24754","cluster_addr":"172.21.15.174:6811/24754","heartbeat_back_addr":"172.21.15.174:6815/24754","heartbeat_front_addr":"172.21.15.174:6813/24754","state":["exists","up"]},{"osd":2,"uuid":"02b1b455-b518-4393-b257-40c3a76af157","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":24781},{"type":"v1","addr":"172.21.15.174:6817","nonce":24781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":24781},{"type":"v1","addr":"172.21.15.174:6819","nonce":24781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":24781},{"type":"v1","addr":"172.21.15.174:6823","nonce":24781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":24781},{"type":"v1","addr":"172.21.15.174:6821","nonce":24781}]},"public_addr":"172.21.15.174:6817/24781","cluster_addr":"172.21.15.174:6819/24781","heartbeat_back_addr":"172.21.15.174:6823/24781","heartbeat_front_addr":"172.21.15.174:6821/24781","state":["exists","up"]},{"osd":3,"uuid":"d7fb3499-9e13-4076-b3cf-28f27eb62967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":24972},{"type":"v1","addr":"172.21.15.174:6825","nonce":24972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":24972},{"type":"v1","addr":"172.21.15.174:6827","nonce":24972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":24972},{"type":"v1","addr":"172.21.15.174:6831","nonce":24972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":24972},{"type":"v1","addr":"172.21.15.174:6829","nonce":24972}]},"public_addr":"172.21.15.174:6825/24972","cluster_addr":"172.21.15.174:6827/24972","heartbeat_back_addr":"172.21.15.174:6831/24972","heartbeat_front_addr":"172.21.15.174:6829/24972","state":["exists","up"]},{"osd":4,"uuid":"16923c47-2f21-43ea-9647-5ead4b1b2101","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":24034},{"type":"v1","addr":"172.21.15.196:6803","nonce":24034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":24034},{"type":"v1","addr":"172.21.15.196:6805","nonce":24034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":24034},{"type":"v1","addr":"172.21.15.196:6809","nonce":24034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":24034},{"type":"v1","addr":"172.21.15.196:6807","nonce":24034}]},"public_addr":"172.21.15.196:6803/24034","cluster_addr":"172.21.15.196:6805/24034","heartbeat_back_addr":"172.21.15.196:6809/24034","heartbeat_front_addr":"172.21.15.196:6807/24034","state":["exists","up"]},{"osd":5,"uuid":"7cf2859b-2226-4908-8d70-6e699d1acb0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":24190},{"type":"v1","addr":"172.21.15.196:6811","nonce":24190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":24190},{"type":"v1","addr":"172.21.15.196:6813","nonce":24190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":24190},{"type":"v1","addr":"172.21.15.196:6817","nonce":24190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":24190},{"type":"v1","addr":"172.21.15.196:6815","nonce":24190}]},"public_addr":"172.21.15.196:6811/24190","cluster_addr":"172.21.15.196:6813/24190","heartbeat_back_addr":"172.21.15.196:6817/24190","heartbeat_front_addr":"172.21.15.196:6815/24190","state":["exists","up"]},{"osd":6,"uuid":"441081ef-133a-41ec-8041-094e129707e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":24212},{"type":"v1","addr":"172.21.15.196:6819","nonce":24212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":24212},{"type":"v1","addr":"172.21.15.196:6821","nonce":24212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":24212},{"type":"v1","addr":"172.21.15.196:6825","nonce":24212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":24212},{"type":"v1","addr":"172.21.15.196:6823","nonce":24212}]},"public_addr":"172.21.15.196:6819/24212","cluster_addr":"172.21.15.196:6821/24212","heartbeat_back_addr":"172.21.15.196:6825/24212","heartbeat_front_addr":"172.21.15.196:6823/24212","state":["exists","up"]},{"osd":7,"uuid":"17ee8d46-46bf-4ef0-8d02-82cbc4ef5a5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":24408},{"type":"v1","addr":"172.21.15.196:6827","nonce":24408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":24408},{"type":"v1","addr":"172.21.15.196:6829","nonce":24408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":24408},{"type":"v1","addr":"172.21.15.196:6833","nonce":24408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":24408},{"type":"v1","addr":"172.21.15.196:6831","nonce":24408}]},"public_addr":"172.21.15.196:6827/24408","cluster_addr":"172.21.15.196:6829/24408","heartbeat_back_addr":"172.21.15.196:6833/24408","heartbeat_front_addr":"172.21.15.196:6831/24408","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.725574+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.732598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.775890+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.854998+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.545334+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.591623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.627501+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.614807+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-02T23:21:40.879 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.876+0000 7f002e6a3700 1 -- 172.21.15.174:0/223980837 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f000c04d600 msgr2=0x7f000c04fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:40.879 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.876+0000 7f002e6a3700 1 --2- 172.21.15.174:0/223980837 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f000c04d600 0x7f000c04fac0 secure :-1 s=READY pgs=53 cs=0 l=1 rx=0x7f0010002f30 tx=0x7f0010008d90).stop 2020-04-02T23:21:40.879 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.876+0000 7f002e6a3700 1 -- 172.21.15.174:0/223980837 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f00280a5f00 msgr2=0x7f002812ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:40.879 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.876+0000 7f002e6a3700 1 --2- 172.21.15.174:0/223980837 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f00280a5f00 0x7f002812ee10 secure :-1 s=READY pgs=81 cs=0 l=1 rx=0x7f00280a6b00 tx=0x7f00280445b0).stop 2020-04-02T23:21:40.879 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.876+0000 7f002e6a3700 1 -- 172.21.15.174:0/223980837 shutdown_connections 2020-04-02T23:21:40.880 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.876+0000 7f002e6a3700 1 --2- 172.21.15.174:0/223980837 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f002813b600 0x7f002814fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:40.880 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.876+0000 7f002e6a3700 1 --2- 172.21.15.174:0/223980837 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f00280a5f00 0x7f002812ee10 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:40.880 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.876+0000 7f002e6a3700 1 --2- 172.21.15.174:0/223980837 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f000c04d600 0x7f000c04fac0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:40.880 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.876+0000 7f002e6a3700 1 -- 172.21.15.174:0/223980837 >> 172.21.15.174:0/223980837 conn(0x7f00280ab320 msgr2=0x7f00280695c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:40.880 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.876+0000 7f002e6a3700 1 -- 172.21.15.174:0/223980837 shutdown_connections 2020-04-02T23:21:40.880 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:40.876+0000 7f002e6a3700 1 -- 172.21.15.174:0/223980837 wait complete. 2020-04-02T23:21:40.890 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:40.903 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-02T23:21:41.048 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.045+0000 7fd92374d700 1 Processor -- start 2020-04-02T23:21:41.048 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.045+0000 7fd92374d700 1 -- start start 2020-04-02T23:21:41.053 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.046+0000 7fd92374d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd91c066180 0x7fd91c09a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:41.053 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.046+0000 7fd92374d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd91c05c3c0 con 0x7fd91c05b340 2020-04-02T23:21:41.054 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.046+0000 7fd92374d700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd91c05c660 con 0x7fd91c09ac70 2020-04-02T23:21:41.054 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.046+0000 7fd92374d700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd91c0a2520 con 0x7fd91c066180 2020-04-02T23:21:41.054 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.046+0000 7fd920ce8700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd91c066180 0x7fd91c09a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:41.054 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.046+0000 7fd9214e9700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fd91c05b340 0x7fd91c065a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:44676/0 (socket says 172.21.15.174:44676) 2020-04-02T23:21:41.054 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.046+0000 7fd9214e9700 1 -- 172.21.15.174:0/253351867 learned_addr learned my addr 172.21.15.174:0/253351867 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:21:41.054 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.046+0000 7fd920ce8700 1 -- 172.21.15.174:0/253351867 >> v1:172.21.15.196:6789/0 conn(0x7fd91c09ac70 legacy=0x7fd91c142b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:41.054 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.046+0000 7fd920ce8700 1 -- 172.21.15.174:0/253351867 >> v1:172.21.15.174:6789/0 conn(0x7fd91c05b340 legacy=0x7fd91c065a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:41.054 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.046+0000 7fd90bfff700 1 -- 172.21.15.174:0/253351867 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1346085158 0 0) 0x7fd91c05c3c0 con 0x7fd91c05b340 2020-04-02T23:21:41.055 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.046+0000 7fd920ce8700 1 -- 172.21.15.174:0/253351867 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd91c0a4fa0 con 0x7fd91c066180 2020-04-02T23:21:41.055 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.046+0000 7fd920ce8700 1 --2- 172.21.15.174:0/253351867 >> v2:172.21.15.174:3300/0 conn(0x7fd91c066180 0x7fd91c09a810 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd91c0abca0 tx=0x7fd918007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:41.055 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.046+0000 7fd920ce8700 1 --2- 172.21.15.174:0/253351867 >> v2:172.21.15.174:3300/0 conn(0x7fd91c066180 0x7fd91c09a810 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd91c0abca0 tx=0x7fd918007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:41.055 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.047+0000 7fd920ce8700 1 --2- 172.21.15.174:0/253351867 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd91c066180 0x7fd91c09a810 secure :-1 s=READY pgs=83 cs=0 l=1 rx=0x7fd91c0abca0 tx=0x7fd918007a40).ready entity=mon.0 client_cookie=e99017483f959cd server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:41.055 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.047+0000 7fd920ce8700 1 --2- 172.21.15.174:0/253351867 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd91c066180 0x7fd91c09a810 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7fd91c0abca0 tx=0x7fd918007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:41.055 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.047+0000 7fd90bfff700 1 -- 172.21.15.174:0/253351867 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd918011430 con 0x7fd91c066180 2020-04-02T23:21:41.055 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.047+0000 7fd920ce8700 1 --2- 172.21.15.174:0/253351867 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd91c066180 0x7fd91c09a810 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7fd91c0abca0 tx=0x7fd918007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:41.056 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.047+0000 7fd90bfff700 1 -- 172.21.15.174:0/253351867 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd918011590 con 0x7fd91c066180 2020-04-02T23:21:41.056 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.047+0000 7fd920ce8700 1 --2- 172.21.15.174:0/253351867 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd91c066180 0x7fd91c09a810 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7fd91c0abca0 tx=0x7fd918007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:41.056 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.047+0000 7fd92374d700 1 -- 172.21.15.174:0/253351867 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd91c066180 msgr2=0x7fd91c09a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:41.056 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.047+0000 7fd92374d700 1 --2- 172.21.15.174:0/253351867 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd91c066180 0x7fd91c09a810 secure :-1 s=READY pgs=83 cs=0 l=1 rx=0x7fd91c0abca0 tx=0x7fd918007a40).stop 2020-04-02T23:21:41.056 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.047+0000 7fd90bfff700 1 -- 172.21.15.174:0/253351867 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd918011970 con 0x7fd91c066180 2020-04-02T23:21:41.056 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.047+0000 7fd92374d700 1 -- 172.21.15.174:0/253351867 shutdown_connections 2020-04-02T23:21:41.056 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.047+0000 7fd92374d700 1 --2- 172.21.15.174:0/253351867 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd91c066180 0x7fd91c09a810 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:41.056 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.047+0000 7fd92374d700 1 -- 172.21.15.174:0/253351867 >> 172.21.15.174:0/253351867 conn(0x7fd91c0aaca0 msgr2=0x7fd91c0ab0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:41.057 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.047+0000 7fd92374d700 1 -- 172.21.15.174:0/253351867 shutdown_connections 2020-04-02T23:21:41.057 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.047+0000 7fd92374d700 1 -- 172.21.15.174:0/253351867 wait complete. 2020-04-02T23:21:41.057 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.048+0000 7fd92374d700 1 Processor -- start 2020-04-02T23:21:41.057 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.048+0000 7fd92374d700 1 -- start start 2020-04-02T23:21:41.057 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.049+0000 7fd92374d700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fd91c05b340 0x7fd91c090270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:41.057 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.049+0000 7fd92374d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd91c066180 0x7fd91c092070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:41.057 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.049+0000 7fd92374d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd91c0907b0 con 0x7fd91c09ac70 2020-04-02T23:21:41.058 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.049+0000 7fd92374d700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd91c0a0c60 con 0x7fd91c066180 2020-04-02T23:21:41.058 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.049+0000 7fd92374d700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd91c0a1810 con 0x7fd91c05b340 2020-04-02T23:21:41.058 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.049+0000 7fd920ce8700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd91c066180 0x7fd91c092070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:41.058 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.049+0000 7fd920ce8700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd91c066180 0x7fd91c092070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:39646/0 (socket says 172.21.15.174:39646) 2020-04-02T23:21:41.058 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.049+0000 7fd921cea700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fd91c09ac70 0x7fd91c0a1100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:44686/0 (socket says 172.21.15.174:44686) 2020-04-02T23:21:41.058 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.049+0000 7fd920ce8700 1 -- 172.21.15.174:0/1153617450 learned_addr learned my addr 172.21.15.174:0/1153617450 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:21:41.058 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.049+0000 7fd920ce8700 1 -- 172.21.15.174:0/1153617450 >> v2:172.21.15.196:3300/0 conn(0x7fd91c05b340 msgr2=0x7fd91c090270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:41.058 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.049+0000 7fd920ce8700 1 --2- 172.21.15.174:0/1153617450 >> v2:172.21.15.196:3300/0 conn(0x7fd91c05b340 0x7fd91c090270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:41.059 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.049+0000 7fd920ce8700 1 -- 172.21.15.174:0/1153617450 >> v1:172.21.15.174:6789/0 conn(0x7fd91c09ac70 legacy=0x7fd91c0a1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:41.059 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.049+0000 7fd90a7fc700 1 -- 172.21.15.174:0/1153617450 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2127656834 0 0) 0x7fd91c0907b0 con 0x7fd91c09ac70 2020-04-02T23:21:41.059 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.049+0000 7fd920ce8700 1 -- 172.21.15.174:0/1153617450 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd91c090a50 con 0x7fd91c066180 2020-04-02T23:21:41.059 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.049+0000 7fd920ce8700 1 --2- 172.21.15.174:0/1153617450 >> v2:172.21.15.174:3300/0 conn(0x7fd91c066180 0x7fd91c092070 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd91c0abca0 tx=0x7fd918007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:41.059 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.049+0000 7fd920ce8700 1 --2- 172.21.15.174:0/1153617450 >> v2:172.21.15.174:3300/0 conn(0x7fd91c066180 0x7fd91c092070 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd91c0abca0 tx=0x7fd918007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:41.059 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.049+0000 7fd920ce8700 1 --2- 172.21.15.174:0/1153617450 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd91c066180 0x7fd91c092070 secure :-1 s=READY pgs=85 cs=0 l=1 rx=0x7fd91c0abca0 tx=0x7fd918007a40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:41.059 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.049+0000 7fd920ce8700 1 --2- 172.21.15.174:0/1153617450 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd91c066180 0x7fd91c092070 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7fd91c0abca0 tx=0x7fd918007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:41.059 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.049+0000 7fd90a7fc700 1 -- 172.21.15.174:0/1153617450 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd918007150 con 0x7fd91c066180 2020-04-02T23:21:41.060 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.049+0000 7fd920ce8700 1 --2- 172.21.15.174:0/1153617450 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd91c066180 0x7fd91c092070 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7fd91c0abca0 tx=0x7fd918007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:41.060 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.049+0000 7fd920ce8700 1 --2- 172.21.15.174:0/1153617450 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd91c066180 0x7fd91c092070 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7fd91c0abca0 tx=0x7fd918007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:41.060 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.049+0000 7fd90a7fc700 1 -- 172.21.15.174:0/1153617450 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9180072b0 con 0x7fd91c066180 2020-04-02T23:21:41.060 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.049+0000 7fd92374d700 1 -- 172.21.15.174:0/1153617450 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd91c0924d0 con 0x7fd91c066180 2020-04-02T23:21:41.060 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.049+0000 7fd90a7fc700 1 -- 172.21.15.174:0/1153617450 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd9180056c0 con 0x7fd91c066180 2020-04-02T23:21:41.060 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.049+0000 7fd92374d700 1 -- 172.21.15.174:0/1153617450 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd91c08fb30 con 0x7fd91c066180 2020-04-02T23:21:41.060 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.050+0000 7fd920ce8700 1 --2- 172.21.15.174:0/1153617450 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd91c066180 0x7fd91c092070 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7fd91c0abca0 tx=0x7fd918007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:41.061 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.050+0000 7fd90a7fc700 1 -- 172.21.15.174:0/1153617450 <== mon.0 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fd918005930 con 0x7fd91c066180 2020-04-02T23:21:41.061 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.050+0000 7fd920ce8700 1 --2- 172.21.15.174:0/1153617450 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd91c066180 0x7fd91c092070 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7fd91c0abca0 tx=0x7fd918007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:41.061 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.050+0000 7fd92374d700 1 -- 172.21.15.174:0/1153617450 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd91c056c50 con 0x7fd91c066180 2020-04-02T23:21:41.061 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.050+0000 7fd90a7fc700 1 --2- 172.21.15.174:0/1153617450 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fd8fc04d3d0 0x7fd8fc04f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:41.061 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.051+0000 7fd90a7fc700 1 -- 172.21.15.174:0/1153617450 <== mon.0 v2:172.21.15.174:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd918061650 con 0x7fd91c066180 2020-04-02T23:21:41.062 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.051+0000 7fd9214e9700 1 --2- 172.21.15.174:0/1153617450 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fd8fc04d3d0 0x7fd8fc04f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:41.062 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.051+0000 7fd9214e9700 1 --2- 172.21.15.174:0/1153617450 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fd8fc04d3d0 0x7fd8fc04f890 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd90c000b80 tx=0x7fd90c001450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:41.062 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.051+0000 7fd9214e9700 1 --2- 172.21.15.174:0/1153617450 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fd8fc04d3d0 0x7fd8fc04f890 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd90c000b80 tx=0x7fd90c001450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:41.062 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.051+0000 7fd9214e9700 1 --2- 172.21.15.174:0/1153617450 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fd8fc04d3d0 0x7fd8fc04f890 secure :-1 s=READY pgs=54 cs=0 l=1 rx=0x7fd90c000b80 tx=0x7fd90c001450).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:41.062 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.054+0000 7fd920ce8700 1 --2- 172.21.15.174:0/1153617450 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd91c066180 0x7fd91c092070 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7fd91c0abca0 tx=0x7fd918007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:41.063 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.054+0000 7fd90a7fc700 1 -- 172.21.15.174:0/1153617450 <== mon.0 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fd91803ce10 con 0x7fd91c066180 2020-04-02T23:21:41.195 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.192+0000 7fd92374d700 1 -- 172.21.15.174:0/1153617450 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd91c0a74b0 con 0x7fd91c066180 2020-04-02T23:21:41.195 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.193+0000 7fd920ce8700 1 --2- 172.21.15.174:0/1153617450 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd91c066180 0x7fd91c092070 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7fd91c0abca0 tx=0x7fd918007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:41.196 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.193+0000 7fd90a7fc700 1 -- 172.21.15.174:0/1153617450 <== mon.0 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16147 (secure 0 0 0) 0x7fd918040430 con 0x7fd91c066180 2020-04-02T23:21:41.196 INFO:teuthology.orchestra.run.smithi174.stdout: 2020-04-02T23:21:41.196 INFO:teuthology.orchestra.run.smithi174.stdout:{"epoch":22,"fsid":"06504ece-4284-40ba-b298-58864abc4224","created":"2020-04-02T23:21:19.153932+0000","modified":"2020-04-02T23:21:40.534167+0000","last_up_change":"2020-04-02T23:21:29.337390+0000","last_in_change":"2020-04-02T23:21:29.337390+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-02T23:21:22.199702+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-02T23:21:35.314601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-04-02T23:21:38.762876+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-04-02T23:21:39.474986+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c9d748ee-c52f-4f21-b8c9-2a53a937be1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":24590},{"type":"v1","addr":"172.21.15.174:6801","nonce":24590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":24590},{"type":"v1","addr":"172.21.15.174:6803","nonce":24590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":24590},{"type":"v1","addr":"172.21.15.174:6807","nonce":24590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":24590},{"type":"v1","addr":"172.21.15.174:6805","nonce":24590}]},"public_addr":"172.21.15.174:6801/24590","cluster_addr":"172.21.15.174:6803/24590","heartbeat_back_addr":"172.21.15.174:6807/24590","heartbeat_front_addr":"172.21.15.174:6805/24590","state":["exists","up"]},{"osd":1,"uuid":"27c05faf-11f5-4cef-9bde-1a6653a9e533","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":24754},{"type":"v1","addr":"172.21.15.174:6809","nonce":24754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":24754},{"type":"v1","addr":"172.21.15.174:6811","nonce":24754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":24754},{"type":"v1","addr":"172.21.15.174:6815","nonce":24754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":24754},{"type":"v1","addr":"172.21.15.174:6813","nonce":24754}]},"public_addr":"172.21.15.174:6809/24754","cluster_addr":"172.21.15.174:6811/24754","heartbeat_back_addr":"172.21.15.174:6815/24754","heartbeat_front_addr":"172.21.15.174:6813/24754","state":["exists","up"]},{"osd":2,"uuid":"02b1b455-b518-4393-b257-40c3a76af157","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":24781},{"type":"v1","addr":"172.21.15.174:6817","nonce":24781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":24781},{"type":"v1","addr":"172.21.15.174:6819","nonce":24781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":24781},{"type":"v1","addr":"172.21.15.174:6823","nonce":24781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":24781},{"type":"v1","addr":"172.21.15.174:6821","nonce":24781}]},"public_addr":"172.21.15.174:6817/24781","cluster_addr":"172.21.15.174:6819/24781","heartbeat_back_addr":"172.21.15.174:6823/24781","heartbeat_front_addr":"172.21.15.174:6821/24781","state":["exists","up"]},{"osd":3,"uuid":"d7fb3499-9e13-4076-b3cf-28f27eb62967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":24972},{"type":"v1","addr":"172.21.15.174:6825","nonce":24972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":24972},{"type":"v1","addr":"172.21.15.174:6827","nonce":24972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":24972},{"type":"v1","addr":"172.21.15.174:6831","nonce":24972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":24972},{"type":"v1","addr":"172.21.15.174:6829","nonce":24972}]},"public_addr":"172.21.15.174:6825/24972","cluster_addr":"172.21.15.174:6827/24972","heartbeat_back_addr":"172.21.15.174:6831/24972","heartbeat_front_addr":"172.21.15.174:6829/24972","state":["exists","up"]},{"osd":4,"uuid":"16923c47-2f21-43ea-9647-5ead4b1b2101","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":24034},{"type":"v1","addr":"172.21.15.196:6803","nonce":24034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":24034},{"type":"v1","addr":"172.21.15.196:6805","nonce":24034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":24034},{"type":"v1","addr":"172.21.15.196:6809","nonce":24034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":24034},{"type":"v1","addr":"172.21.15.196:6807","nonce":24034}]},"public_addr":"172.21.15.196:6803/24034","cluster_addr":"172.21.15.196:6805/24034","heartbeat_back_addr":"172.21.15.196:6809/24034","heartbeat_front_addr":"172.21.15.196:6807/24034","state":["exists","up"]},{"osd":5,"uuid":"7cf2859b-2226-4908-8d70-6e699d1acb0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":24190},{"type":"v1","addr":"172.21.15.196:6811","nonce":24190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":24190},{"type":"v1","addr":"172.21.15.196:6813","nonce":24190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":24190},{"type":"v1","addr":"172.21.15.196:6817","nonce":24190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":24190},{"type":"v1","addr":"172.21.15.196:6815","nonce":24190}]},"public_addr":"172.21.15.196:6811/24190","cluster_addr":"172.21.15.196:6813/24190","heartbeat_back_addr":"172.21.15.196:6817/24190","heartbeat_front_addr":"172.21.15.196:6815/24190","state":["exists","up"]},{"osd":6,"uuid":"441081ef-133a-41ec-8041-094e129707e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":24212},{"type":"v1","addr":"172.21.15.196:6819","nonce":24212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":24212},{"type":"v1","addr":"172.21.15.196:6821","nonce":24212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":24212},{"type":"v1","addr":"172.21.15.196:6825","nonce":24212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":24212},{"type":"v1","addr":"172.21.15.196:6823","nonce":24212}]},"public_addr":"172.21.15.196:6819/24212","cluster_addr":"172.21.15.196:6821/24212","heartbeat_back_addr":"172.21.15.196:6825/24212","heartbeat_front_addr":"172.21.15.196:6823/24212","state":["exists","up"]},{"osd":7,"uuid":"17ee8d46-46bf-4ef0-8d02-82cbc4ef5a5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":24408},{"type":"v1","addr":"172.21.15.196:6827","nonce":24408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":24408},{"type":"v1","addr":"172.21.15.196:6829","nonce":24408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":24408},{"type":"v1","addr":"172.21.15.196:6833","nonce":24408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":24408},{"type":"v1","addr":"172.21.15.196:6831","nonce":24408}]},"public_addr":"172.21.15.196:6827/24408","cluster_addr":"172.21.15.196:6829/24408","heartbeat_back_addr":"172.21.15.196:6833/24408","heartbeat_front_addr":"172.21.15.196:6831/24408","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.725574+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.732598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.775890+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.854998+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.545334+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.591623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.627501+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.614807+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-02T23:21:41.197 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.194+0000 7fd92374d700 1 -- 172.21.15.174:0/1153617450 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fd8fc04d3d0 msgr2=0x7fd8fc04f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:41.197 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.194+0000 7fd92374d700 1 --2- 172.21.15.174:0/1153617450 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fd8fc04d3d0 0x7fd8fc04f890 secure :-1 s=READY pgs=54 cs=0 l=1 rx=0x7fd90c000b80 tx=0x7fd90c001450).stop 2020-04-02T23:21:41.198 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.194+0000 7fd92374d700 1 -- 172.21.15.174:0/1153617450 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd91c066180 msgr2=0x7fd91c092070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:41.198 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.194+0000 7fd92374d700 1 --2- 172.21.15.174:0/1153617450 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd91c066180 0x7fd91c092070 secure :-1 s=READY pgs=85 cs=0 l=1 rx=0x7fd91c0abca0 tx=0x7fd918007a40).stop 2020-04-02T23:21:41.198 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.195+0000 7fd92374d700 1 -- 172.21.15.174:0/1153617450 shutdown_connections 2020-04-02T23:21:41.198 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.195+0000 7fd92374d700 1 --2- 172.21.15.174:0/1153617450 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fd8fc04d3d0 0x7fd8fc04f890 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:41.198 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.195+0000 7fd92374d700 1 --2- 172.21.15.174:0/1153617450 >> v2:172.21.15.196:3300/0 conn(0x7fd91c05b340 0x7fd91c090270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:41.198 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.195+0000 7fd92374d700 1 --2- 172.21.15.174:0/1153617450 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd91c066180 0x7fd91c092070 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:41.198 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.195+0000 7fd92374d700 1 -- 172.21.15.174:0/1153617450 >> 172.21.15.174:0/1153617450 conn(0x7fd91c0aaca0 msgr2=0x7fd91c0a8160 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:41.199 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.195+0000 7fd92374d700 1 -- 172.21.15.174:0/1153617450 shutdown_connections 2020-04-02T23:21:41.199 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.195+0000 7fd92374d700 1 -- 172.21.15.174:0/1153617450 wait complete. 2020-04-02T23:21:41.208 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:41.221 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2020-04-02T23:21:41.368 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.366+0000 7fc2884fc700 1 Processor -- start 2020-04-02T23:21:41.369 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.366+0000 7fc2884fc700 1 -- start start 2020-04-02T23:21:41.376 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.367+0000 7fc2884fc700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fc2800a5f00 0x7fc2800a9a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:41.376 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.367+0000 7fc2884fc700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc28013b600 0x7fc28013ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:41.376 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.367+0000 7fc2884fc700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2800a9150 con 0x7fc2800a62e0 2020-04-02T23:21:41.376 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.367+0000 7fc2884fc700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2800aa720 con 0x7fc2800a5f00 2020-04-02T23:21:41.377 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.367+0000 7fc2884fc700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2800a6770 con 0x7fc28013b600 2020-04-02T23:21:41.377 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.367+0000 7fc285a97700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fc2800a62e0 0x7fc28005ffc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:44692/0 (socket says 172.21.15.174:44692) 2020-04-02T23:21:41.377 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.367+0000 7fc285a97700 1 -- 172.21.15.174:0/995053734 learned_addr learned my addr 172.21.15.174:0/995053734 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:21:41.377 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.367+0000 7fc286a99700 1 --2- 172.21.15.174:0/995053734 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc28013b600 0x7fc28013ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:41.377 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.367+0000 7fc286298700 1 --2- 172.21.15.174:0/995053734 >> v2:172.21.15.196:3300/0 conn(0x7fc2800a5f00 0x7fc2800a9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:41.377 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.367+0000 7fc285296700 1 -- 172.21.15.174:0/995053734 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3778610881 0 0) 0x7fc2800a9150 con 0x7fc2800a62e0 2020-04-02T23:21:41.377 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.367+0000 7fc285296700 1 -- 172.21.15.174:0/995053734 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc268003230 con 0x7fc2800a62e0 2020-04-02T23:21:41.378 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.367+0000 7fc285296700 1 -- 172.21.15.174:0/995053734 <== mon.0 v1:172.21.15.174:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3871281725 0 0) 0x7fc268003230 con 0x7fc2800a62e0 2020-04-02T23:21:41.378 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.367+0000 7fc285296700 1 -- 172.21.15.174:0/995053734 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc28013b600 msgr2=0x7fc28013ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:41.378 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.367+0000 7fc285296700 1 --2- 172.21.15.174:0/995053734 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc28013b600 0x7fc28013ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:41.378 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.367+0000 7fc285296700 1 -- 172.21.15.174:0/995053734 >> v2:172.21.15.196:3300/0 conn(0x7fc2800a5f00 msgr2=0x7fc2800a9a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:41.378 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.367+0000 7fc285296700 1 --2- 172.21.15.174:0/995053734 >> v2:172.21.15.196:3300/0 conn(0x7fc2800a5f00 0x7fc2800a9a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:41.378 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.367+0000 7fc285296700 1 -- 172.21.15.174:0/995053734 --> v1:172.21.15.174:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc28005c3b0 con 0x7fc2800a62e0 2020-04-02T23:21:41.378 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.367+0000 7fc285296700 1 -- 172.21.15.174:0/995053734 <== mon.0 v1:172.21.15.174:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2811762909 0 0) 0x7fc27c0016d0 con 0x7fc2800a62e0 2020-04-02T23:21:41.379 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.367+0000 7fc285296700 1 -- 172.21.15.174:0/995053734 >> v1:172.21.15.174:6789/0 conn(0x7fc2800a62e0 legacy=0x7fc28005ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:41.379 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.367+0000 7fc285296700 1 --2- 172.21.15.174:0/995053734 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc28013b600 0x7fc268003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:41.379 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.367+0000 7fc285296700 1 --2- 172.21.15.174:0/995053734 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc268003b80 0x7fc268003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:41.379 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.367+0000 7fc285296700 1 --2- 172.21.15.174:0/995053734 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc2680045c0 0x7fc268004a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:41.379 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.367+0000 7fc285296700 1 -- 172.21.15.174:0/995053734 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2800aa720 con 0x7fc268003b80 2020-04-02T23:21:41.379 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.367+0000 7fc285296700 1 -- 172.21.15.174:0/995053734 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2800a6770 con 0x7fc2680045c0 2020-04-02T23:21:41.379 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.367+0000 7fc285296700 1 -- 172.21.15.174:0/995053734 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc268005050 con 0x7fc28013b600 2020-04-02T23:21:41.380 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.367+0000 7fc285a97700 1 --2- 172.21.15.174:0/995053734 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc268003b80 0x7fc268003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:41.380 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.368+0000 7fc286298700 1 --2- 172.21.15.174:0/995053734 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc28013b600 0x7fc268003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:41.380 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.368+0000 7fc286a99700 1 --2- 172.21.15.174:0/995053734 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc2680045c0 0x7fc268004a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:41.380 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.368+0000 7fc285a97700 1 -- 172.21.15.174:0/995053734 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc28013b600 msgr2=0x7fc268003720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:41.380 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.368+0000 7fc285a97700 1 --2- 172.21.15.174:0/995053734 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc28013b600 0x7fc268003720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:41.380 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.368+0000 7fc285a97700 1 -- 172.21.15.174:0/995053734 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc2680045c0 msgr2=0x7fc268004a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:41.380 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.368+0000 7fc285a97700 1 --2- 172.21.15.174:0/995053734 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc2680045c0 0x7fc268004a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:41.381 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.368+0000 7fc285a97700 1 -- 172.21.15.174:0/995053734 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc268003230 con 0x7fc268003b80 2020-04-02T23:21:41.381 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.368+0000 7fc286a99700 1 --2- 172.21.15.174:0/995053734 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc2680045c0 0x7fc268004a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-02T23:21:41.381 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.368+0000 7fc285a97700 1 --2- 172.21.15.174:0/995053734 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc268003b80 0x7fc268003fe0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc27c0013e0 tx=0x7fc2801329d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:41.381 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.368+0000 7fc285a97700 1 --2- 172.21.15.174:0/995053734 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc268003b80 0x7fc268003fe0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc27c0013e0 tx=0x7fc2801329d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:41.381 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.368+0000 7fc285a97700 1 --2- 172.21.15.174:0/995053734 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc268003b80 0x7fc268003fe0 secure :-1 s=READY pgs=87 cs=0 l=1 rx=0x7fc27c0013e0 tx=0x7fc2801329d0).ready entity=mon.0 client_cookie=ab4c07fc6c134163 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:41.381 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.368+0000 7fc285a97700 1 --2- 172.21.15.174:0/995053734 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc268003b80 0x7fc268003fe0 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7fc27c0013e0 tx=0x7fc2801329d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:41.381 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.368+0000 7fc285296700 1 -- 172.21.15.174:0/995053734 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc27c00ce70 con 0x7fc268003b80 2020-04-02T23:21:41.382 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.368+0000 7fc285a97700 1 --2- 172.21.15.174:0/995053734 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc268003b80 0x7fc268003fe0 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7fc27c0013e0 tx=0x7fc2801329d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:41.382 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.368+0000 7fc285a97700 1 --2- 172.21.15.174:0/995053734 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc268003b80 0x7fc268003fe0 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7fc27c0013e0 tx=0x7fc2801329d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:41.382 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.368+0000 7fc285296700 1 -- 172.21.15.174:0/995053734 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc27c00e350 con 0x7fc268003b80 2020-04-02T23:21:41.382 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.368+0000 7fc285296700 1 -- 172.21.15.174:0/995053734 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc27c00e6f0 con 0x7fc268003b80 2020-04-02T23:21:41.382 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.368+0000 7fc2884fc700 1 -- 172.21.15.174:0/995053734 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc268003b80 msgr2=0x7fc268003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:41.382 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.368+0000 7fc2884fc700 1 --2- 172.21.15.174:0/995053734 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc268003b80 0x7fc268003fe0 secure :-1 s=READY pgs=87 cs=0 l=1 rx=0x7fc27c0013e0 tx=0x7fc2801329d0).stop 2020-04-02T23:21:41.382 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.368+0000 7fc286a99700 1 -- 172.21.15.174:0/995053734 reap_dead start 2020-04-02T23:21:41.382 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.368+0000 7fc2884fc700 1 -- 172.21.15.174:0/995053734 shutdown_connections 2020-04-02T23:21:41.383 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.368+0000 7fc2884fc700 1 -- 172.21.15.174:0/995053734 >> 172.21.15.174:0/995053734 conn(0x7fc2800ab320 msgr2=0x7fc2800ab730 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:41.383 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.369+0000 7fc2884fc700 1 -- 172.21.15.174:0/995053734 shutdown_connections 2020-04-02T23:21:41.383 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.369+0000 7fc2884fc700 1 -- 172.21.15.174:0/995053734 wait complete. 2020-04-02T23:21:41.383 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.369+0000 7fc2884fc700 1 Processor -- start 2020-04-02T23:21:41.383 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.369+0000 7fc2884fc700 1 -- start start 2020-04-02T23:21:41.383 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.370+0000 7fc2884fc700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc2800a7910 0x7fc280133730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:41.383 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.370+0000 7fc2884fc700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc2801351e0 0x7fc280133b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:41.384 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.370+0000 7fc2884fc700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc28005b590 con 0x7fc2801380f0 2020-04-02T23:21:41.384 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.370+0000 7fc2884fc700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2800a3280 con 0x7fc2800a7910 2020-04-02T23:21:41.384 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.370+0000 7fc2884fc700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2800a8fb0 con 0x7fc2801351e0 2020-04-02T23:21:41.384 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.370+0000 7fc286298700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc2800a7910 0x7fc280133730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:41.384 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.370+0000 7fc286298700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc2800a7910 0x7fc280133730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:39664/0 (socket says 172.21.15.174:39664) 2020-04-02T23:21:41.384 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.370+0000 7fc286298700 1 -- 172.21.15.174:0/1651909385 learned_addr learned my addr 172.21.15.174:0/1651909385 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:21:41.384 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.370+0000 7fc285a97700 1 --2- 172.21.15.174:0/1651909385 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc2801351e0 0x7fc280133b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:41.384 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.370+0000 7fc286298700 1 -- 172.21.15.174:0/1651909385 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc2801351e0 msgr2=0x7fc280133b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:41.385 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.370+0000 7fc286298700 1 --2- 172.21.15.174:0/1651909385 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc2801351e0 0x7fc280133b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:41.385 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.370+0000 7fc286298700 1 -- 172.21.15.174:0/1651909385 >> v1:172.21.15.174:6789/0 conn(0x7fc2801380f0 legacy=0x7fc280138580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:41.385 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.370+0000 7fc286298700 1 -- 172.21.15.174:0/1651909385 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2801348c0 con 0x7fc2800a7910 2020-04-02T23:21:41.391 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.370+0000 7fc2737fe700 1 -- 172.21.15.174:0/1651909385 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 91146681 0 0) 0x7fc28005b590 con 0x7fc2801380f0 2020-04-02T23:21:41.392 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.370+0000 7fc285a97700 1 --2- 172.21.15.174:0/1651909385 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc2801351e0 0x7fc280133b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-02T23:21:41.392 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.370+0000 7fc286298700 1 --2- 172.21.15.174:0/1651909385 >> v2:172.21.15.174:3300/0 conn(0x7fc2800a7910 0x7fc280133730 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc274002f30 tx=0x7fc2800445b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:41.392 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.370+0000 7fc286298700 1 --2- 172.21.15.174:0/1651909385 >> v2:172.21.15.174:3300/0 conn(0x7fc2800a7910 0x7fc280133730 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc274002f30 tx=0x7fc2800445b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:41.392 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.370+0000 7fc286298700 1 --2- 172.21.15.174:0/1651909385 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2800a7910 0x7fc280133730 secure :-1 s=READY pgs=89 cs=0 l=1 rx=0x7fc274002f30 tx=0x7fc2800445b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:41.392 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.370+0000 7fc286298700 1 --2- 172.21.15.174:0/1651909385 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2800a7910 0x7fc280133730 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7fc274002f30 tx=0x7fc2800445b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:41.392 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.370+0000 7fc286298700 1 --2- 172.21.15.174:0/1651909385 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2800a7910 0x7fc280133730 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7fc274002f30 tx=0x7fc2800445b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:41.393 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.370+0000 7fc2737fe700 1 -- 172.21.15.174:0/1651909385 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc274005e90 con 0x7fc2800a7910 2020-04-02T23:21:41.393 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.370+0000 7fc286298700 1 --2- 172.21.15.174:0/1651909385 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2800a7910 0x7fc280133730 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7fc274002f30 tx=0x7fc2800445b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:41.393 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.370+0000 7fc2737fe700 1 -- 172.21.15.174:0/1651909385 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc274007160 con 0x7fc2800a7910 2020-04-02T23:21:41.393 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.370+0000 7fc2884fc700 1 -- 172.21.15.174:0/1651909385 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2800a3470 con 0x7fc2800a7910 2020-04-02T23:21:41.393 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.370+0000 7fc2737fe700 1 -- 172.21.15.174:0/1651909385 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc274007540 con 0x7fc2800a7910 2020-04-02T23:21:41.393 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.371+0000 7fc2884fc700 1 -- 172.21.15.174:0/1651909385 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc280132be0 con 0x7fc2800a7910 2020-04-02T23:21:41.393 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.372+0000 7fc2884fc700 1 -- 172.21.15.174:0/1651909385 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2800a38d0 con 0x7fc2800a7910 2020-04-02T23:21:41.394 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.372+0000 7fc286298700 1 --2- 172.21.15.174:0/1651909385 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2800a7910 0x7fc280133730 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7fc274002f30 tx=0x7fc2800445b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:41.394 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.372+0000 7fc2737fe700 1 -- 172.21.15.174:0/1651909385 <== mon.0 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fc27400c410 con 0x7fc2800a7910 2020-04-02T23:21:41.394 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.372+0000 7fc286298700 1 --2- 172.21.15.174:0/1651909385 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2800a7910 0x7fc280133730 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7fc274002f30 tx=0x7fc2800445b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:41.394 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.372+0000 7fc2737fe700 1 --2- 172.21.15.174:0/1651909385 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fc26004d430 0x7fc26004f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:41.394 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.373+0000 7fc2737fe700 1 -- 172.21.15.174:0/1651909385 <== mon.0 v2:172.21.15.174:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc274061200 con 0x7fc2800a7910 2020-04-02T23:21:41.394 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.373+0000 7fc285a97700 1 --2- 172.21.15.174:0/1651909385 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fc26004d430 0x7fc26004f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:41.394 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.373+0000 7fc285a97700 1 --2- 172.21.15.174:0/1651909385 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fc26004d430 0x7fc26004f8f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc27c0013e0 tx=0x7fc2801329d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:41.394 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.373+0000 7fc285a97700 1 --2- 172.21.15.174:0/1651909385 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fc26004d430 0x7fc26004f8f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc27c0013e0 tx=0x7fc2801329d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:41.395 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.373+0000 7fc285a97700 1 --2- 172.21.15.174:0/1651909385 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fc26004d430 0x7fc26004f8f0 secure :-1 s=READY pgs=55 cs=0 l=1 rx=0x7fc27c0013e0 tx=0x7fc2801329d0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:41.395 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.375+0000 7fc286298700 1 --2- 172.21.15.174:0/1651909385 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2800a7910 0x7fc280133730 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7fc274002f30 tx=0x7fc2800445b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:41.395 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.375+0000 7fc2737fe700 1 -- 172.21.15.174:0/1651909385 <== mon.0 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fc27403c960 con 0x7fc2800a7910 2020-04-02T23:21:41.561 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:41.558+0000 7fc2884fc700 1 -- 172.21.15.174:0/1651909385 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc280056c50 con 0x7fc2800a7910 2020-04-02T23:21:42.373 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.370+0000 7fc286298700 1 --2- 172.21.15.174:0/1651909385 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2800a7910 0x7fc280133730 secure :-1 s=READY pgs=89 cs=0 l=1 rx=0x7fc274002f30 tx=0x7fc2800445b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:42.542 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.540+0000 7fc286298700 1 --2- 172.21.15.174:0/1651909385 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2800a7910 0x7fc280133730 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7fc274002f30 tx=0x7fc2800445b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:42.543 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.540+0000 7fc2737fe700 1 -- 172.21.15.174:0/1651909385 <== mon.0 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v3) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc27403ff80 con 0x7fc2800a7910 2020-04-02T23:21:42.545 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.542+0000 7fc2884fc700 1 -- 172.21.15.174:0/1651909385 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fc26004d430 msgr2=0x7fc26004f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:42.545 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.542+0000 7fc2884fc700 1 --2- 172.21.15.174:0/1651909385 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fc26004d430 0x7fc26004f8f0 secure :-1 s=READY pgs=55 cs=0 l=1 rx=0x7fc27c0013e0 tx=0x7fc2801329d0).stop 2020-04-02T23:21:42.545 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.542+0000 7fc2884fc700 1 -- 172.21.15.174:0/1651909385 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2800a7910 msgr2=0x7fc280133730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:42.545 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.542+0000 7fc2884fc700 1 --2- 172.21.15.174:0/1651909385 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2800a7910 0x7fc280133730 secure :-1 s=READY pgs=89 cs=0 l=1 rx=0x7fc274002f30 tx=0x7fc2800445b0).stop 2020-04-02T23:21:42.546 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.542+0000 7fc2884fc700 1 -- 172.21.15.174:0/1651909385 shutdown_connections 2020-04-02T23:21:42.546 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.542+0000 7fc2884fc700 1 --2- 172.21.15.174:0/1651909385 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fc26004d430 0x7fc26004f8f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:42.546 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.542+0000 7fc2884fc700 1 --2- 172.21.15.174:0/1651909385 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2800a7910 0x7fc280133730 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:42.546 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.542+0000 7fc2884fc700 1 --2- 172.21.15.174:0/1651909385 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc2801351e0 0x7fc280133b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:42.546 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.542+0000 7fc2884fc700 1 -- 172.21.15.174:0/1651909385 >> 172.21.15.174:0/1651909385 conn(0x7fc2800ab320 msgr2=0x7fc2800add20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:42.546 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.542+0000 7fc2884fc700 1 -- 172.21.15.174:0/1651909385 shutdown_connections 2020-04-02T23:21:42.546 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.542+0000 7fc2884fc700 1 -- 172.21.15.174:0/1651909385 wait complete. 2020-04-02T23:21:42.558 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:42.574 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-02T23:21:42.727 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.725+0000 7f73fd6dc700 1 Processor -- start 2020-04-02T23:21:42.728 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.725+0000 7f73fd6dc700 1 -- start start 2020-04-02T23:21:42.734 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.725+0000 7f73fd6dc700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f73f809e300 0x7f73f80a4b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:42.734 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.725+0000 7f73fd6dc700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f73f80a4f90 0x7f73f8137bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:42.734 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.726+0000 7f73fd6dc700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73f80a42c0 con 0x7f73f805bc10 2020-04-02T23:21:42.734 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.726+0000 7f73fd6dc700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73f80a10a0 con 0x7f73f80a4f90 2020-04-02T23:21:42.734 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.726+0000 7f73fd6dc700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73f80a2a90 con 0x7f73f809e300 2020-04-02T23:21:42.734 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.726+0000 7f73f7fff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f73f809e300 0x7f73f80a4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:42.735 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.726+0000 7f73f77fe700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f73f80a4f90 0x7f73f8137bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:42.735 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.726+0000 7f73f77fe700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f73f80a4f90 0x7f73f8137bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.174:47766/0 (socket says 172.21.15.174:47766) 2020-04-02T23:21:42.735 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.726+0000 7f73f7fff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f73f809e300 0x7f73f80a4b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.174:34260/0 (socket says 172.21.15.174:34260) 2020-04-02T23:21:42.735 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.726+0000 7f73f77fe700 1 -- 172.21.15.174:0/3818737164 learned_addr learned my addr 172.21.15.174:0/3818737164 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:21:42.735 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.726+0000 7f73f7fff700 1 -- 172.21.15.174:0/3818737164 >> v2:172.21.15.196:3300/0 conn(0x7f73f80a4f90 msgr2=0x7f73f8137bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:42.735 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.726+0000 7f73f7fff700 1 --2- 172.21.15.174:0/3818737164 >> v2:172.21.15.196:3300/0 conn(0x7f73f80a4f90 0x7f73f8137bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:42.735 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.726+0000 7f73f7fff700 1 -- 172.21.15.174:0/3818737164 >> v1:172.21.15.196:6789/0 conn(0x7f73f805bc10 legacy=0x7f73f8138030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:42.735 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.726+0000 7f73f6ffd700 1 -- 172.21.15.174:0/3818737164 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3372006618 0 0) 0x7f73f80a42c0 con 0x7f73f805bc10 2020-04-02T23:21:42.736 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.726+0000 7f73f7fff700 1 -- 172.21.15.174:0/3818737164 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73f80a2d30 con 0x7f73f809e300 2020-04-02T23:21:42.736 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.726+0000 7f73f77fe700 1 --2- 172.21.15.174:0/3818737164 >> v2:172.21.15.196:3300/0 conn(0x7f73f80a4f90 0x7f73f8137bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:21:42.736 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.726+0000 7f73f7fff700 1 --2- 172.21.15.174:0/3818737164 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f73f809e300 0x7f73f80a4b30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f73e8002f30 tx=0x7f73e8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:42.736 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.726+0000 7f73f7fff700 1 --2- 172.21.15.174:0/3818737164 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f73f809e300 0x7f73f80a4b30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f73e8002f30 tx=0x7f73e8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:42.736 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.726+0000 7f73f7fff700 1 --2- 172.21.15.174:0/3818737164 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f73f809e300 0x7f73f80a4b30 secure :-1 s=READY pgs=22 cs=0 l=1 rx=0x7f73e8002f30 tx=0x7f73e8007a40).ready entity=mon.2 client_cookie=2eb33782b536866c server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:42.736 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.727+0000 7f73f7fff700 1 --2- 172.21.15.174:0/3818737164 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f73f809e300 0x7f73f80a4b30 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7f73e8002f30 tx=0x7f73e8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:42.736 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.727+0000 7f73f6ffd700 1 -- 172.21.15.174:0/3818737164 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73e80113c0 con 0x7f73f809e300 2020-04-02T23:21:42.737 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.727+0000 7f73f7fff700 1 --2- 172.21.15.174:0/3818737164 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f73f809e300 0x7f73f80a4b30 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7f73e8002f30 tx=0x7f73e8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:42.737 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.727+0000 7f73f7fff700 1 --2- 172.21.15.174:0/3818737164 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f73f809e300 0x7f73f80a4b30 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7f73e8002f30 tx=0x7f73e8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:42.737 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.727+0000 7f73f6ffd700 1 -- 172.21.15.174:0/3818737164 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73e8011520 con 0x7f73f809e300 2020-04-02T23:21:42.737 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.727+0000 7f73f6ffd700 1 -- 172.21.15.174:0/3818737164 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73e8011900 con 0x7f73f809e300 2020-04-02T23:21:42.737 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.727+0000 7f73fd6dc700 1 -- 172.21.15.174:0/3818737164 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f73f809e300 msgr2=0x7f73f80a4b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:42.737 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.727+0000 7f73fd6dc700 1 --2- 172.21.15.174:0/3818737164 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f73f809e300 0x7f73f80a4b30 secure :-1 s=READY pgs=22 cs=0 l=1 rx=0x7f73e8002f30 tx=0x7f73e8007a40).stop 2020-04-02T23:21:42.737 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.727+0000 7f73fd6dc700 1 -- 172.21.15.174:0/3818737164 shutdown_connections 2020-04-02T23:21:42.738 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.727+0000 7f73fd6dc700 1 --2- 172.21.15.174:0/3818737164 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f73f809e300 0x7f73f80a4b30 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:42.738 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.727+0000 7f73fd6dc700 1 --2- 172.21.15.174:0/3818737164 >> v2:172.21.15.196:3300/0 conn(0x7f73f80a4f90 0x7f73f8137bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:42.738 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.727+0000 7f73fd6dc700 1 -- 172.21.15.174:0/3818737164 >> 172.21.15.174:0/3818737164 conn(0x7f73f80a6d00 msgr2=0x7f73f80a7110 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:42.738 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.727+0000 7f73fd6dc700 1 -- 172.21.15.174:0/3818737164 shutdown_connections 2020-04-02T23:21:42.738 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.727+0000 7f73fd6dc700 1 -- 172.21.15.174:0/3818737164 wait complete. 2020-04-02T23:21:42.738 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.728+0000 7f73fd6dc700 1 Processor -- start 2020-04-02T23:21:42.739 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.728+0000 7f73fd6dc700 1 -- start start 2020-04-02T23:21:42.739 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.729+0000 7f73fd6dc700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f73f805bc10 0x7f73f8065040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:42.739 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.729+0000 7f73fd6dc700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f73f809e300 0x7f73f80633d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:42.739 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.729+0000 7f73fd6dc700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f73f8061f00 0x7f73f80623b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:42.739 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.729+0000 7f73fd6dc700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73f8143240 con 0x7f73f805bc10 2020-04-02T23:21:42.740 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.729+0000 7f73fd6dc700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73f80654a0 con 0x7f73f809e300 2020-04-02T23:21:42.740 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.729+0000 7f73fd6dc700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73f80a0cb0 con 0x7f73f8061f00 2020-04-02T23:21:42.740 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.729+0000 7f73f7fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f73f805bc10 0x7f73f8065040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:42.740 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.729+0000 7f73f7fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f73f805bc10 0x7f73f8065040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:39678/0 (socket says 172.21.15.174:39678) 2020-04-02T23:21:42.740 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.729+0000 7f73f7fff700 1 -- 172.21.15.174:0/2346517342 learned_addr learned my addr 172.21.15.174:0/2346517342 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:21:42.741 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.729+0000 7f73fcedb700 1 --2- 172.21.15.174:0/2346517342 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f73f8061f00 0x7f73f80623b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:42.741 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.729+0000 7f73f77fe700 1 --2- 172.21.15.174:0/2346517342 >> v2:172.21.15.196:3300/0 conn(0x7f73f809e300 0x7f73f80633d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:42.741 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.729+0000 7f73f7fff700 1 -- 172.21.15.174:0/2346517342 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f73f8061f00 msgr2=0x7f73f80623b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:42.741 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.729+0000 7f73f7fff700 1 --2- 172.21.15.174:0/2346517342 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f73f8061f00 0x7f73f80623b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:42.741 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.729+0000 7f73f7fff700 1 -- 172.21.15.174:0/2346517342 >> v2:172.21.15.196:3300/0 conn(0x7f73f809e300 msgr2=0x7f73f80633d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:42.741 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.729+0000 7f73f7fff700 1 --2- 172.21.15.174:0/2346517342 >> v2:172.21.15.196:3300/0 conn(0x7f73f809e300 0x7f73f80633d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:42.741 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.729+0000 7f73f7fff700 1 -- 172.21.15.174:0/2346517342 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73f81343a0 con 0x7f73f805bc10 2020-04-02T23:21:42.742 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.729+0000 7f73f7fff700 1 --2- 172.21.15.174:0/2346517342 >> v2:172.21.15.174:3300/0 conn(0x7f73f805bc10 0x7f73f8065040 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f73e8002f30 tx=0x7f73e8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:42.742 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.729+0000 7f73f7fff700 1 --2- 172.21.15.174:0/2346517342 >> v2:172.21.15.174:3300/0 conn(0x7f73f805bc10 0x7f73f8065040 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f73e8002f30 tx=0x7f73e8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:42.742 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.729+0000 7f73f7fff700 1 --2- 172.21.15.174:0/2346517342 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f73f805bc10 0x7f73f8065040 secure :-1 s=READY pgs=90 cs=0 l=1 rx=0x7f73e8002f30 tx=0x7f73e8007a40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:42.742 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.729+0000 7f73f7fff700 1 --2- 172.21.15.174:0/2346517342 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f73f805bc10 0x7f73f8065040 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f73e8002f30 tx=0x7f73e8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:42.742 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.730+0000 7f73f57fa700 1 -- 172.21.15.174:0/2346517342 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73e80117c0 con 0x7f73f805bc10 2020-04-02T23:21:42.742 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.730+0000 7f73f7fff700 1 --2- 172.21.15.174:0/2346517342 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f73f805bc10 0x7f73f8065040 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f73e8002f30 tx=0x7f73e8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:42.743 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.730+0000 7f73f7fff700 1 --2- 172.21.15.174:0/2346517342 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f73f805bc10 0x7f73f8065040 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f73e8002f30 tx=0x7f73e8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:42.743 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.730+0000 7f73f57fa700 1 -- 172.21.15.174:0/2346517342 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73e8011920 con 0x7f73f805bc10 2020-04-02T23:21:42.743 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.730+0000 7f73f57fa700 1 -- 172.21.15.174:0/2346517342 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73e8007340 con 0x7f73f805bc10 2020-04-02T23:21:42.743 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.730+0000 7f73fd6dc700 1 -- 172.21.15.174:0/2346517342 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73f8134640 con 0x7f73f805bc10 2020-04-02T23:21:42.743 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.730+0000 7f73fd6dc700 1 -- 172.21.15.174:0/2346517342 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73f8063830 con 0x7f73f805bc10 2020-04-02T23:21:42.743 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.730+0000 7f73f7fff700 1 --2- 172.21.15.174:0/2346517342 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f73f805bc10 0x7f73f8065040 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f73e8002f30 tx=0x7f73e8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:42.743 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.731+0000 7f73fd6dc700 1 -- 172.21.15.174:0/2346517342 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73f8134aa0 con 0x7f73f805bc10 2020-04-02T23:21:42.744 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.731+0000 7f73f57fa700 1 -- 172.21.15.174:0/2346517342 <== mon.0 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f73e80056c0 con 0x7f73f805bc10 2020-04-02T23:21:42.744 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.731+0000 7f73f7fff700 1 --2- 172.21.15.174:0/2346517342 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f73f805bc10 0x7f73f8065040 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f73e8002f30 tx=0x7f73e8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:42.744 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.731+0000 7f73f57fa700 1 --2- 172.21.15.174:0/2346517342 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f73d804d600 0x7f73d804fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:42.744 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.731+0000 7f73f57fa700 1 -- 172.21.15.174:0/2346517342 <== mon.0 v2:172.21.15.174:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f73e80613b0 con 0x7f73f805bc10 2020-04-02T23:21:42.744 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.731+0000 7f73f77fe700 1 --2- 172.21.15.174:0/2346517342 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f73d804d600 0x7f73d804fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:42.744 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.731+0000 7f73f77fe700 1 --2- 172.21.15.174:0/2346517342 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f73d804d600 0x7f73d804fac0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f73ec002f30 tx=0x7f73ec00f530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:42.744 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.731+0000 7f73f77fe700 1 --2- 172.21.15.174:0/2346517342 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f73d804d600 0x7f73d804fac0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f73ec002f30 tx=0x7f73ec00f530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:42.745 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.731+0000 7f73f77fe700 1 --2- 172.21.15.174:0/2346517342 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f73d804d600 0x7f73d804fac0 secure :-1 s=READY pgs=56 cs=0 l=1 rx=0x7f73ec002f30 tx=0x7f73ec00f530).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:42.745 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.734+0000 7f73f7fff700 1 --2- 172.21.15.174:0/2346517342 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f73f805bc10 0x7f73f8065040 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f73e8002f30 tx=0x7f73e8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:42.745 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.734+0000 7f73f57fa700 1 -- 172.21.15.174:0/2346517342 <== mon.0 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f73e803cb70 con 0x7f73f805bc10 2020-04-02T23:21:42.917 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.914+0000 7f73fd6dc700 1 -- 172.21.15.174:0/2346517342 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f73f8056c50 con 0x7f73f805bc10 2020-04-02T23:21:42.917 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.915+0000 7f73f7fff700 1 --2- 172.21.15.174:0/2346517342 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f73f805bc10 0x7f73f8065040 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f73e8002f30 tx=0x7f73e8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:42.918 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.915+0000 7f73f57fa700 1 -- 172.21.15.174:0/2346517342 <== mon.0 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+1420 (secure 0 0 0) 0x7f73e8040190 con 0x7f73f805bc10 2020-04-02T23:21:42.918 INFO:teuthology.orchestra.run.smithi174.stdout: 2020-04-02T23:21:42.918 INFO:teuthology.orchestra.run.smithi174.stdout:{"epoch":3,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":3,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-02T23:21:40.534377+0000","modified":"2020-04-02T23:21:42.536824+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-04-02T23:21:42.919 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.916+0000 7f73fd6dc700 1 -- 172.21.15.174:0/2346517342 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f73d804d600 msgr2=0x7f73d804fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:42.919 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.916+0000 7f73fd6dc700 1 --2- 172.21.15.174:0/2346517342 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f73d804d600 0x7f73d804fac0 secure :-1 s=READY pgs=56 cs=0 l=1 rx=0x7f73ec002f30 tx=0x7f73ec00f530).stop 2020-04-02T23:21:42.919 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.916+0000 7f73fd6dc700 1 -- 172.21.15.174:0/2346517342 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f73f805bc10 msgr2=0x7f73f8065040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:42.920 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.916+0000 7f73fd6dc700 1 --2- 172.21.15.174:0/2346517342 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f73f805bc10 0x7f73f8065040 secure :-1 s=READY pgs=90 cs=0 l=1 rx=0x7f73e8002f30 tx=0x7f73e8007a40).stop 2020-04-02T23:21:42.920 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.916+0000 7f73fd6dc700 1 -- 172.21.15.174:0/2346517342 shutdown_connections 2020-04-02T23:21:42.920 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.916+0000 7f73fd6dc700 1 --2- 172.21.15.174:0/2346517342 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f73d804d600 0x7f73d804fac0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:42.920 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.916+0000 7f73fd6dc700 1 --2- 172.21.15.174:0/2346517342 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f73f8061f00 0x7f73f80623b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:42.920 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.916+0000 7f73fd6dc700 1 --2- 172.21.15.174:0/2346517342 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f73f805bc10 0x7f73f8065040 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:42.920 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.916+0000 7f73fd6dc700 1 --2- 172.21.15.174:0/2346517342 >> v2:172.21.15.196:3300/0 conn(0x7f73f809e300 0x7f73f80633d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:42.920 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.916+0000 7f73fd6dc700 1 -- 172.21.15.174:0/2346517342 >> 172.21.15.174:0/2346517342 conn(0x7f73f80a6d00 msgr2=0x7f73f80a5380 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:42.921 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.916+0000 7f73fd6dc700 1 -- 172.21.15.174:0/2346517342 shutdown_connections 2020-04-02T23:21:42.921 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:42.916+0000 7f73fd6dc700 1 -- 172.21.15.174:0/2346517342 wait complete. 2020-04-02T23:21:42.921 INFO:teuthology.orchestra.run.smithi174.stderr:dumped fsmap epoch 3 2020-04-02T23:21:42.929 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:42.942 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-02T23:21:43.087 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.085+0000 7f2865994700 1 Processor -- start 2020-04-02T23:21:43.087 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.085+0000 7f2865994700 1 -- start start 2020-04-02T23:21:43.090 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.085+0000 7f2865994700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f286005bf90 0x7f286009e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:43.090 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.085+0000 7f2865994700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f286009ec70 0x7f2860138aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:43.090 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.085+0000 7f2865994700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28600a2a70 con 0x7f2860138f00 2020-04-02T23:21:43.090 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.085+0000 7f2865994700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f286009e140 con 0x7f286009ec70 2020-04-02T23:21:43.091 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.085+0000 7f2865994700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f286009e3e0 con 0x7f286005bf90 2020-04-02T23:21:43.091 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.085+0000 7f285ffff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f286009ec70 0x7f2860138aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:43.091 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.085+0000 7f285ffff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f286009ec70 0x7f2860138aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:39688/0 (socket says 172.21.15.174:39688) 2020-04-02T23:21:43.091 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.085+0000 7f285ffff700 1 -- 172.21.15.174:0/3305256735 learned_addr learned my addr 172.21.15.174:0/3305256735 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:21:43.091 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.086+0000 7f2864992700 1 --2- 172.21.15.174:0/3305256735 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f286005bf90 0x7f286009e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:43.091 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.086+0000 7f285ffff700 1 -- 172.21.15.174:0/3305256735 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f286005bf90 msgr2=0x7f286009e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:43.092 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.086+0000 7f285ffff700 1 --2- 172.21.15.174:0/3305256735 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f286005bf90 0x7f286009e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:43.092 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.086+0000 7f285ffff700 1 -- 172.21.15.174:0/3305256735 >> v1:172.21.15.196:6789/0 conn(0x7f2860138f00 legacy=0x7f2860139340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:43.092 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.086+0000 7f285ffff700 1 -- 172.21.15.174:0/3305256735 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28600a65b0 con 0x7f286009ec70 2020-04-02T23:21:43.092 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.086+0000 7f285ffff700 1 --2- 172.21.15.174:0/3305256735 >> v2:172.21.15.174:3300/0 conn(0x7f286009ec70 0x7f2860138aa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f286005f350 tx=0x7f2848007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:43.093 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.086+0000 7f285ffff700 1 --2- 172.21.15.174:0/3305256735 >> v2:172.21.15.174:3300/0 conn(0x7f286009ec70 0x7f2860138aa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f286005f350 tx=0x7f2848007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:43.093 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.086+0000 7f285ffff700 1 --2- 172.21.15.174:0/3305256735 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f286009ec70 0x7f2860138aa0 secure :-1 s=READY pgs=91 cs=0 l=1 rx=0x7f286005f350 tx=0x7f2848007a40).ready entity=mon.0 client_cookie=dff29bb361d15297 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:43.093 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.086+0000 7f285ffff700 1 --2- 172.21.15.174:0/3305256735 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f286009ec70 0x7f2860138aa0 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7f286005f350 tx=0x7f2848007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:43.093 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.086+0000 7f285f7fe700 1 -- 172.21.15.174:0/3305256735 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28480116e0 con 0x7f286009ec70 2020-04-02T23:21:43.093 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.086+0000 7f285ffff700 1 --2- 172.21.15.174:0/3305256735 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f286009ec70 0x7f2860138aa0 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7f286005f350 tx=0x7f2848007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:43.094 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.086+0000 7f285ffff700 1 --2- 172.21.15.174:0/3305256735 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f286009ec70 0x7f2860138aa0 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7f286005f350 tx=0x7f2848007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:43.094 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.086+0000 7f285f7fe700 1 -- 172.21.15.174:0/3305256735 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2848011840 con 0x7f286009ec70 2020-04-02T23:21:43.094 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.086+0000 7f285f7fe700 1 -- 172.21.15.174:0/3305256735 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2848011c60 con 0x7f286009ec70 2020-04-02T23:21:43.094 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.086+0000 7f2865994700 1 -- 172.21.15.174:0/3305256735 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f286009ec70 msgr2=0x7f2860138aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:43.094 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.086+0000 7f2865994700 1 --2- 172.21.15.174:0/3305256735 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f286009ec70 0x7f2860138aa0 secure :-1 s=READY pgs=91 cs=0 l=1 rx=0x7f286005f350 tx=0x7f2848007a40).stop 2020-04-02T23:21:43.094 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.086+0000 7f2865994700 1 -- 172.21.15.174:0/3305256735 shutdown_connections 2020-04-02T23:21:43.094 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.086+0000 7f2865994700 1 --2- 172.21.15.174:0/3305256735 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f286005bf90 0x7f286009e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:43.094 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.086+0000 7f2865994700 1 --2- 172.21.15.174:0/3305256735 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f286009ec70 0x7f2860138aa0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:43.095 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.086+0000 7f2865994700 1 -- 172.21.15.174:0/3305256735 >> 172.21.15.174:0/3305256735 conn(0x7f28600a6d00 msgr2=0x7f28600a7110 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:43.095 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.087+0000 7f2865994700 1 -- 172.21.15.174:0/3305256735 shutdown_connections 2020-04-02T23:21:43.095 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.087+0000 7f2865994700 1 -- 172.21.15.174:0/3305256735 wait complete. 2020-04-02T23:21:43.095 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.087+0000 7f2865994700 1 Processor -- start 2020-04-02T23:21:43.095 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.087+0000 7f2865994700 1 -- start start 2020-04-02T23:21:43.098 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.088+0000 7f2865994700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2860138f00 0x7f2860064e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:43.099 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.088+0000 7f2865994700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2860065440 con 0x7f286005bf90 2020-04-02T23:21:43.099 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.088+0000 7f2865994700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28600656e0 con 0x7f286009ec70 2020-04-02T23:21:43.099 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.088+0000 7f2865994700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28600643f0 con 0x7f2860138f00 2020-04-02T23:21:43.099 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.088+0000 7f2864992700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f286005bf90 0x7f286009b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:44730/0 (socket says 172.21.15.174:44730) 2020-04-02T23:21:43.099 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.088+0000 7f2864992700 1 -- 172.21.15.174:0/1976034119 learned_addr learned my addr 172.21.15.174:0/1976034119 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:21:43.099 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.088+0000 7f2865193700 1 --2- 172.21.15.174:0/1976034119 >> v2:172.21.15.174:3300/0 conn(0x7f2860138f00 0x7f2860064e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:43.099 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.088+0000 7f285dffb700 1 -- 172.21.15.174:0/1976034119 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2578819190 0 0) 0x7f2860065440 con 0x7f286005bf90 2020-04-02T23:21:43.100 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.088+0000 7f285dffb700 1 -- 172.21.15.174:0/1976034119 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2844002fe0 con 0x7f286005bf90 2020-04-02T23:21:43.100 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.089+0000 7f2865193700 1 -- 172.21.15.174:0/1976034119 >> v1:172.21.15.196:6789/0 conn(0x7f286009ec70 legacy=0x7f2860063b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:43.100 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.089+0000 7f2865193700 1 -- 172.21.15.174:0/1976034119 >> v1:172.21.15.174:6789/0 conn(0x7f286005bf90 legacy=0x7f286009b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:43.100 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.089+0000 7f2865193700 1 -- 172.21.15.174:0/1976034119 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2860065980 con 0x7f2860138f00 2020-04-02T23:21:43.100 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.089+0000 7f2865193700 1 --2- 172.21.15.174:0/1976034119 >> v2:172.21.15.174:3300/0 conn(0x7f2860138f00 0x7f2860064e80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f28580022d0 tx=0x7f2858010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:43.100 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.089+0000 7f2865193700 1 --2- 172.21.15.174:0/1976034119 >> v2:172.21.15.174:3300/0 conn(0x7f2860138f00 0x7f2860064e80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f28580022d0 tx=0x7f2858010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:43.100 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.089+0000 7f2865193700 1 --2- 172.21.15.174:0/1976034119 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2860138f00 0x7f2860064e80 secure :-1 s=READY pgs=93 cs=0 l=1 rx=0x7f28580022d0 tx=0x7f2858010b50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:43.101 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.089+0000 7f2865193700 1 --2- 172.21.15.174:0/1976034119 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2860138f00 0x7f2860064e80 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f28580022d0 tx=0x7f2858010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:43.101 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.089+0000 7f2865193700 1 --2- 172.21.15.174:0/1976034119 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2860138f00 0x7f2860064e80 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f28580022d0 tx=0x7f2858010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:43.101 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.089+0000 7f285dffb700 1 -- 172.21.15.174:0/1976034119 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28580121f0 con 0x7f2860138f00 2020-04-02T23:21:43.101 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.089+0000 7f2865193700 1 --2- 172.21.15.174:0/1976034119 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2860138f00 0x7f2860064e80 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f28580022d0 tx=0x7f2858010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:43.101 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.089+0000 7f285dffb700 1 -- 172.21.15.174:0/1976034119 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2858012390 con 0x7f2860138f00 2020-04-02T23:21:43.101 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.089+0000 7f2865994700 1 -- 172.21.15.174:0/1976034119 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f286009e830 con 0x7f2860138f00 2020-04-02T23:21:43.101 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.089+0000 7f285dffb700 1 -- 172.21.15.174:0/1976034119 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2858012770 con 0x7f2860138f00 2020-04-02T23:21:43.102 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.089+0000 7f2865994700 1 -- 172.21.15.174:0/1976034119 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2860066300 con 0x7f2860138f00 2020-04-02T23:21:43.102 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.090+0000 7f2865193700 1 --2- 172.21.15.174:0/1976034119 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2860138f00 0x7f2860064e80 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f28580022d0 tx=0x7f2858010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:43.103 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.090+0000 7f2865994700 1 -- 172.21.15.174:0/1976034119 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28600665e0 con 0x7f2860138f00 2020-04-02T23:21:43.103 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.090+0000 7f285dffb700 1 -- 172.21.15.174:0/1976034119 <== mon.0 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f28580128d0 con 0x7f2860138f00 2020-04-02T23:21:43.103 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.090+0000 7f2865193700 1 --2- 172.21.15.174:0/1976034119 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2860138f00 0x7f2860064e80 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f28580022d0 tx=0x7f2858010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:43.103 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.090+0000 7f285dffb700 1 --2- 172.21.15.174:0/1976034119 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f284404d8d0 0x7f284404fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:43.103 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.090+0000 7f285dffb700 1 -- 172.21.15.174:0/1976034119 <== mon.0 v2:172.21.15.174:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2858061470 con 0x7f2860138f00 2020-04-02T23:21:43.103 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.090+0000 7f2864992700 1 --2- 172.21.15.174:0/1976034119 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f284404d8d0 0x7f284404fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:43.103 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.091+0000 7f2864992700 1 --2- 172.21.15.174:0/1976034119 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f284404d8d0 0x7f284404fd90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2850002f30 tx=0x7f2850002340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:43.104 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.091+0000 7f2864992700 1 --2- 172.21.15.174:0/1976034119 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f284404d8d0 0x7f284404fd90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2850002f30 tx=0x7f2850002340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:43.104 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.091+0000 7f2864992700 1 --2- 172.21.15.174:0/1976034119 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f284404d8d0 0x7f284404fd90 secure :-1 s=READY pgs=57 cs=0 l=1 rx=0x7f2850002f30 tx=0x7f2850002340).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:43.104 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.093+0000 7f2865193700 1 --2- 172.21.15.174:0/1976034119 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2860138f00 0x7f2860064e80 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f28580022d0 tx=0x7f2858010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:43.104 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.093+0000 7f285dffb700 1 -- 172.21.15.174:0/1976034119 <== mon.0 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f285803cc30 con 0x7f2860138f00 2020-04-02T23:21:43.237 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.234+0000 7f2865994700 1 -- 172.21.15.174:0/1976034119 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2860065b10 con 0x7f2860138f00 2020-04-02T23:21:43.238 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.235+0000 7f2865193700 1 --2- 172.21.15.174:0/1976034119 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2860138f00 0x7f2860064e80 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f28580022d0 tx=0x7f2858010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:43.238 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.235+0000 7f285dffb700 1 -- 172.21.15.174:0/1976034119 <== mon.0 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16134 (secure 0 0 0) 0x7f2858040250 con 0x7f2860138f00 2020-04-02T23:21:43.239 INFO:teuthology.orchestra.run.smithi174.stdout: 2020-04-02T23:21:43.239 INFO:teuthology.orchestra.run.smithi174.stdout:{"epoch":23,"fsid":"06504ece-4284-40ba-b298-58864abc4224","created":"2020-04-02T23:21:19.153932+0000","modified":"2020-04-02T23:21:41.535533+0000","last_up_change":"2020-04-02T23:21:29.337390+0000","last_in_change":"2020-04-02T23:21:29.337390+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-02T23:21:22.199702+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-02T23:21:35.314601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-04-02T23:21:38.762876+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-04-02T23:21:39.474986+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c9d748ee-c52f-4f21-b8c9-2a53a937be1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":24590},{"type":"v1","addr":"172.21.15.174:6801","nonce":24590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":24590},{"type":"v1","addr":"172.21.15.174:6803","nonce":24590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":24590},{"type":"v1","addr":"172.21.15.174:6807","nonce":24590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":24590},{"type":"v1","addr":"172.21.15.174:6805","nonce":24590}]},"public_addr":"172.21.15.174:6801/24590","cluster_addr":"172.21.15.174:6803/24590","heartbeat_back_addr":"172.21.15.174:6807/24590","heartbeat_front_addr":"172.21.15.174:6805/24590","state":["exists","up"]},{"osd":1,"uuid":"27c05faf-11f5-4cef-9bde-1a6653a9e533","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":24754},{"type":"v1","addr":"172.21.15.174:6809","nonce":24754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":24754},{"type":"v1","addr":"172.21.15.174:6811","nonce":24754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":24754},{"type":"v1","addr":"172.21.15.174:6815","nonce":24754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":24754},{"type":"v1","addr":"172.21.15.174:6813","nonce":24754}]},"public_addr":"172.21.15.174:6809/24754","cluster_addr":"172.21.15.174:6811/24754","heartbeat_back_addr":"172.21.15.174:6815/24754","heartbeat_front_addr":"172.21.15.174:6813/24754","state":["exists","up"]},{"osd":2,"uuid":"02b1b455-b518-4393-b257-40c3a76af157","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":24781},{"type":"v1","addr":"172.21.15.174:6817","nonce":24781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":24781},{"type":"v1","addr":"172.21.15.174:6819","nonce":24781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":24781},{"type":"v1","addr":"172.21.15.174:6823","nonce":24781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":24781},{"type":"v1","addr":"172.21.15.174:6821","nonce":24781}]},"public_addr":"172.21.15.174:6817/24781","cluster_addr":"172.21.15.174:6819/24781","heartbeat_back_addr":"172.21.15.174:6823/24781","heartbeat_front_addr":"172.21.15.174:6821/24781","state":["exists","up"]},{"osd":3,"uuid":"d7fb3499-9e13-4076-b3cf-28f27eb62967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":24972},{"type":"v1","addr":"172.21.15.174:6825","nonce":24972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":24972},{"type":"v1","addr":"172.21.15.174:6827","nonce":24972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":24972},{"type":"v1","addr":"172.21.15.174:6831","nonce":24972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":24972},{"type":"v1","addr":"172.21.15.174:6829","nonce":24972}]},"public_addr":"172.21.15.174:6825/24972","cluster_addr":"172.21.15.174:6827/24972","heartbeat_back_addr":"172.21.15.174:6831/24972","heartbeat_front_addr":"172.21.15.174:6829/24972","state":["exists","up"]},{"osd":4,"uuid":"16923c47-2f21-43ea-9647-5ead4b1b2101","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":24034},{"type":"v1","addr":"172.21.15.196:6803","nonce":24034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":24034},{"type":"v1","addr":"172.21.15.196:6805","nonce":24034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":24034},{"type":"v1","addr":"172.21.15.196:6809","nonce":24034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":24034},{"type":"v1","addr":"172.21.15.196:6807","nonce":24034}]},"public_addr":"172.21.15.196:6803/24034","cluster_addr":"172.21.15.196:6805/24034","heartbeat_back_addr":"172.21.15.196:6809/24034","heartbeat_front_addr":"172.21.15.196:6807/24034","state":["exists","up"]},{"osd":5,"uuid":"7cf2859b-2226-4908-8d70-6e699d1acb0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":24190},{"type":"v1","addr":"172.21.15.196:6811","nonce":24190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":24190},{"type":"v1","addr":"172.21.15.196:6813","nonce":24190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":24190},{"type":"v1","addr":"172.21.15.196:6817","nonce":24190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":24190},{"type":"v1","addr":"172.21.15.196:6815","nonce":24190}]},"public_addr":"172.21.15.196:6811/24190","cluster_addr":"172.21.15.196:6813/24190","heartbeat_back_addr":"172.21.15.196:6817/24190","heartbeat_front_addr":"172.21.15.196:6815/24190","state":["exists","up"]},{"osd":6,"uuid":"441081ef-133a-41ec-8041-094e129707e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":24212},{"type":"v1","addr":"172.21.15.196:6819","nonce":24212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":24212},{"type":"v1","addr":"172.21.15.196:6821","nonce":24212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":24212},{"type":"v1","addr":"172.21.15.196:6825","nonce":24212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":24212},{"type":"v1","addr":"172.21.15.196:6823","nonce":24212}]},"public_addr":"172.21.15.196:6819/24212","cluster_addr":"172.21.15.196:6821/24212","heartbeat_back_addr":"172.21.15.196:6825/24212","heartbeat_front_addr":"172.21.15.196:6823/24212","state":["exists","up"]},{"osd":7,"uuid":"17ee8d46-46bf-4ef0-8d02-82cbc4ef5a5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":24408},{"type":"v1","addr":"172.21.15.196:6827","nonce":24408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":24408},{"type":"v1","addr":"172.21.15.196:6829","nonce":24408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":24408},{"type":"v1","addr":"172.21.15.196:6833","nonce":24408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":24408},{"type":"v1","addr":"172.21.15.196:6831","nonce":24408}]},"public_addr":"172.21.15.196:6827/24408","cluster_addr":"172.21.15.196:6829/24408","heartbeat_back_addr":"172.21.15.196:6833/24408","heartbeat_front_addr":"172.21.15.196:6831/24408","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.725574+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.732598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.775890+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.854998+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.545334+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.591623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.627501+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.614807+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-02T23:21:43.240 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.236+0000 7f2865994700 1 -- 172.21.15.174:0/1976034119 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f284404d8d0 msgr2=0x7f284404fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:43.240 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.236+0000 7f2865994700 1 --2- 172.21.15.174:0/1976034119 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f284404d8d0 0x7f284404fd90 secure :-1 s=READY pgs=57 cs=0 l=1 rx=0x7f2850002f30 tx=0x7f2850002340).stop 2020-04-02T23:21:43.240 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.236+0000 7f2865994700 1 -- 172.21.15.174:0/1976034119 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2860138f00 msgr2=0x7f2860064e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:43.240 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.236+0000 7f2865994700 1 --2- 172.21.15.174:0/1976034119 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2860138f00 0x7f2860064e80 secure :-1 s=READY pgs=93 cs=0 l=1 rx=0x7f28580022d0 tx=0x7f2858010b50).stop 2020-04-02T23:21:43.241 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.236+0000 7f2865994700 1 -- 172.21.15.174:0/1976034119 shutdown_connections 2020-04-02T23:21:43.241 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.236+0000 7f2865994700 1 --2- 172.21.15.174:0/1976034119 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2860138f00 0x7f2860064e80 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:43.241 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.236+0000 7f2865994700 1 --2- 172.21.15.174:0/1976034119 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f284404d8d0 0x7f284404fd90 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:43.241 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.236+0000 7f2865994700 1 -- 172.21.15.174:0/1976034119 >> 172.21.15.174:0/1976034119 conn(0x7f28600a6d00 msgr2=0x7f28600695c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:43.241 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.237+0000 7f2865994700 1 -- 172.21.15.174:0/1976034119 shutdown_connections 2020-04-02T23:21:43.241 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.237+0000 7f2865994700 1 -- 172.21.15.174:0/1976034119 wait complete. 2020-04-02T23:21:43.250 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2020-04-02T23:21:43.250 INFO:tasks.ceph.mds.b:Restarting daemon 2020-04-02T23:21:43.250 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:43.267 INFO:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2020-04-02T23:21:43.310 INFO:tasks.ceph.mds.b:Started 2020-04-02T23:21:43.310 INFO:tasks.ceph.mds.a:Restarting daemon 2020-04-02T23:21:43.310 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:43.324 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2020-04-02T23:21:43.367 INFO:tasks.ceph.mds.a:Started 2020-04-02T23:21:43.368 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:43.368 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2020-04-02T23:21:43.382 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-02T23:21:43.393 INFO:tasks.ceph.mds.b.smithi196.stdout:starting mds.b at 2020-04-02T23:21:43.444 INFO:tasks.ceph.mds.a.smithi174.stdout:starting mds.a at 2020-04-02T23:21:43.538 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.528+0000 7f3c623b0700 1 Processor -- start 2020-04-02T23:21:43.538 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.528+0000 7f3c623b0700 1 -- start start 2020-04-02T23:21:43.539 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.528+0000 7f3c623b0700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f3c5c0a7a60 0x7f3c5c0a38f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:43.539 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.528+0000 7f3c623b0700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3c5c0a1fe0 0x7f3c5c138480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:43.539 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.528+0000 7f3c623b0700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c5c0a40d0 con 0x7f3c5c1388e0 2020-04-02T23:21:43.539 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.528+0000 7f3c623b0700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c5c0a3ec0 con 0x7f3c5c0a1fe0 2020-04-02T23:21:43.539 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.528+0000 7f3c623b0700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c5c0a4370 con 0x7f3c5c0a7a60 2020-04-02T23:21:43.539 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.529+0000 7f3c5b7fe700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3c5c0a1fe0 0x7f3c5c138480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:43.539 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.529+0000 7f3c6094d700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f3c5c1388e0 0x7f3c5c12e590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:44750/0 (socket says 172.21.15.174:44750) 2020-04-02T23:21:43.540 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.529+0000 7f3c5b7fe700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3c5c0a1fe0 0x7f3c5c138480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:39712/0 (socket says 172.21.15.174:39712) 2020-04-02T23:21:43.540 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.529+0000 7f3c6094d700 1 -- 172.21.15.174:0/1762757739 learned_addr learned my addr 172.21.15.174:0/1762757739 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:21:43.540 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.529+0000 7f3c5bfff700 1 --2- 172.21.15.174:0/1762757739 >> v2:172.21.15.196:3300/0 conn(0x7f3c5c0a7a60 0x7f3c5c0a38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:43.540 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.529+0000 7f3c5b7fe700 1 -- 172.21.15.174:0/1762757739 >> v2:172.21.15.196:3300/0 conn(0x7f3c5c0a7a60 msgr2=0x7f3c5c0a38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:43.540 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.529+0000 7f3c5b7fe700 1 --2- 172.21.15.174:0/1762757739 >> v2:172.21.15.196:3300/0 conn(0x7f3c5c0a7a60 0x7f3c5c0a38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:43.540 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.529+0000 7f3c5b7fe700 1 -- 172.21.15.174:0/1762757739 >> v1:172.21.15.174:6789/0 conn(0x7f3c5c1388e0 legacy=0x7f3c5c12e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:43.540 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.529+0000 7f3c5b7fe700 1 -- 172.21.15.174:0/1762757739 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c5c138d20 con 0x7f3c5c0a1fe0 2020-04-02T23:21:43.540 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.529+0000 7f3c5affd700 1 -- 172.21.15.174:0/1762757739 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 84212952 0 0) 0x7f3c5c0a40d0 con 0x7f3c5c1388e0 2020-04-02T23:21:43.541 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.529+0000 7f3c5b7fe700 1 --2- 172.21.15.174:0/1762757739 >> v2:172.21.15.174:3300/0 conn(0x7f3c5c0a1fe0 0x7f3c5c138480 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3c50002f30 tx=0x7f3c50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:43.545 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.529+0000 7f3c5b7fe700 1 --2- 172.21.15.174:0/1762757739 >> v2:172.21.15.174:3300/0 conn(0x7f3c5c0a1fe0 0x7f3c5c138480 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3c50002f30 tx=0x7f3c50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:43.545 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.529+0000 7f3c5b7fe700 1 --2- 172.21.15.174:0/1762757739 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3c5c0a1fe0 0x7f3c5c138480 secure :-1 s=READY pgs=97 cs=0 l=1 rx=0x7f3c50002f30 tx=0x7f3c50007a40).ready entity=mon.0 client_cookie=4d19bbe8f499e209 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:43.545 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.529+0000 7f3c5b7fe700 1 --2- 172.21.15.174:0/1762757739 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3c5c0a1fe0 0x7f3c5c138480 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7f3c50002f30 tx=0x7f3c50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:43.545 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.529+0000 7f3c5affd700 1 -- 172.21.15.174:0/1762757739 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c5000ae80 con 0x7f3c5c0a1fe0 2020-04-02T23:21:43.545 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.529+0000 7f3c5b7fe700 1 --2- 172.21.15.174:0/1762757739 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3c5c0a1fe0 0x7f3c5c138480 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7f3c50002f30 tx=0x7f3c50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:43.547 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.529+0000 7f3c5affd700 1 -- 172.21.15.174:0/1762757739 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c500139b0 con 0x7f3c5c0a1fe0 2020-04-02T23:21:43.548 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.529+0000 7f3c5b7fe700 1 --2- 172.21.15.174:0/1762757739 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3c5c0a1fe0 0x7f3c5c138480 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7f3c50002f30 tx=0x7f3c50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:43.548 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.529+0000 7f3c623b0700 1 -- 172.21.15.174:0/1762757739 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3c5c0a1fe0 msgr2=0x7f3c5c138480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:43.548 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.529+0000 7f3c5affd700 1 -- 172.21.15.174:0/1762757739 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c50013d50 con 0x7f3c5c0a1fe0 2020-04-02T23:21:43.548 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.529+0000 7f3c623b0700 1 --2- 172.21.15.174:0/1762757739 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3c5c0a1fe0 0x7f3c5c138480 secure :-1 s=READY pgs=97 cs=0 l=1 rx=0x7f3c50002f30 tx=0x7f3c50007a40).stop 2020-04-02T23:21:43.548 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.530+0000 7f3c623b0700 1 -- 172.21.15.174:0/1762757739 shutdown_connections 2020-04-02T23:21:43.548 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.530+0000 7f3c623b0700 1 --2- 172.21.15.174:0/1762757739 >> v2:172.21.15.196:3300/0 conn(0x7f3c5c0a7a60 0x7f3c5c0a38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:43.548 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.530+0000 7f3c623b0700 1 --2- 172.21.15.174:0/1762757739 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3c5c0a1fe0 0x7f3c5c138480 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:43.549 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.530+0000 7f3c623b0700 1 -- 172.21.15.174:0/1762757739 >> 172.21.15.174:0/1762757739 conn(0x7f3c5c0aaf80 msgr2=0x7f3c5c0a6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:43.549 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.530+0000 7f3c623b0700 1 -- 172.21.15.174:0/1762757739 shutdown_connections 2020-04-02T23:21:43.549 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.530+0000 7f3c623b0700 1 -- 172.21.15.174:0/1762757739 wait complete. 2020-04-02T23:21:43.549 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.531+0000 7f3c623b0700 1 Processor -- start 2020-04-02T23:21:43.549 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.531+0000 7f3c623b0700 1 -- start start 2020-04-02T23:21:43.549 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.531+0000 7f3c623b0700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3c5c0a1fe0 0x7f3c5c1350f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:43.549 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.531+0000 7f3c623b0700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3c5c1388e0 0x7f3c5c0a0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:43.550 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.531+0000 7f3c623b0700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c5c134710 con 0x7f3c5c0a7a60 2020-04-02T23:21:43.550 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.531+0000 7f3c623b0700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c5c135f60 con 0x7f3c5c1388e0 2020-04-02T23:21:43.550 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.531+0000 7f3c623b0700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5c1349b0 con 0x7f3c5c0a1fe0 2020-04-02T23:21:43.550 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.531+0000 7f3c5b7fe700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f3c5c0a7a60 0x7f3c5c0a0450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:44758/0 (socket says 172.21.15.174:44758) 2020-04-02T23:21:43.550 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.531+0000 7f3c5b7fe700 1 -- 172.21.15.174:0/3758974229 learned_addr learned my addr 172.21.15.174:0/3758974229 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:21:43.552 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.531+0000 7f3c6094d700 1 --2- 172.21.15.174:0/3758974229 >> v2:172.21.15.174:3300/0 conn(0x7f3c5c1388e0 0x7f3c5c0a0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:43.553 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.532+0000 7f3c5bfff700 1 --2- 172.21.15.174:0/3758974229 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3c5c0a1fe0 0x7f3c5c1350f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:43.553 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.532+0000 7f3c597fa700 1 -- 172.21.15.174:0/3758974229 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1991177956 0 0) 0x7f3c5c134710 con 0x7f3c5c0a7a60 2020-04-02T23:21:43.553 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.532+0000 7f3c597fa700 1 -- 172.21.15.174:0/3758974229 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c3c002fe0 con 0x7f3c5c0a7a60 2020-04-02T23:21:43.553 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.532+0000 7f3c6094d700 1 -- 172.21.15.174:0/3758974229 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3c5c0a1fe0 msgr2=0x7f3c5c1350f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:43.553 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.532+0000 7f3c6094d700 1 --2- 172.21.15.174:0/3758974229 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3c5c0a1fe0 0x7f3c5c1350f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:43.553 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.532+0000 7f3c6094d700 1 -- 172.21.15.174:0/3758974229 >> v1:172.21.15.174:6789/0 conn(0x7f3c5c0a7a60 legacy=0x7f3c5c0a0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:43.553 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.532+0000 7f3c6094d700 1 -- 172.21.15.174:0/3758974229 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c5c134c50 con 0x7f3c5c1388e0 2020-04-02T23:21:43.554 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.532+0000 7f3c6094d700 1 --2- 172.21.15.174:0/3758974229 >> v2:172.21.15.174:3300/0 conn(0x7f3c5c1388e0 0x7f3c5c0a0b60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3c54000f00 tx=0x7f3c54010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:43.554 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.532+0000 7f3c6094d700 1 --2- 172.21.15.174:0/3758974229 >> v2:172.21.15.174:3300/0 conn(0x7f3c5c1388e0 0x7f3c5c0a0b60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3c54000f00 tx=0x7f3c54010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:43.554 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.532+0000 7f3c6094d700 1 --2- 172.21.15.174:0/3758974229 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3c5c1388e0 0x7f3c5c0a0b60 secure :-1 s=READY pgs=99 cs=0 l=1 rx=0x7f3c54000f00 tx=0x7f3c54010be0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:43.554 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.532+0000 7f3c6094d700 1 --2- 172.21.15.174:0/3758974229 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3c5c1388e0 0x7f3c5c0a0b60 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7f3c54000f00 tx=0x7f3c54010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:43.554 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.532+0000 7f3c597fa700 1 -- 172.21.15.174:0/3758974229 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c54005e30 con 0x7f3c5c1388e0 2020-04-02T23:21:43.554 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.532+0000 7f3c6094d700 1 --2- 172.21.15.174:0/3758974229 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3c5c1388e0 0x7f3c5c0a0b60 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7f3c54000f00 tx=0x7f3c54010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:43.582 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.532+0000 7f3c6094d700 1 --2- 172.21.15.174:0/3758974229 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3c5c1388e0 0x7f3c5c0a0b60 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7f3c54000f00 tx=0x7f3c54010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:43.582 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.532+0000 7f3c597fa700 1 -- 172.21.15.174:0/3758974229 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c540123c0 con 0x7f3c5c1388e0 2020-04-02T23:21:43.582 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.532+0000 7f3c623b0700 1 -- 172.21.15.174:0/3758974229 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c5c137f60 con 0x7f3c5c1388e0 2020-04-02T23:21:43.583 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.532+0000 7f3c597fa700 1 -- 172.21.15.174:0/3758974229 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c540127e0 con 0x7f3c5c1388e0 2020-04-02T23:21:43.583 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.532+0000 7f3c623b0700 1 -- 172.21.15.174:0/3758974229 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c5c0a1920 con 0x7f3c5c1388e0 2020-04-02T23:21:43.583 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.533+0000 7f3c6094d700 1 --2- 172.21.15.174:0/3758974229 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3c5c1388e0 0x7f3c5c0a0b60 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7f3c54000f00 tx=0x7f3c54010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:43.583 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.533+0000 7f3c623b0700 1 -- 172.21.15.174:0/3758974229 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c5c056c50 con 0x7f3c5c1388e0 2020-04-02T23:21:43.583 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.533+0000 7f3c597fa700 1 -- 172.21.15.174:0/3758974229 <== mon.0 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f3c54012a50 con 0x7f3c5c1388e0 2020-04-02T23:21:43.583 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.533+0000 7f3c6094d700 1 --2- 172.21.15.174:0/3758974229 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3c5c1388e0 0x7f3c5c0a0b60 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7f3c54000f00 tx=0x7f3c54010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:43.583 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.533+0000 7f3c597fa700 1 --2- 172.21.15.174:0/3758974229 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f3c3c04d8f0 0x7f3c3c04fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:43.584 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.533+0000 7f3c597fa700 1 -- 172.21.15.174:0/3758974229 <== mon.0 v2:172.21.15.174:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3c54061240 con 0x7f3c5c1388e0 2020-04-02T23:21:43.584 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.533+0000 7f3c5bfff700 1 --2- 172.21.15.174:0/3758974229 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f3c3c04d8f0 0x7f3c3c04fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:43.584 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.534+0000 7f3c5bfff700 1 --2- 172.21.15.174:0/3758974229 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f3c3c04d8f0 0x7f3c3c04fdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3c4c002f30 tx=0x7f3c4c00d8b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:43.584 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.534+0000 7f3c5bfff700 1 --2- 172.21.15.174:0/3758974229 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f3c3c04d8f0 0x7f3c3c04fdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3c4c002f30 tx=0x7f3c4c00d8b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:43.584 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.534+0000 7f3c5bfff700 1 --2- 172.21.15.174:0/3758974229 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f3c3c04d8f0 0x7f3c3c04fdb0 secure :-1 s=READY pgs=58 cs=0 l=1 rx=0x7f3c4c002f30 tx=0x7f3c4c00d8b0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:43.585 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.537+0000 7f3c6094d700 1 --2- 172.21.15.174:0/3758974229 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3c5c1388e0 0x7f3c5c0a0b60 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7f3c54000f00 tx=0x7f3c54010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:43.585 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.537+0000 7f3c597fa700 1 -- 172.21.15.174:0/3758974229 <== mon.0 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f3c5403c9a0 con 0x7f3c5c1388e0 2020-04-02T23:21:43.681 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.675+0000 7f3c623b0700 1 -- 172.21.15.174:0/3758974229 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3c5c05a690 con 0x7f3c5c1388e0 2020-04-02T23:21:43.681 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.676+0000 7f3c6094d700 1 --2- 172.21.15.174:0/3758974229 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3c5c1388e0 0x7f3c5c0a0b60 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7f3c54000f00 tx=0x7f3c54010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:43.681 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.676+0000 7f3c597fa700 1 -- 172.21.15.174:0/3758974229 <== mon.0 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16134 (secure 0 0 0) 0x7f3c5403ffc0 con 0x7f3c5c1388e0 2020-04-02T23:21:43.682 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.677+0000 7f3c623b0700 1 -- 172.21.15.174:0/3758974229 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f3c3c04d8f0 msgr2=0x7f3c3c04fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:43.682 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.677+0000 7f3c623b0700 1 --2- 172.21.15.174:0/3758974229 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f3c3c04d8f0 0x7f3c3c04fdb0 secure :-1 s=READY pgs=58 cs=0 l=1 rx=0x7f3c4c002f30 tx=0x7f3c4c00d8b0).stop 2020-04-02T23:21:43.682 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.677+0000 7f3c623b0700 1 -- 172.21.15.174:0/3758974229 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3c5c1388e0 msgr2=0x7f3c5c0a0b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:43.682 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.677+0000 7f3c623b0700 1 --2- 172.21.15.174:0/3758974229 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3c5c1388e0 0x7f3c5c0a0b60 secure :-1 s=READY pgs=99 cs=0 l=1 rx=0x7f3c54000f00 tx=0x7f3c54010be0).stop 2020-04-02T23:21:43.682 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.677+0000 7f3c623b0700 1 -- 172.21.15.174:0/3758974229 shutdown_connections 2020-04-02T23:21:43.682 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.677+0000 7f3c623b0700 1 --2- 172.21.15.174:0/3758974229 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f3c3c04d8f0 0x7f3c3c04fdb0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:43.683 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.677+0000 7f3c623b0700 1 --2- 172.21.15.174:0/3758974229 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3c5c1388e0 0x7f3c5c0a0b60 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:43.683 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.677+0000 7f3c623b0700 1 --2- 172.21.15.174:0/3758974229 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3c5c0a1fe0 0x7f3c5c1350f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:43.683 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.677+0000 7f3c623b0700 1 -- 172.21.15.174:0/3758974229 >> 172.21.15.174:0/3758974229 conn(0x7f3c5c0aaf80 msgr2=0x7f3c5c12d990 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:43.683 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.677+0000 7f3c623b0700 1 -- 172.21.15.174:0/3758974229 shutdown_connections 2020-04-02T23:21:43.683 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.677+0000 7f3c623b0700 1 -- 172.21.15.174:0/3758974229 wait complete. 2020-04-02T23:21:43.683 INFO:teuthology.orchestra.run.smithi174.stdout: 2020-04-02T23:21:43.688 INFO:teuthology.orchestra.run.smithi174.stdout:{"epoch":23,"fsid":"06504ece-4284-40ba-b298-58864abc4224","created":"2020-04-02T23:21:19.153932+0000","modified":"2020-04-02T23:21:41.535533+0000","last_up_change":"2020-04-02T23:21:29.337390+0000","last_in_change":"2020-04-02T23:21:29.337390+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-02T23:21:22.199702+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-02T23:21:35.314601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-04-02T23:21:38.762876+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-04-02T23:21:39.474986+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c9d748ee-c52f-4f21-b8c9-2a53a937be1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":24590},{"type":"v1","addr":"172.21.15.174:6801","nonce":24590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":24590},{"type":"v1","addr":"172.21.15.174:6803","nonce":24590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":24590},{"type":"v1","addr":"172.21.15.174:6807","nonce":24590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":24590},{"type":"v1","addr":"172.21.15.174:6805","nonce":24590}]},"public_addr":"172.21.15.174:6801/24590","cluster_addr":"172.21.15.174:6803/24590","heartbeat_back_addr":"172.21.15.174:6807/24590","heartbeat_front_addr":"172.21.15.174:6805/24590","state":["exists","up"]},{"osd":1,"uuid":"27c05faf-11f5-4cef-9bde-1a6653a9e533","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":24754},{"type":"v1","addr":"172.21.15.174:6809","nonce":24754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":24754},{"type":"v1","addr":"172.21.15.174:6811","nonce":24754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":24754},{"type":"v1","addr":"172.21.15.174:6815","nonce":24754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":24754},{"type":"v1","addr":"172.21.15.174:6813","nonce":24754}]},"public_addr":"172.21.15.174:6809/24754","cluster_addr":"172.21.15.174:6811/24754","heartbeat_back_addr":"172.21.15.174:6815/24754","heartbeat_front_addr":"172.21.15.174:6813/24754","state":["exists","up"]},{"osd":2,"uuid":"02b1b455-b518-4393-b257-40c3a76af157","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":24781},{"type":"v1","addr":"172.21.15.174:6817","nonce":24781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":24781},{"type":"v1","addr":"172.21.15.174:6819","nonce":24781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":24781},{"type":"v1","addr":"172.21.15.174:6823","nonce":24781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":24781},{"type":"v1","addr":"172.21.15.174:6821","nonce":24781}]},"public_addr":"172.21.15.174:6817/24781","cluster_addr":"172.21.15.174:6819/24781","heartbeat_back_addr":"172.21.15.174:6823/24781","heartbeat_front_addr":"172.21.15.174:6821/24781","state":["exists","up"]},{"osd":3,"uuid":"d7fb3499-9e13-4076-b3cf-28f27eb62967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":24972},{"type":"v1","addr":"172.21.15.174:6825","nonce":24972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":24972},{"type":"v1","addr":"172.21.15.174:6827","nonce":24972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":24972},{"type":"v1","addr":"172.21.15.174:6831","nonce":24972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":24972},{"type":"v1","addr":"172.21.15.174:6829","nonce":24972}]},"public_addr":"172.21.15.174:6825/24972","cluster_addr":"172.21.15.174:6827/24972","heartbeat_back_addr":"172.21.15.174:6831/24972","heartbeat_front_addr":"172.21.15.174:6829/24972","state":["exists","up"]},{"osd":4,"uuid":"16923c47-2f21-43ea-9647-5ead4b1b2101","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":24034},{"type":"v1","addr":"172.21.15.196:6803","nonce":24034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":24034},{"type":"v1","addr":"172.21.15.196:6805","nonce":24034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":24034},{"type":"v1","addr":"172.21.15.196:6809","nonce":24034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":24034},{"type":"v1","addr":"172.21.15.196:6807","nonce":24034}]},"public_addr":"172.21.15.196:6803/24034","cluster_addr":"172.21.15.196:6805/24034","heartbeat_back_addr":"172.21.15.196:6809/24034","heartbeat_front_addr":"172.21.15.196:6807/24034","state":["exists","up"]},{"osd":5,"uuid":"7cf2859b-2226-4908-8d70-6e699d1acb0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":24190},{"type":"v1","addr":"172.21.15.196:6811","nonce":24190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":24190},{"type":"v1","addr":"172.21.15.196:6813","nonce":24190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":24190},{"type":"v1","addr":"172.21.15.196:6817","nonce":24190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":24190},{"type":"v1","addr":"172.21.15.196:6815","nonce":24190}]},"public_addr":"172.21.15.196:6811/24190","cluster_addr":"172.21.15.196:6813/24190","heartbeat_back_addr":"172.21.15.196:6817/24190","heartbeat_front_addr":"172.21.15.196:6815/24190","state":["exists","up"]},{"osd":6,"uuid":"441081ef-133a-41ec-8041-094e129707e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":24212},{"type":"v1","addr":"172.21.15.196:6819","nonce":24212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":24212},{"type":"v1","addr":"172.21.15.196:6821","nonce":24212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":24212},{"type":"v1","addr":"172.21.15.196:6825","nonce":24212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":24212},{"type":"v1","addr":"172.21.15.196:6823","nonce":24212}]},"public_addr":"172.21.15.196:6819/24212","cluster_addr":"172.21.15.196:6821/24212","heartbeat_back_addr":"172.21.15.196:6825/24212","heartbeat_front_addr":"172.21.15.196:6823/24212","state":["exists","up"]},{"osd":7,"uuid":"17ee8d46-46bf-4ef0-8d02-82cbc4ef5a5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":24408},{"type":"v1","addr":"172.21.15.196:6827","nonce":24408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":24408},{"type":"v1","addr":"172.21.15.196:6829","nonce":24408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":24408},{"type":"v1","addr":"172.21.15.196:6833","nonce":24408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":24408},{"type":"v1","addr":"172.21.15.196:6831","nonce":24408}]},"public_addr":"172.21.15.196:6827/24408","cluster_addr":"172.21.15.196:6829/24408","heartbeat_back_addr":"172.21.15.196:6833/24408","heartbeat_front_addr":"172.21.15.196:6831/24408","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.725574+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.732598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.775890+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.854998+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.545334+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.591623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.627501+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.614807+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-02T23:21:43.692 INFO:tasks.ceph.ceph_manager.ceph:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 1, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-02T23:21:22.199702+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 1, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 1, u'pg_num': 1, u'type': 1, u'grade_table': [], u'pool_name': u'device_health_metrics', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 1, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'mgr_devicehealth': {}}, u'options': {u'pg_num_min': 1}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'16', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-02T23:21:35.314601+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'19', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-02T23:21:38.762876+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 3, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'22', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-02T23:21:39.474986+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 4, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'23', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-04-02T23:21:43.693 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:43.744 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-04-02T23:21:43.891 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.889+0000 7f55227e9700 1 Processor -- start 2020-04-02T23:21:43.892 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.889+0000 7f55227e9700 1 -- start start 2020-04-02T23:21:43.899 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.890+0000 7f55227e9700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f551c0a5900 0x7f551c135030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:43.900 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.890+0000 7f55227e9700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f551c05ac00 0x7f551c12e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:43.900 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.890+0000 7f55227e9700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f551c134420 con 0x7f551c12e6c0 2020-04-02T23:21:43.900 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.890+0000 7f55227e9700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f551c05b0b0 con 0x7f551c0a5900 2020-04-02T23:21:43.900 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.890+0000 7f55227e9700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f551c0a49d0 con 0x7f551c05ac00 2020-04-02T23:21:43.900 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.890+0000 7f551b7fe700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f551c05ac00 0x7f551c12e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:43.900 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.890+0000 7f551bfff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f551c0a5900 0x7f551c135030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:43.901 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.890+0000 7f551b7fe700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f551c05ac00 0x7f551c12e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.174:34314/0 (socket says 172.21.15.174:34314) 2020-04-02T23:21:43.901 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.890+0000 7f551b7fe700 1 -- 172.21.15.174:0/76213779 learned_addr learned my addr 172.21.15.174:0/76213779 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:21:43.901 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.890+0000 7f551b7fe700 1 -- 172.21.15.174:0/76213779 >> v2:172.21.15.196:3300/0 conn(0x7f551c0a5900 msgr2=0x7f551c135030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:43.901 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.890+0000 7f551b7fe700 1 --2- 172.21.15.174:0/76213779 >> v2:172.21.15.196:3300/0 conn(0x7f551c0a5900 0x7f551c135030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:43.901 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.890+0000 7f551b7fe700 1 -- 172.21.15.174:0/76213779 >> v1:172.21.15.196:6789/0 conn(0x7f551c12e6c0 legacy=0x7f551c1379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:43.901 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.890+0000 7f551b7fe700 1 -- 172.21.15.174:0/76213779 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f551c134650 con 0x7f551c05ac00 2020-04-02T23:21:43.901 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.890+0000 7f551b7fe700 1 --2- 172.21.15.174:0/76213779 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f551c05ac00 0x7f551c12e260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5510002f30 tx=0x7f5510007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:43.901 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.890+0000 7f551b7fe700 1 --2- 172.21.15.174:0/76213779 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f551c05ac00 0x7f551c12e260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5510002f30 tx=0x7f5510007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:43.902 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.890+0000 7f551b7fe700 1 --2- 172.21.15.174:0/76213779 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f551c05ac00 0x7f551c12e260 secure :-1 s=READY pgs=23 cs=0 l=1 rx=0x7f5510002f30 tx=0x7f5510007a40).ready entity=mon.2 client_cookie=d6e184b1041a5b11 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:43.902 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.891+0000 7f551b7fe700 1 --2- 172.21.15.174:0/76213779 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f551c05ac00 0x7f551c12e260 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7f5510002f30 tx=0x7f5510007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:43.902 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.891+0000 7f551b7fe700 1 --2- 172.21.15.174:0/76213779 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f551c05ac00 0x7f551c12e260 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7f5510002f30 tx=0x7f5510007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:43.902 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.891+0000 7f551affd700 1 -- 172.21.15.174:0/76213779 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5510011670 con 0x7f551c05ac00 2020-04-02T23:21:43.902 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.891+0000 7f551b7fe700 1 --2- 172.21.15.174:0/76213779 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f551c05ac00 0x7f551c12e260 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7f5510002f30 tx=0x7f5510007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:43.902 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.891+0000 7f551affd700 1 -- 172.21.15.174:0/76213779 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55100117d0 con 0x7f551c05ac00 2020-04-02T23:21:43.902 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.891+0000 7f551affd700 1 -- 172.21.15.174:0/76213779 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5510011bf0 con 0x7f551c05ac00 2020-04-02T23:21:43.903 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.891+0000 7f55227e9700 1 -- 172.21.15.174:0/76213779 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f551c05ac00 msgr2=0x7f551c12e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:43.903 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.891+0000 7f55227e9700 1 --2- 172.21.15.174:0/76213779 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f551c05ac00 0x7f551c12e260 secure :-1 s=READY pgs=23 cs=0 l=1 rx=0x7f5510002f30 tx=0x7f5510007a40).stop 2020-04-02T23:21:43.903 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.891+0000 7f55227e9700 1 -- 172.21.15.174:0/76213779 shutdown_connections 2020-04-02T23:21:43.903 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.891+0000 7f55227e9700 1 --2- 172.21.15.174:0/76213779 >> v2:172.21.15.196:3300/0 conn(0x7f551c0a5900 0x7f551c135030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:43.903 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.891+0000 7f55227e9700 1 --2- 172.21.15.174:0/76213779 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f551c05ac00 0x7f551c12e260 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:43.903 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.891+0000 7f55227e9700 1 -- 172.21.15.174:0/76213779 >> 172.21.15.174:0/76213779 conn(0x7f551c0aaf80 msgr2=0x7f551c0a6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:43.903 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.891+0000 7f55227e9700 1 -- 172.21.15.174:0/76213779 shutdown_connections 2020-04-02T23:21:43.903 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.891+0000 7f55227e9700 1 -- 172.21.15.174:0/76213779 wait complete. 2020-04-02T23:21:43.904 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.892+0000 7f55227e9700 1 Processor -- start 2020-04-02T23:21:43.904 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.892+0000 7f55227e9700 1 -- start start 2020-04-02T23:21:43.904 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.893+0000 7f55227e9700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f551c0a5900 0x7f551c11ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:43.904 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.893+0000 7f55227e9700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f551c12e6c0 0x7f551c0a03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:43.904 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.893+0000 7f55227e9700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f551c1355f0 con 0x7f551c05ac00 2020-04-02T23:21:43.904 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.893+0000 7f55227e9700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f551c11f030 con 0x7f551c0a5900 2020-04-02T23:21:43.905 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.893+0000 7f55227e9700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f551c138180 con 0x7f551c12e6c0 2020-04-02T23:21:43.905 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.893+0000 7f551b7fe700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f551c0a5900 0x7f551c11ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:43.905 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.893+0000 7f551b7fe700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f551c0a5900 0x7f551c11ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:39734/0 (socket says 172.21.15.174:39734) 2020-04-02T23:21:43.905 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.893+0000 7f551b7fe700 1 -- 172.21.15.174:0/3180300524 learned_addr learned my addr 172.21.15.174:0/3180300524 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:21:43.905 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.893+0000 7f5520d86700 1 --2- 172.21.15.174:0/3180300524 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f551c12e6c0 0x7f551c0a03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:43.905 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.893+0000 7f55197fa700 1 -- 172.21.15.174:0/3180300524 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2212437178 0 0) 0x7f551c1355f0 con 0x7f551c05ac00 2020-04-02T23:21:43.905 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.893+0000 7f55197fa700 1 -- 172.21.15.174:0/3180300524 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54fc002fe0 con 0x7f551c05ac00 2020-04-02T23:21:43.906 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.893+0000 7f551b7fe700 1 -- 172.21.15.174:0/3180300524 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f551c12e6c0 msgr2=0x7f551c0a03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:43.906 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.893+0000 7f551b7fe700 1 --2- 172.21.15.174:0/3180300524 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f551c12e6c0 0x7f551c0a03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:43.906 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.893+0000 7f551b7fe700 1 -- 172.21.15.174:0/3180300524 >> v1:172.21.15.196:6789/0 conn(0x7f551c05ac00 legacy=0x7f551c11e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:43.906 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.893+0000 7f551b7fe700 1 -- 172.21.15.174:0/3180300524 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f551c05e660 con 0x7f551c0a5900 2020-04-02T23:21:43.906 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.893+0000 7f551b7fe700 1 --2- 172.21.15.174:0/3180300524 >> v2:172.21.15.174:3300/0 conn(0x7f551c0a5900 0x7f551c11ebd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5510002f30 tx=0x7f5510007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:43.906 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.893+0000 7f551b7fe700 1 --2- 172.21.15.174:0/3180300524 >> v2:172.21.15.174:3300/0 conn(0x7f551c0a5900 0x7f551c11ebd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5510002f30 tx=0x7f5510007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:43.907 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.893+0000 7f551b7fe700 1 --2- 172.21.15.174:0/3180300524 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f551c0a5900 0x7f551c11ebd0 secure :-1 s=READY pgs=100 cs=0 l=1 rx=0x7f5510002f30 tx=0x7f5510007a40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:43.907 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.893+0000 7f551b7fe700 1 --2- 172.21.15.174:0/3180300524 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f551c0a5900 0x7f551c11ebd0 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f5510002f30 tx=0x7f5510007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:43.907 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.893+0000 7f55197fa700 1 -- 172.21.15.174:0/3180300524 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5510011e60 con 0x7f551c0a5900 2020-04-02T23:21:43.907 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.893+0000 7f551b7fe700 1 --2- 172.21.15.174:0/3180300524 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f551c0a5900 0x7f551c11ebd0 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f5510002f30 tx=0x7f5510007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:43.907 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.894+0000 7f55197fa700 1 -- 172.21.15.174:0/3180300524 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5510007150 con 0x7f551c0a5900 2020-04-02T23:21:43.907 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.893+0000 7f551b7fe700 1 --2- 172.21.15.174:0/3180300524 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f551c0a5900 0x7f551c11ebd0 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f5510002f30 tx=0x7f5510007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:43.907 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.894+0000 7f55227e9700 1 -- 172.21.15.174:0/3180300524 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f551c138420 con 0x7f551c0a5900 2020-04-02T23:21:43.907 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.894+0000 7f55197fa700 1 -- 172.21.15.174:0/3180300524 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55100074b0 con 0x7f551c0a5900 2020-04-02T23:21:43.908 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.894+0000 7f55227e9700 1 -- 172.21.15.174:0/3180300524 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f551c061ae0 con 0x7f551c0a5900 2020-04-02T23:21:43.908 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.894+0000 7f551b7fe700 1 --2- 172.21.15.174:0/3180300524 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f551c0a5900 0x7f551c11ebd0 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f5510002f30 tx=0x7f5510007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:43.908 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.894+0000 7f55227e9700 1 -- 172.21.15.174:0/3180300524 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f551c131ad0 con 0x7f551c0a5900 2020-04-02T23:21:43.908 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.895+0000 7f55197fa700 1 -- 172.21.15.174:0/3180300524 <== mon.0 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f55100056c0 con 0x7f551c0a5900 2020-04-02T23:21:43.908 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.895+0000 7f551b7fe700 1 --2- 172.21.15.174:0/3180300524 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f551c0a5900 0x7f551c11ebd0 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f5510002f30 tx=0x7f5510007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:43.908 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.895+0000 7f55197fa700 1 --2- 172.21.15.174:0/3180300524 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f54fc04d8c0 0x7f54fc04fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:43.908 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.895+0000 7f55197fa700 1 -- 172.21.15.174:0/3180300524 <== mon.0 v2:172.21.15.174:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f55100612d0 con 0x7f551c0a5900 2020-04-02T23:21:43.909 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.895+0000 7f551bfff700 1 --2- 172.21.15.174:0/3180300524 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f54fc04d8c0 0x7f54fc04fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:43.909 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.895+0000 7f551bfff700 1 --2- 172.21.15.174:0/3180300524 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f54fc04d8c0 0x7f54fc04fd80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f550c002ef0 tx=0x7f550c0090b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:43.909 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.895+0000 7f551bfff700 1 --2- 172.21.15.174:0/3180300524 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f54fc04d8c0 0x7f54fc04fd80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f550c002ef0 tx=0x7f550c0090b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:43.909 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.895+0000 7f551bfff700 1 --2- 172.21.15.174:0/3180300524 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f54fc04d8c0 0x7f54fc04fd80 secure :-1 s=READY pgs=59 cs=0 l=1 rx=0x7f550c002ef0 tx=0x7f550c0090b0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:43.910 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.898+0000 7f551b7fe700 1 --2- 172.21.15.174:0/3180300524 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f551c0a5900 0x7f551c11ebd0 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f5510002f30 tx=0x7f5510007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:43.910 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:43.898+0000 7f55197fa700 1 -- 172.21.15.174:0/3180300524 <== mon.0 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f551003ca70 con 0x7f551c0a5900 2020-04-02T23:21:44.036 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.033+0000 7f55227e9700 1 -- 172.21.15.174:0/3180300524 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f551c061c70 con 0x7f551c0a5900 2020-04-02T23:21:44.036 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.034+0000 7f551b7fe700 1 --2- 172.21.15.174:0/3180300524 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f551c0a5900 0x7f551c11ebd0 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f5510002f30 tx=0x7f5510007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:44.037 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.034+0000 7f55197fa700 1 -- 172.21.15.174:0/3180300524 <== mon.0 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v23) v1 ==== 110+0+10 (secure 0 0 0) 0x7f5510040090 con 0x7f551c0a5900 2020-04-02T23:21:44.037 INFO:teuthology.orchestra.run.smithi174.stdout:pg_num: 1 2020-04-02T23:21:44.038 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.035+0000 7f55227e9700 1 -- 172.21.15.174:0/3180300524 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f54fc04d8c0 msgr2=0x7f54fc04fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:44.038 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.035+0000 7f55227e9700 1 --2- 172.21.15.174:0/3180300524 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f54fc04d8c0 0x7f54fc04fd80 secure :-1 s=READY pgs=59 cs=0 l=1 rx=0x7f550c002ef0 tx=0x7f550c0090b0).stop 2020-04-02T23:21:44.038 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.035+0000 7f55227e9700 1 -- 172.21.15.174:0/3180300524 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f551c0a5900 msgr2=0x7f551c11ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:44.038 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.035+0000 7f55227e9700 1 --2- 172.21.15.174:0/3180300524 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f551c0a5900 0x7f551c11ebd0 secure :-1 s=READY pgs=100 cs=0 l=1 rx=0x7f5510002f30 tx=0x7f5510007a40).stop 2020-04-02T23:21:44.039 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.035+0000 7f55227e9700 1 -- 172.21.15.174:0/3180300524 shutdown_connections 2020-04-02T23:21:44.039 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.035+0000 7f55227e9700 1 --2- 172.21.15.174:0/3180300524 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f54fc04d8c0 0x7f54fc04fd80 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:44.039 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.035+0000 7f55227e9700 1 --2- 172.21.15.174:0/3180300524 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f551c12e6c0 0x7f551c0a03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:44.039 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.035+0000 7f55227e9700 1 --2- 172.21.15.174:0/3180300524 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f551c0a5900 0x7f551c11ebd0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:44.039 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.035+0000 7f55227e9700 1 -- 172.21.15.174:0/3180300524 >> 172.21.15.174:0/3180300524 conn(0x7f551c0aaf80 msgr2=0x7f551c132440 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:44.039 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.035+0000 7f55227e9700 1 -- 172.21.15.174:0/3180300524 shutdown_connections 2020-04-02T23:21:44.040 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.035+0000 7f55227e9700 1 -- 172.21.15.174:0/3180300524 wait complete. 2020-04-02T23:21:44.048 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:44.061 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-04-02T23:21:44.222 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.212+0000 7f7b9ad32700 1 Processor -- start 2020-04-02T23:21:44.223 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.212+0000 7f7b9ad32700 1 -- start start 2020-04-02T23:21:44.223 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.213+0000 7f7b9ad32700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7b941384d0 0x7f7b94138950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:44.223 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.213+0000 7f7b9ad32700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f7b94138db0 0x7f7b94142e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:44.223 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.213+0000 7f7b9ad32700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b940a4e40 con 0x7f7b9405b320 2020-04-02T23:21:44.223 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.213+0000 7f7b9ad32700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b9405c310 con 0x7f7b941384d0 2020-04-02T23:21:44.224 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.213+0000 7f7b9ad32700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b9405c5b0 con 0x7f7b94138db0 2020-04-02T23:21:44.224 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.213+0000 7f7b93fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7b941384d0 0x7f7b94138950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:44.224 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.213+0000 7f7b93fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7b941384d0 0x7f7b94138950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:39742/0 (socket says 172.21.15.174:39742) 2020-04-02T23:21:44.224 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.213+0000 7f7b93fff700 1 -- 172.21.15.174:0/3106902688 learned_addr learned my addr 172.21.15.174:0/3106902688 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:21:44.224 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.213+0000 7f7b992cf700 1 --2- 172.21.15.174:0/3106902688 >> v2:172.21.15.196:3300/0 conn(0x7f7b94138db0 0x7f7b94142e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:44.224 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.213+0000 7f7b93fff700 1 -- 172.21.15.174:0/3106902688 >> v2:172.21.15.196:3300/0 conn(0x7f7b94138db0 msgr2=0x7f7b94142e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:44.225 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.213+0000 7f7b93fff700 1 --2- 172.21.15.174:0/3106902688 >> v2:172.21.15.196:3300/0 conn(0x7f7b94138db0 0x7f7b94142e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:44.225 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.213+0000 7f7b93fff700 1 -- 172.21.15.174:0/3106902688 >> v1:172.21.15.196:6789/0 conn(0x7f7b9405b320 legacy=0x7f7b94065870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:44.225 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.213+0000 7f7b93fff700 1 -- 172.21.15.174:0/3106902688 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b940a5070 con 0x7f7b941384d0 2020-04-02T23:21:44.225 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.213+0000 7f7b93fff700 1 --2- 172.21.15.174:0/3106902688 >> v2:172.21.15.174:3300/0 conn(0x7f7b941384d0 0x7f7b94138950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7b80002f30 tx=0x7f7b80007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:44.225 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.213+0000 7f7b93fff700 1 --2- 172.21.15.174:0/3106902688 >> v2:172.21.15.174:3300/0 conn(0x7f7b941384d0 0x7f7b94138950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7b80002f30 tx=0x7f7b80007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:44.225 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.213+0000 7f7b93fff700 1 --2- 172.21.15.174:0/3106902688 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7b941384d0 0x7f7b94138950 secure :-1 s=READY pgs=101 cs=0 l=1 rx=0x7f7b80002f30 tx=0x7f7b80007a40).ready entity=mon.0 client_cookie=8d317ad9a22d2bbe server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:44.225 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.213+0000 7f7b93fff700 1 --2- 172.21.15.174:0/3106902688 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7b941384d0 0x7f7b94138950 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7f7b80002f30 tx=0x7f7b80007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:44.225 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.213+0000 7f7b937fe700 1 -- 172.21.15.174:0/3106902688 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b80011670 con 0x7f7b941384d0 2020-04-02T23:21:44.226 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.213+0000 7f7b93fff700 1 --2- 172.21.15.174:0/3106902688 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7b941384d0 0x7f7b94138950 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7f7b80002f30 tx=0x7f7b80007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:44.226 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.213+0000 7f7b93fff700 1 --2- 172.21.15.174:0/3106902688 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7b941384d0 0x7f7b94138950 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7f7b80002f30 tx=0x7f7b80007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:44.226 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.213+0000 7f7b937fe700 1 -- 172.21.15.174:0/3106902688 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b800117d0 con 0x7f7b941384d0 2020-04-02T23:21:44.226 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.213+0000 7f7b937fe700 1 -- 172.21.15.174:0/3106902688 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b80011bb0 con 0x7f7b941384d0 2020-04-02T23:21:44.226 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.213+0000 7f7b9ad32700 1 -- 172.21.15.174:0/3106902688 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7b941384d0 msgr2=0x7f7b94138950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:44.226 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.213+0000 7f7b9ad32700 1 --2- 172.21.15.174:0/3106902688 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7b941384d0 0x7f7b94138950 secure :-1 s=READY pgs=101 cs=0 l=1 rx=0x7f7b80002f30 tx=0x7f7b80007a40).stop 2020-04-02T23:21:44.226 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.214+0000 7f7b9ad32700 1 -- 172.21.15.174:0/3106902688 shutdown_connections 2020-04-02T23:21:44.227 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.214+0000 7f7b9ad32700 1 --2- 172.21.15.174:0/3106902688 >> v2:172.21.15.196:3300/0 conn(0x7f7b94138db0 0x7f7b94142e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:44.227 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.214+0000 7f7b9ad32700 1 --2- 172.21.15.174:0/3106902688 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7b941384d0 0x7f7b94138950 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:44.227 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.214+0000 7f7b9ad32700 1 -- 172.21.15.174:0/3106902688 >> 172.21.15.174:0/3106902688 conn(0x7f7b940aaca0 msgr2=0x7f7b940ab0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:44.227 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.214+0000 7f7b9ad32700 1 -- 172.21.15.174:0/3106902688 shutdown_connections 2020-04-02T23:21:44.227 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.214+0000 7f7b9ad32700 1 -- 172.21.15.174:0/3106902688 wait complete. 2020-04-02T23:21:44.227 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.215+0000 7f7b9ad32700 1 Processor -- start 2020-04-02T23:21:44.227 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.215+0000 7f7b9ad32700 1 -- start start 2020-04-02T23:21:44.228 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.215+0000 7f7b9ad32700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7b94138db0 0x7f7b94090260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:44.228 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.216+0000 7f7b9ad32700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b94138a90 con 0x7f7b941384d0 2020-04-02T23:21:44.228 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.216+0000 7f7b9ad32700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b9409ceb0 con 0x7f7b9405b320 2020-04-02T23:21:44.228 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.216+0000 7f7b9ad32700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b9409d150 con 0x7f7b94138db0 2020-04-02T23:21:44.228 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.216+0000 7f7b992cf700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7b94138db0 0x7f7b94090260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:44.228 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.216+0000 7f7b992cf700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7b94138db0 0x7f7b94090260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:39750/0 (socket says 172.21.15.174:39750) 2020-04-02T23:21:44.229 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.216+0000 7f7b992cf700 1 -- 172.21.15.174:0/608159316 learned_addr learned my addr 172.21.15.174:0/608159316 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:21:44.229 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.216+0000 7f7b93fff700 1 --1- 172.21.15.174:0/608159316 >> v1:172.21.15.174:6789/0 conn(0x7f7b941384d0 0x7f7b94145510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:44786/0 (socket says 172.21.15.174:44786) 2020-04-02T23:21:44.229 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.216+0000 7f7b992cf700 1 -- 172.21.15.174:0/608159316 >> v1:172.21.15.196:6789/0 conn(0x7f7b9405b320 legacy=0x7f7b9409c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:44.229 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.216+0000 7f7b992cf700 1 -- 172.21.15.174:0/608159316 >> v1:172.21.15.174:6789/0 conn(0x7f7b941384d0 legacy=0x7f7b94145510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:44.229 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.216+0000 7f7b91ffb700 1 -- 172.21.15.174:0/608159316 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3065927765 0 0) 0x7f7b9409ceb0 con 0x7f7b9405b320 2020-04-02T23:21:44.229 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.216+0000 7f7b992cf700 1 -- 172.21.15.174:0/608159316 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b9409d3f0 con 0x7f7b94138db0 2020-04-02T23:21:44.229 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.216+0000 7f7b992cf700 1 --2- 172.21.15.174:0/608159316 >> v2:172.21.15.174:3300/0 conn(0x7f7b94138db0 0x7f7b94090260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7b80007ed0 tx=0x7f7b8c010fe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:44.230 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.216+0000 7f7b992cf700 1 --2- 172.21.15.174:0/608159316 >> v2:172.21.15.174:3300/0 conn(0x7f7b94138db0 0x7f7b94090260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7b80007ed0 tx=0x7f7b8c010fe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:44.230 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.216+0000 7f7b992cf700 1 --2- 172.21.15.174:0/608159316 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7b94138db0 0x7f7b94090260 secure :-1 s=READY pgs=103 cs=0 l=1 rx=0x7f7b80007ed0 tx=0x7f7b8c010fe0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:44.230 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.216+0000 7f7b992cf700 1 --2- 172.21.15.174:0/608159316 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7b94138db0 0x7f7b94090260 secure :-1 s=THROTTLE_DONE pgs=103 cs=0 l=1 rx=0x7f7b80007ed0 tx=0x7f7b8c010fe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:44.230 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.216+0000 7f7b91ffb700 1 -- 172.21.15.174:0/608159316 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b8c010540 con 0x7f7b94138db0 2020-04-02T23:21:44.230 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.216+0000 7f7b992cf700 1 --2- 172.21.15.174:0/608159316 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7b94138db0 0x7f7b94090260 secure :-1 s=THROTTLE_DONE pgs=103 cs=0 l=1 rx=0x7f7b80007ed0 tx=0x7f7b8c010fe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:44.230 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.216+0000 7f7b9ad32700 1 -- 172.21.15.174:0/608159316 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b9409d690 con 0x7f7b94138db0 2020-04-02T23:21:44.231 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.216+0000 7f7b91ffb700 1 -- 172.21.15.174:0/608159316 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b8c00e980 con 0x7f7b94138db0 2020-04-02T23:21:44.231 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.216+0000 7f7b992cf700 1 --2- 172.21.15.174:0/608159316 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7b94138db0 0x7f7b94090260 secure :-1 s=THROTTLE_DONE pgs=103 cs=0 l=1 rx=0x7f7b80007ed0 tx=0x7f7b8c010fe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:44.231 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.216+0000 7f7b91ffb700 1 -- 172.21.15.174:0/608159316 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b8c00ed20 con 0x7f7b94138db0 2020-04-02T23:21:44.231 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.216+0000 7f7b9ad32700 1 -- 172.21.15.174:0/608159316 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b9409db30 con 0x7f7b94138db0 2020-04-02T23:21:44.231 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.217+0000 7f7b992cf700 1 --2- 172.21.15.174:0/608159316 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7b94138db0 0x7f7b94090260 secure :-1 s=THROTTLE_DONE pgs=103 cs=0 l=1 rx=0x7f7b80007ed0 tx=0x7f7b8c010fe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:44.231 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.217+0000 7f7b9ad32700 1 -- 172.21.15.174:0/608159316 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b9408e910 con 0x7f7b94138db0 2020-04-02T23:21:44.231 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.217+0000 7f7b91ffb700 1 -- 172.21.15.174:0/608159316 <== mon.0 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f7b8c005a40 con 0x7f7b94138db0 2020-04-02T23:21:44.232 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.217+0000 7f7b992cf700 1 --2- 172.21.15.174:0/608159316 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7b94138db0 0x7f7b94090260 secure :-1 s=THROTTLE_DONE pgs=103 cs=0 l=1 rx=0x7f7b80007ed0 tx=0x7f7b8c010fe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:44.232 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.217+0000 7f7b91ffb700 1 --2- 172.21.15.174:0/608159316 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f7b7c04d3c0 0x7f7b7c04f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:44.232 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.217+0000 7f7b91ffb700 1 -- 172.21.15.174:0/608159316 <== mon.0 v2:172.21.15.174:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7b8c060eb0 con 0x7f7b94138db0 2020-04-02T23:21:44.232 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.218+0000 7f7b98ace700 1 --2- 172.21.15.174:0/608159316 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f7b7c04d3c0 0x7f7b7c04f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:44.232 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.218+0000 7f7b98ace700 1 --2- 172.21.15.174:0/608159316 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f7b7c04d3c0 0x7f7b7c04f880 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7b88002170 tx=0x7f7b88002720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:44.232 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.218+0000 7f7b98ace700 1 --2- 172.21.15.174:0/608159316 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f7b7c04d3c0 0x7f7b7c04f880 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7b88002170 tx=0x7f7b88002720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:44.233 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.218+0000 7f7b98ace700 1 --2- 172.21.15.174:0/608159316 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f7b7c04d3c0 0x7f7b7c04f880 secure :-1 s=READY pgs=61 cs=0 l=1 rx=0x7f7b88002170 tx=0x7f7b88002720).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:44.234 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.221+0000 7f7b992cf700 1 --2- 172.21.15.174:0/608159316 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7b94138db0 0x7f7b94090260 secure :-1 s=THROTTLE_DONE pgs=103 cs=0 l=1 rx=0x7f7b80007ed0 tx=0x7f7b8c010fe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:44.234 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.221+0000 7f7b91ffb700 1 -- 172.21.15.174:0/608159316 <== mon.0 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f7b8c03c530 con 0x7f7b94138db0 2020-04-02T23:21:44.360 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.357+0000 7f7b9ad32700 1 -- 172.21.15.174:0/608159316 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7b94056c50 con 0x7f7b94138db0 2020-04-02T23:21:44.361 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.358+0000 7f7b992cf700 1 --2- 172.21.15.174:0/608159316 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7b94138db0 0x7f7b94090260 secure :-1 s=THROTTLE_DONE pgs=103 cs=0 l=1 rx=0x7f7b80007ed0 tx=0x7f7b8c010fe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:44.361 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.358+0000 7f7b91ffb700 1 -- 172.21.15.174:0/608159316 <== mon.0 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7b8c03fb50 con 0x7f7b94138db0 2020-04-02T23:21:44.361 INFO:teuthology.orchestra.run.smithi174.stdout:pg_num: 8 2020-04-02T23:21:44.362 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.359+0000 7f7b9ad32700 1 -- 172.21.15.174:0/608159316 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f7b7c04d3c0 msgr2=0x7f7b7c04f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:44.362 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.359+0000 7f7b9ad32700 1 --2- 172.21.15.174:0/608159316 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f7b7c04d3c0 0x7f7b7c04f880 secure :-1 s=READY pgs=61 cs=0 l=1 rx=0x7f7b88002170 tx=0x7f7b88002720).stop 2020-04-02T23:21:44.362 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.359+0000 7f7b9ad32700 1 -- 172.21.15.174:0/608159316 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7b94138db0 msgr2=0x7f7b94090260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:44.363 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.359+0000 7f7b9ad32700 1 --2- 172.21.15.174:0/608159316 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7b94138db0 0x7f7b94090260 secure :-1 s=READY pgs=103 cs=0 l=1 rx=0x7f7b80007ed0 tx=0x7f7b8c010fe0).stop 2020-04-02T23:21:44.363 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.359+0000 7f7b9ad32700 1 -- 172.21.15.174:0/608159316 shutdown_connections 2020-04-02T23:21:44.363 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.359+0000 7f7b9ad32700 1 --2- 172.21.15.174:0/608159316 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7b94138db0 0x7f7b94090260 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:44.363 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.359+0000 7f7b9ad32700 1 --2- 172.21.15.174:0/608159316 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f7b7c04d3c0 0x7f7b7c04f880 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:44.363 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.359+0000 7f7b9ad32700 1 -- 172.21.15.174:0/608159316 >> 172.21.15.174:0/608159316 conn(0x7f7b940aaca0 msgr2=0x7f7b940695c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:44.363 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.359+0000 7f7b9ad32700 1 -- 172.21.15.174:0/608159316 shutdown_connections 2020-04-02T23:21:44.363 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.359+0000 7f7b9ad32700 1 -- 172.21.15.174:0/608159316 wait complete. 2020-04-02T23:21:44.372 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:44.385 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-04-02T23:21:44.533 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.530+0000 7f597f29b700 1 Processor -- start 2020-04-02T23:21:44.533 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.530+0000 7f597f29b700 1 -- start start 2020-04-02T23:21:44.536 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.531+0000 7f597f29b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f597805b520 0x7f5978138760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:44.536 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.531+0000 7f597f29b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5978132880 con 0x7f597805b090 2020-04-02T23:21:44.536 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.531+0000 7f597f29b700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59780a9230 con 0x7f597805f600 2020-04-02T23:21:44.536 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.531+0000 7f597f29b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59780a9460 con 0x7f597805b520 2020-04-02T23:21:44.536 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.531+0000 7f597ea9a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f597805b520 0x7f5978138760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:44.536 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.531+0000 7f597ea9a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f597805b520 0x7f5978138760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:39758/0 (socket says 172.21.15.174:39758) 2020-04-02T23:21:44.536 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.531+0000 7f597da98700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f597805b090 0x7f5978138050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:44794/0 (socket says 172.21.15.174:44794) 2020-04-02T23:21:44.537 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.531+0000 7f597ea9a700 1 -- 172.21.15.174:0/1194828964 learned_addr learned my addr 172.21.15.174:0/1194828964 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:21:44.537 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.531+0000 7f597ea9a700 1 -- 172.21.15.174:0/1194828964 >> v1:172.21.15.196:6789/0 conn(0x7f597805f600 legacy=0x7f59780601a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:44.537 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.531+0000 7f597ea9a700 1 -- 172.21.15.174:0/1194828964 >> v1:172.21.15.174:6789/0 conn(0x7f597805b090 legacy=0x7f5978138050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:44.538 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.531+0000 7f597ea9a700 1 -- 172.21.15.174:0/1194828964 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59780a9700 con 0x7f597805b520 2020-04-02T23:21:44.538 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.531+0000 7f597d297700 1 -- 172.21.15.174:0/1194828964 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1153978744 0 0) 0x7f5978132880 con 0x7f597805b090 2020-04-02T23:21:44.538 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.531+0000 7f597ea9a700 1 --2- 172.21.15.174:0/1194828964 >> v2:172.21.15.174:3300/0 conn(0x7f597805b520 0x7f5978138760 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f59700032b0 tx=0x7f5970007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:44.538 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.532+0000 7f597ea9a700 1 --2- 172.21.15.174:0/1194828964 >> v2:172.21.15.174:3300/0 conn(0x7f597805b520 0x7f5978138760 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f59700032b0 tx=0x7f5970007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:44.538 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.532+0000 7f597ea9a700 1 --2- 172.21.15.174:0/1194828964 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f597805b520 0x7f5978138760 secure :-1 s=READY pgs=105 cs=0 l=1 rx=0x7f59700032b0 tx=0x7f5970007dc0).ready entity=mon.0 client_cookie=502ad849191138ee server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:44.538 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.532+0000 7f597ea9a700 1 --2- 172.21.15.174:0/1194828964 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f597805b520 0x7f5978138760 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7f59700032b0 tx=0x7f5970007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:44.538 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.532+0000 7f597d297700 1 -- 172.21.15.174:0/1194828964 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f597000a160 con 0x7f597805b520 2020-04-02T23:21:44.538 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.532+0000 7f597ea9a700 1 --2- 172.21.15.174:0/1194828964 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f597805b520 0x7f5978138760 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7f59700032b0 tx=0x7f5970007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:44.539 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.532+0000 7f597ea9a700 1 --2- 172.21.15.174:0/1194828964 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f597805b520 0x7f5978138760 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7f59700032b0 tx=0x7f5970007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:44.539 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.532+0000 7f597d297700 1 -- 172.21.15.174:0/1194828964 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f597000a2c0 con 0x7f597805b520 2020-04-02T23:21:44.539 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.532+0000 7f597d297700 1 -- 172.21.15.174:0/1194828964 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f597000a6e0 con 0x7f597805b520 2020-04-02T23:21:44.539 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.532+0000 7f597f29b700 1 -- 172.21.15.174:0/1194828964 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f597805b520 msgr2=0x7f5978138760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:44.539 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.532+0000 7f597f29b700 1 --2- 172.21.15.174:0/1194828964 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f597805b520 0x7f5978138760 secure :-1 s=READY pgs=105 cs=0 l=1 rx=0x7f59700032b0 tx=0x7f5970007dc0).stop 2020-04-02T23:21:44.539 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.532+0000 7f597f29b700 1 -- 172.21.15.174:0/1194828964 shutdown_connections 2020-04-02T23:21:44.539 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.532+0000 7f597f29b700 1 --2- 172.21.15.174:0/1194828964 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f597805b520 0x7f5978138760 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:44.540 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.532+0000 7f597f29b700 1 -- 172.21.15.174:0/1194828964 >> 172.21.15.174:0/1194828964 conn(0x7f59780ae840 msgr2=0x7f59780aec20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:44.540 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.532+0000 7f597f29b700 1 -- 172.21.15.174:0/1194828964 shutdown_connections 2020-04-02T23:21:44.540 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.532+0000 7f597f29b700 1 -- 172.21.15.174:0/1194828964 wait complete. 2020-04-02T23:21:44.540 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.533+0000 7f597f29b700 1 Processor -- start 2020-04-02T23:21:44.540 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.533+0000 7f597f29b700 1 -- start start 2020-04-02T23:21:44.544 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.534+0000 7f597f29b700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f597805b090 0x7f5978148da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:44.544 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.534+0000 7f597f29b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f597805b520 0x7f5978136390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:44.544 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.534+0000 7f597f29b700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5978149410 con 0x7f597805f600 2020-04-02T23:21:44.544 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.534+0000 7f597f29b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5978149200 con 0x7f597805b520 2020-04-02T23:21:44.544 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.534+0000 7f597f29b700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59781496b0 con 0x7f597805b090 2020-04-02T23:21:44.544 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.534+0000 7f597da98700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f597805b520 0x7f5978136390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:44.544 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.534+0000 7f597da98700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f597805b520 0x7f5978136390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:39762/0 (socket says 172.21.15.174:39762) 2020-04-02T23:21:44.545 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.534+0000 7f597da98700 1 -- 172.21.15.174:0/2716115239 learned_addr learned my addr 172.21.15.174:0/2716115239 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:21:44.545 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.534+0000 7f597e299700 1 --2- 172.21.15.174:0/2716115239 >> v2:172.21.15.196:3300/0 conn(0x7f597805b090 0x7f5978148da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:44.545 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.534+0000 7f597da98700 1 -- 172.21.15.174:0/2716115239 >> v2:172.21.15.196:3300/0 conn(0x7f597805b090 msgr2=0x7f5978148da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:44.545 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.534+0000 7f597da98700 1 --2- 172.21.15.174:0/2716115239 >> v2:172.21.15.196:3300/0 conn(0x7f597805b090 0x7f5978148da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:44.545 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.534+0000 7f597da98700 1 -- 172.21.15.174:0/2716115239 >> v1:172.21.15.196:6789/0 conn(0x7f597805f600 legacy=0x7f597813afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:44.545 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.534+0000 7f597da98700 1 -- 172.21.15.174:0/2716115239 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5978135ef0 con 0x7f597805b520 2020-04-02T23:21:44.545 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.534+0000 7f597e299700 1 --2- 172.21.15.174:0/2716115239 >> v2:172.21.15.196:3300/0 conn(0x7f597805b090 0x7f5978148da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-04-02T23:21:44.546 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.534+0000 7f597da98700 1 --2- 172.21.15.174:0/2716115239 >> v2:172.21.15.174:3300/0 conn(0x7f597805b520 0x7f5978136390 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f59781311f0 tx=0x7f5974001e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:44.546 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.534+0000 7f597da98700 1 --2- 172.21.15.174:0/2716115239 >> v2:172.21.15.174:3300/0 conn(0x7f597805b520 0x7f5978136390 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f59781311f0 tx=0x7f5974001e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:44.546 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.534+0000 7f597da98700 1 --2- 172.21.15.174:0/2716115239 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f597805b520 0x7f5978136390 secure :-1 s=READY pgs=106 cs=0 l=1 rx=0x7f59781311f0 tx=0x7f5974001e30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:44.546 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.534+0000 7f597da98700 1 --2- 172.21.15.174:0/2716115239 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f597805b520 0x7f5978136390 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7f59781311f0 tx=0x7f5974001e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:44.546 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.534+0000 7f597da98700 1 --2- 172.21.15.174:0/2716115239 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f597805b520 0x7f5978136390 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7f59781311f0 tx=0x7f5974001e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:44.546 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.534+0000 7f596b7fe700 1 -- 172.21.15.174:0/2716115239 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f597400c940 con 0x7f597805b520 2020-04-02T23:21:44.546 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.534+0000 7f597da98700 1 --2- 172.21.15.174:0/2716115239 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f597805b520 0x7f5978136390 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7f59781311f0 tx=0x7f5974001e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:44.546 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.534+0000 7f596b7fe700 1 -- 172.21.15.174:0/2716115239 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f597400caa0 con 0x7f597805b520 2020-04-02T23:21:44.547 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.534+0000 7f597f29b700 1 -- 172.21.15.174:0/2716115239 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5978131560 con 0x7f597805b520 2020-04-02T23:21:44.547 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.534+0000 7f596b7fe700 1 -- 172.21.15.174:0/2716115239 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f597400ce80 con 0x7f597805b520 2020-04-02T23:21:44.547 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.534+0000 7f597f29b700 1 -- 172.21.15.174:0/2716115239 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59780ade00 con 0x7f597805b520 2020-04-02T23:21:44.547 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.535+0000 7f597da98700 1 --2- 172.21.15.174:0/2716115239 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f597805b520 0x7f5978136390 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7f59781311f0 tx=0x7f5974001e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:44.548 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.536+0000 7f597f29b700 1 -- 172.21.15.174:0/2716115239 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5978056c50 con 0x7f597805b520 2020-04-02T23:21:44.548 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.536+0000 7f596b7fe700 1 -- 172.21.15.174:0/2716115239 <== mon.0 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f59740044f0 con 0x7f597805b520 2020-04-02T23:21:44.548 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.536+0000 7f597da98700 1 --2- 172.21.15.174:0/2716115239 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f597805b520 0x7f5978136390 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7f59781311f0 tx=0x7f5974001e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:44.548 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.536+0000 7f596b7fe700 1 --2- 172.21.15.174:0/2716115239 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f595804d560 0x7f595804fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:44.548 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.536+0000 7f596b7fe700 1 -- 172.21.15.174:0/2716115239 <== mon.0 v2:172.21.15.174:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5974060c20 con 0x7f597805b520 2020-04-02T23:21:44.548 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.536+0000 7f597e299700 1 --2- 172.21.15.174:0/2716115239 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f595804d560 0x7f595804fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:44.548 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.536+0000 7f597e299700 1 --2- 172.21.15.174:0/2716115239 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f595804d560 0x7f595804fa20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f597809e640 tx=0x7f597806a960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:44.549 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.537+0000 7f597e299700 1 --2- 172.21.15.174:0/2716115239 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f595804d560 0x7f595804fa20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f597809e640 tx=0x7f597806a960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:44.549 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.537+0000 7f597e299700 1 --2- 172.21.15.174:0/2716115239 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f595804d560 0x7f595804fa20 secure :-1 s=READY pgs=62 cs=0 l=1 rx=0x7f597809e640 tx=0x7f597806a960).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:44.549 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.539+0000 7f597da98700 1 --2- 172.21.15.174:0/2716115239 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f597805b520 0x7f5978136390 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7f59781311f0 tx=0x7f5974001e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:44.549 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.539+0000 7f596b7fe700 1 -- 172.21.15.174:0/2716115239 <== mon.0 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f597403c2c0 con 0x7f597805b520 2020-04-02T23:21:44.677 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.675+0000 7f597f29b700 1 -- 172.21.15.174:0/2716115239 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f597805d190 con 0x7f597805b520 2020-04-02T23:21:44.678 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.675+0000 7f597da98700 1 --2- 172.21.15.174:0/2716115239 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f597805b520 0x7f5978136390 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7f59781311f0 tx=0x7f5974001e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:44.678 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.675+0000 7f596b7fe700 1 -- 172.21.15.174:0/2716115239 <== mon.0 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+10 (secure 0 0 0) 0x7f597403f8e0 con 0x7f597805b520 2020-04-02T23:21:44.678 INFO:teuthology.orchestra.run.smithi174.stdout:pg_num: 8 2020-04-02T23:21:44.679 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.676+0000 7f597f29b700 1 -- 172.21.15.174:0/2716115239 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f595804d560 msgr2=0x7f595804fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:44.679 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.676+0000 7f597f29b700 1 --2- 172.21.15.174:0/2716115239 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f595804d560 0x7f595804fa20 secure :-1 s=READY pgs=62 cs=0 l=1 rx=0x7f597809e640 tx=0x7f597806a960).stop 2020-04-02T23:21:44.679 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.676+0000 7f597f29b700 1 -- 172.21.15.174:0/2716115239 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f597805b520 msgr2=0x7f5978136390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:44.679 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.676+0000 7f597f29b700 1 --2- 172.21.15.174:0/2716115239 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f597805b520 0x7f5978136390 secure :-1 s=READY pgs=106 cs=0 l=1 rx=0x7f59781311f0 tx=0x7f5974001e30).stop 2020-04-02T23:21:44.680 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.676+0000 7f597f29b700 1 -- 172.21.15.174:0/2716115239 shutdown_connections 2020-04-02T23:21:44.680 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.676+0000 7f597f29b700 1 --2- 172.21.15.174:0/2716115239 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f595804d560 0x7f595804fa20 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:44.680 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.676+0000 7f597f29b700 1 --2- 172.21.15.174:0/2716115239 >> v2:172.21.15.196:3300/0 conn(0x7f597805b090 0x7f5978148da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:44.680 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.676+0000 7f597f29b700 1 --2- 172.21.15.174:0/2716115239 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f597805b520 0x7f5978136390 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:44.680 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.676+0000 7f597f29b700 1 -- 172.21.15.174:0/2716115239 >> 172.21.15.174:0/2716115239 conn(0x7f59780ae840 msgr2=0x7f59780695c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:44.680 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.676+0000 7f597f29b700 1 -- 172.21.15.174:0/2716115239 shutdown_connections 2020-04-02T23:21:44.680 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.676+0000 7f597f29b700 1 -- 172.21.15.174:0/2716115239 wait complete. 2020-04-02T23:21:44.690 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:44.713 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-04-02T23:21:44.860 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.858+0000 7fbd9cd39700 1 Processor -- start 2020-04-02T23:21:44.861 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.858+0000 7fbd9cd39700 1 -- start start 2020-04-02T23:21:44.868 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.859+0000 7fbd9cd39700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fbd98135030 0x7fbd9805ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:44.868 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.859+0000 7fbd9cd39700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd98134420 con 0x7fbd9812e970 2020-04-02T23:21:44.868 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.859+0000 7fbd9cd39700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd980a49d0 con 0x7fbd980a5900 2020-04-02T23:21:44.868 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.859+0000 7fbd9cd39700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd9805b060 con 0x7fbd98135030 2020-04-02T23:21:44.868 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.859+0000 7fbd96d9d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fbd98135030 0x7fbd9805ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:44.869 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.859+0000 7fbd96d9d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fbd98135030 0x7fbd9805ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:39768/0 (socket says 172.21.15.174:39768) 2020-04-02T23:21:44.869 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.859+0000 7fbd8dd9b700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fbd9812e970 0x7fbd9813cd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:44806/0 (socket says 172.21.15.174:44806) 2020-04-02T23:21:44.869 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.859+0000 7fbd96d9d700 1 -- 172.21.15.174:0/3874878289 learned_addr learned my addr 172.21.15.174:0/3874878289 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:21:44.869 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.859+0000 7fbd96d9d700 1 -- 172.21.15.174:0/3874878289 >> v1:172.21.15.196:6789/0 conn(0x7fbd980a5900 legacy=0x7fbd9812e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:44.869 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.859+0000 7fbd96d9d700 1 -- 172.21.15.174:0/3874878289 >> v1:172.21.15.174:6789/0 conn(0x7fbd9812e970 legacy=0x7fbd9813cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:44.869 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.859+0000 7fbd95d9b700 1 -- 172.21.15.174:0/3874878289 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 377321608 0 0) 0x7fbd98134420 con 0x7fbd9812e970 2020-04-02T23:21:44.869 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.859+0000 7fbd96d9d700 1 -- 172.21.15.174:0/3874878289 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd98134650 con 0x7fbd98135030 2020-04-02T23:21:44.869 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.859+0000 7fbd96d9d700 1 --2- 172.21.15.174:0/3874878289 >> v2:172.21.15.174:3300/0 conn(0x7fbd98135030 0x7fbd9805ac00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbd9809e3e0 tx=0x7fbd90007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:44.870 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.859+0000 7fbd96d9d700 1 --2- 172.21.15.174:0/3874878289 >> v2:172.21.15.174:3300/0 conn(0x7fbd98135030 0x7fbd9805ac00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbd9809e3e0 tx=0x7fbd90007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:44.870 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.859+0000 7fbd96d9d700 1 --2- 172.21.15.174:0/3874878289 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbd98135030 0x7fbd9805ac00 secure :-1 s=READY pgs=108 cs=0 l=1 rx=0x7fbd9809e3e0 tx=0x7fbd90007dc0).ready entity=mon.0 client_cookie=cb43784a48120460 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:44.870 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.859+0000 7fbd96d9d700 1 --2- 172.21.15.174:0/3874878289 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbd98135030 0x7fbd9805ac00 secure :-1 s=THROTTLE_DONE pgs=108 cs=0 l=1 rx=0x7fbd9809e3e0 tx=0x7fbd90007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:44.870 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.859+0000 7fbd95d9b700 1 -- 172.21.15.174:0/3874878289 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd9000a160 con 0x7fbd98135030 2020-04-02T23:21:44.870 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.859+0000 7fbd96d9d700 1 --2- 172.21.15.174:0/3874878289 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbd98135030 0x7fbd9805ac00 secure :-1 s=THROTTLE_DONE pgs=108 cs=0 l=1 rx=0x7fbd9809e3e0 tx=0x7fbd90007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:44.870 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.859+0000 7fbd96d9d700 1 --2- 172.21.15.174:0/3874878289 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbd98135030 0x7fbd9805ac00 secure :-1 s=THROTTLE_DONE pgs=108 cs=0 l=1 rx=0x7fbd9809e3e0 tx=0x7fbd90007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:44.870 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.859+0000 7fbd95d9b700 1 -- 172.21.15.174:0/3874878289 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd9000a2c0 con 0x7fbd98135030 2020-04-02T23:21:44.871 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.859+0000 7fbd95d9b700 1 -- 172.21.15.174:0/3874878289 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd9000a6a0 con 0x7fbd98135030 2020-04-02T23:21:44.871 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.859+0000 7fbd9cd39700 1 -- 172.21.15.174:0/3874878289 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbd98135030 msgr2=0x7fbd9805ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:44.871 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.859+0000 7fbd9cd39700 1 --2- 172.21.15.174:0/3874878289 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbd98135030 0x7fbd9805ac00 secure :-1 s=READY pgs=108 cs=0 l=1 rx=0x7fbd9809e3e0 tx=0x7fbd90007dc0).stop 2020-04-02T23:21:44.871 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.860+0000 7fbd9cd39700 1 -- 172.21.15.174:0/3874878289 shutdown_connections 2020-04-02T23:21:44.871 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.860+0000 7fbd9cd39700 1 --2- 172.21.15.174:0/3874878289 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbd98135030 0x7fbd9805ac00 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:44.871 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.860+0000 7fbd9cd39700 1 -- 172.21.15.174:0/3874878289 >> 172.21.15.174:0/3874878289 conn(0x7fbd980aaf80 msgr2=0x7fbd980a6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:44.871 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.860+0000 7fbd9cd39700 1 -- 172.21.15.174:0/3874878289 shutdown_connections 2020-04-02T23:21:44.871 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.860+0000 7fbd9cd39700 1 -- 172.21.15.174:0/3874878289 wait complete. 2020-04-02T23:21:44.872 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.861+0000 7fbd9cd39700 1 Processor -- start 2020-04-02T23:21:44.872 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.861+0000 7fbd9cd39700 1 -- start start 2020-04-02T23:21:44.872 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.861+0000 7fbd9cd39700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd98135030 0x7fbd9809fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:44.872 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.861+0000 7fbd9cd39700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd9809ea60 con 0x7fbd981374e0 2020-04-02T23:21:44.872 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.861+0000 7fbd9cd39700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd9809ed00 con 0x7fbd980a5900 2020-04-02T23:21:44.872 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.861+0000 7fbd9cd39700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9809efa0 con 0x7fbd98135030 2020-04-02T23:21:44.872 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.861+0000 7fbd96d9d700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fbd981374e0 0x7fbd980a0320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:44814/0 (socket says 172.21.15.174:44814) 2020-04-02T23:21:44.873 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.861+0000 7fbd96d9d700 1 -- 172.21.15.174:0/961878468 learned_addr learned my addr 172.21.15.174:0/961878468 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:21:44.873 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.862+0000 7fbd8dd9b700 1 --2- 172.21.15.174:0/961878468 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd98135030 0x7fbd9809fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:44.873 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.862+0000 7fbd8ffff700 1 -- 172.21.15.174:0/961878468 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3523524608 0 0) 0x7fbd9809ea60 con 0x7fbd981374e0 2020-04-02T23:21:44.873 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.862+0000 7fbd8ffff700 1 -- 172.21.15.174:0/961878468 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd70002fe0 con 0x7fbd981374e0 2020-04-02T23:21:44.873 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.862+0000 7fbd8ffff700 1 -- 172.21.15.174:0/961878468 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2462140330 0 0) 0x7fbd9809ed00 con 0x7fbd980a5900 2020-04-02T23:21:44.873 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.862+0000 7fbd8ffff700 1 -- 172.21.15.174:0/961878468 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd9809ea60 con 0x7fbd980a5900 2020-04-02T23:21:44.873 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.862+0000 7fbd8ffff700 1 -- 172.21.15.174:0/961878468 <== mon.0 v1:172.21.15.174:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3182601145 0 0) 0x7fbd70002fe0 con 0x7fbd981374e0 2020-04-02T23:21:44.873 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.862+0000 7fbd8ffff700 1 -- 172.21.15.174:0/961878468 --> v1:172.21.15.174:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbd9809ed00 con 0x7fbd981374e0 2020-04-02T23:21:44.874 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.862+0000 7fbd8ffff700 1 -- 172.21.15.174:0/961878468 <== mon.0 v1:172.21.15.174:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2811762909 0 0) 0x7fbd900089e0 con 0x7fbd981374e0 2020-04-02T23:21:44.874 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.862+0000 7fbd8ffff700 1 -- 172.21.15.174:0/961878468 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd98135030 msgr2=0x7fbd9809fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:44.874 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.862+0000 7fbd8ffff700 1 --2- 172.21.15.174:0/961878468 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd98135030 0x7fbd9809fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:44.874 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.862+0000 7fbd8ffff700 1 -- 172.21.15.174:0/961878468 >> v1:172.21.15.196:6789/0 conn(0x7fbd980a5900 legacy=0x7fbd9809f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:44.874 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.862+0000 7fbd8ffff700 1 -- 172.21.15.174:0/961878468 >> v1:172.21.15.174:6789/0 conn(0x7fbd981374e0 legacy=0x7fbd980a0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:44.874 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.862+0000 7fbd8ffff700 1 --2- 172.21.15.174:0/961878468 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbd70004b20 0x7fbd70004f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:44.874 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.862+0000 7fbd8ffff700 1 --2- 172.21.15.174:0/961878468 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd70003ab0 0x7fbd70003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:44.875 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.862+0000 7fbd8ffff700 1 --2- 172.21.15.174:0/961878468 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd70004350 0x7fbd7000b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:44.875 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.862+0000 7fbd8ffff700 1 -- 172.21.15.174:0/961878468 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9809efa0 con 0x7fbd70004b20 2020-04-02T23:21:44.875 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.862+0000 7fbd8ffff700 1 -- 172.21.15.174:0/961878468 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd700047d0 con 0x7fbd70003ab0 2020-04-02T23:21:44.875 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.862+0000 7fbd8ffff700 1 -- 172.21.15.174:0/961878468 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7000bbb0 con 0x7fbd70004350 2020-04-02T23:21:44.875 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.862+0000 7fbd8dd9b700 1 --2- 172.21.15.174:0/961878468 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd98135030 0x7fbd9809fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:21:44.875 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.862+0000 7fbd9659c700 1 --2- 172.21.15.174:0/961878468 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbd70004b20 0x7fbd70004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:44.876 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.862+0000 7fbd96d9d700 1 --2- 172.21.15.174:0/961878468 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd70004350 0x7fbd7000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:44.876 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.862+0000 7fbd8dd9b700 1 --2- 172.21.15.174:0/961878468 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd70003ab0 0x7fbd70003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:44.876 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.862+0000 7fbd9659c700 1 -- 172.21.15.174:0/961878468 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd70004350 msgr2=0x7fbd7000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:44.876 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.862+0000 7fbd9659c700 1 --2- 172.21.15.174:0/961878468 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd70004350 0x7fbd7000b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:44.876 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.862+0000 7fbd9659c700 1 -- 172.21.15.174:0/961878468 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd70003ab0 msgr2=0x7fbd70003ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:44.877 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.862+0000 7fbd9659c700 1 --2- 172.21.15.174:0/961878468 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd70003ab0 0x7fbd70003ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:44.877 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.862+0000 7fbd9659c700 1 -- 172.21.15.174:0/961878468 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd9812e680 con 0x7fbd70004b20 2020-04-02T23:21:44.877 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.862+0000 7fbd9cd39700 1 -- 172.21.15.174:0/961878468 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd981385c0 con 0x7fbd70004b20 2020-04-02T23:21:44.877 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.862+0000 7fbd8dd9b700 1 --2- 172.21.15.174:0/961878468 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd70003ab0 0x7fbd70003ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-02T23:21:44.879 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.862+0000 7fbd9659c700 1 --2- 172.21.15.174:0/961878468 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbd70004b20 0x7fbd70004f40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbd88000e90 tx=0x7fbd88010a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:44.879 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.862+0000 7fbd9cd39700 1 -- 172.21.15.174:0/961878468 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd98137c50 con 0x7fbd70004b20 2020-04-02T23:21:44.879 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.862+0000 7fbd9659c700 1 --2- 172.21.15.174:0/961878468 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbd70004b20 0x7fbd70004f40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbd88000e90 tx=0x7fbd88010a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:44.879 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.862+0000 7fbd9659c700 1 --2- 172.21.15.174:0/961878468 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbd70004b20 0x7fbd70004f40 secure :-1 s=READY pgs=110 cs=0 l=1 rx=0x7fbd88000e90 tx=0x7fbd88010a60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:44.879 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.863+0000 7fbd9659c700 1 --2- 172.21.15.174:0/961878468 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbd70004b20 0x7fbd70004f40 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7fbd88000e90 tx=0x7fbd88010a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:44.879 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.863+0000 7fbd8ffff700 1 -- 172.21.15.174:0/961878468 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd880069c0 con 0x7fbd70004b20 2020-04-02T23:21:44.880 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.863+0000 7fbd9659c700 1 --2- 172.21.15.174:0/961878468 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbd70004b20 0x7fbd70004f40 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7fbd88000e90 tx=0x7fbd88010a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:44.880 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.863+0000 7fbd9659c700 1 --2- 172.21.15.174:0/961878468 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbd70004b20 0x7fbd70004f40 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7fbd88000e90 tx=0x7fbd88010a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:44.880 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.863+0000 7fbd8ffff700 1 -- 172.21.15.174:0/961878468 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd88006b20 con 0x7fbd70004b20 2020-04-02T23:21:44.880 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.863+0000 7fbd8ffff700 1 -- 172.21.15.174:0/961878468 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd88012130 con 0x7fbd70004b20 2020-04-02T23:21:44.880 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.863+0000 7fbd9659c700 1 --2- 172.21.15.174:0/961878468 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbd70004b20 0x7fbd70004f40 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7fbd88000e90 tx=0x7fbd88010a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:44.880 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.863+0000 7fbd9cd39700 1 -- 172.21.15.174:0/961878468 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd98056c50 con 0x7fbd70004b20 2020-04-02T23:21:44.880 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.864+0000 7fbd8ffff700 1 -- 172.21.15.174:0/961878468 <== mon.0 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fbd88012290 con 0x7fbd70004b20 2020-04-02T23:21:44.881 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.864+0000 7fbd9659c700 1 --2- 172.21.15.174:0/961878468 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbd70004b20 0x7fbd70004f40 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7fbd88000e90 tx=0x7fbd88010a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:44.881 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.864+0000 7fbd8ffff700 1 --2- 172.21.15.174:0/961878468 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fbd70055de0 0x7fbd700582a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:44.881 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.864+0000 7fbd8ffff700 1 -- 172.21.15.174:0/961878468 <== mon.0 v2:172.21.15.174:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fbd880608c0 con 0x7fbd70004b20 2020-04-02T23:21:44.881 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.864+0000 7fbd8dd9b700 1 --2- 172.21.15.174:0/961878468 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fbd70055de0 0x7fbd700582a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:44.881 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.864+0000 7fbd8dd9b700 1 --2- 172.21.15.174:0/961878468 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fbd70055de0 0x7fbd700582a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbd80000b80 tx=0x7fbd80001a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:44.881 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.864+0000 7fbd8dd9b700 1 --2- 172.21.15.174:0/961878468 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fbd70055de0 0x7fbd700582a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbd80000b80 tx=0x7fbd80001a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:44.881 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.864+0000 7fbd8dd9b700 1 --2- 172.21.15.174:0/961878468 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fbd70055de0 0x7fbd700582a0 secure :-1 s=READY pgs=63 cs=0 l=1 rx=0x7fbd80000b80 tx=0x7fbd80001a00).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:44.882 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.867+0000 7fbd9659c700 1 --2- 172.21.15.174:0/961878468 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbd70004b20 0x7fbd70004f40 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7fbd88000e90 tx=0x7fbd88010a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:44.882 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:44.867+0000 7fbd8ffff700 1 -- 172.21.15.174:0/961878468 <== mon.0 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fbd8803c000 con 0x7fbd70004b20 2020-04-02T23:21:45.007 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.005+0000 7fbd9cd39700 1 -- 172.21.15.174:0/961878468 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbd98138750 con 0x7fbd70004b20 2020-04-02T23:21:45.008 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.005+0000 7fbd9659c700 1 --2- 172.21.15.174:0/961878468 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbd70004b20 0x7fbd70004f40 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7fbd88000e90 tx=0x7fbd88010a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:45.008 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.005+0000 7fbd8ffff700 1 -- 172.21.15.174:0/961878468 <== mon.0 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+10 (secure 0 0 0) 0x7fbd8803f620 con 0x7fbd70004b20 2020-04-02T23:21:45.008 INFO:teuthology.orchestra.run.smithi174.stdout:pg_num: 8 2020-04-02T23:21:45.010 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.006+0000 7fbd9cd39700 1 -- 172.21.15.174:0/961878468 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fbd70055de0 msgr2=0x7fbd700582a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:45.010 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.006+0000 7fbd9cd39700 1 --2- 172.21.15.174:0/961878468 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fbd70055de0 0x7fbd700582a0 secure :-1 s=READY pgs=63 cs=0 l=1 rx=0x7fbd80000b80 tx=0x7fbd80001a00).stop 2020-04-02T23:21:45.010 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.006+0000 7fbd9cd39700 1 -- 172.21.15.174:0/961878468 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbd70004b20 msgr2=0x7fbd70004f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:45.010 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.006+0000 7fbd9cd39700 1 --2- 172.21.15.174:0/961878468 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbd70004b20 0x7fbd70004f40 secure :-1 s=READY pgs=110 cs=0 l=1 rx=0x7fbd88000e90 tx=0x7fbd88010a60).stop 2020-04-02T23:21:45.010 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.006+0000 7fbd96d9d700 1 -- 172.21.15.174:0/961878468 reap_dead start 2020-04-02T23:21:45.010 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.006+0000 7fbd9cd39700 1 -- 172.21.15.174:0/961878468 shutdown_connections 2020-04-02T23:21:45.010 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.006+0000 7fbd9cd39700 1 -- 172.21.15.174:0/961878468 >> 172.21.15.174:0/961878468 conn(0x7fbd980aaf80 msgr2=0x7fbd9805b220 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:45.011 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.006+0000 7fbd9cd39700 1 -- 172.21.15.174:0/961878468 shutdown_connections 2020-04-02T23:21:45.011 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.006+0000 7fbd9cd39700 1 -- 172.21.15.174:0/961878468 wait complete. 2020-04-02T23:21:45.019 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2020-04-02T23:21:45.019 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2020-04-02T23:21:45.020 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:45.033 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mgr dump --format=json 2020-04-02T23:21:45.179 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.177+0000 7efe8bd24700 1 Processor -- start 2020-04-02T23:21:45.179 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.177+0000 7efe8bd24700 1 -- start start 2020-04-02T23:21:45.186 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.177+0000 7efe8bd24700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7efe840a5f00 0x7efe840a9a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:45.186 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.177+0000 7efe8bd24700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7efe840a62e0 0x7efe8405ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:45.186 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.177+0000 7efe8bd24700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe840a9150 con 0x7efe8413b600 2020-04-02T23:21:45.186 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.177+0000 7efe8bd24700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe840aa720 con 0x7efe840a62e0 2020-04-02T23:21:45.186 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.177+0000 7efe8bd24700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe840a6770 con 0x7efe840a5f00 2020-04-02T23:21:45.187 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.178+0000 7efe892bf700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7efe840a62e0 0x7efe8405ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:45.187 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.178+0000 7efe892bf700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7efe840a62e0 0x7efe8405ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:39786/0 (socket says 172.21.15.174:39786) 2020-04-02T23:21:45.187 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.178+0000 7efe892bf700 1 -- 172.21.15.174:0/1307768950 learned_addr learned my addr 172.21.15.174:0/1307768950 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:21:45.187 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.178+0000 7efe89ac0700 1 --2- 172.21.15.174:0/1307768950 >> v2:172.21.15.196:3300/0 conn(0x7efe840a5f00 0x7efe840a9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:45.187 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.178+0000 7efe892bf700 1 -- 172.21.15.174:0/1307768950 >> v2:172.21.15.196:3300/0 conn(0x7efe840a5f00 msgr2=0x7efe840a9a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:45.187 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.178+0000 7efe892bf700 1 --2- 172.21.15.174:0/1307768950 >> v2:172.21.15.196:3300/0 conn(0x7efe840a5f00 0x7efe840a9a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:45.187 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.178+0000 7efe892bf700 1 -- 172.21.15.174:0/1307768950 >> v1:172.21.15.196:6789/0 conn(0x7efe8413b600 legacy=0x7efe84138070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:45.188 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.178+0000 7efe892bf700 1 -- 172.21.15.174:0/1307768950 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe8405c3b0 con 0x7efe840a62e0 2020-04-02T23:21:45.188 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.178+0000 7efe89ac0700 1 --2- 172.21.15.174:0/1307768950 >> v2:172.21.15.196:3300/0 conn(0x7efe840a5f00 0x7efe840a9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-02T23:21:45.188 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.178+0000 7efe892bf700 1 --2- 172.21.15.174:0/1307768950 >> v2:172.21.15.174:3300/0 conn(0x7efe840a62e0 0x7efe8405ffc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7efe8405b340 tx=0x7efe74007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:45.188 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.178+0000 7efe892bf700 1 --2- 172.21.15.174:0/1307768950 >> v2:172.21.15.174:3300/0 conn(0x7efe840a62e0 0x7efe8405ffc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7efe8405b340 tx=0x7efe74007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:45.188 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.178+0000 7efe892bf700 1 --2- 172.21.15.174:0/1307768950 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe840a62e0 0x7efe8405ffc0 secure :-1 s=READY pgs=111 cs=0 l=1 rx=0x7efe8405b340 tx=0x7efe74007a40).ready entity=mon.0 client_cookie=7b253ce026ec40f5 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:45.188 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.178+0000 7efe892bf700 1 --2- 172.21.15.174:0/1307768950 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe840a62e0 0x7efe8405ffc0 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7efe8405b340 tx=0x7efe74007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:45.188 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.178+0000 7efe88abe700 1 -- 172.21.15.174:0/1307768950 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe740116e0 con 0x7efe840a62e0 2020-04-02T23:21:45.189 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.178+0000 7efe892bf700 1 --2- 172.21.15.174:0/1307768950 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe840a62e0 0x7efe8405ffc0 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7efe8405b340 tx=0x7efe74007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:45.189 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.178+0000 7efe88abe700 1 -- 172.21.15.174:0/1307768950 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe74011840 con 0x7efe840a62e0 2020-04-02T23:21:45.189 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.178+0000 7efe892bf700 1 --2- 172.21.15.174:0/1307768950 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe840a62e0 0x7efe8405ffc0 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7efe8405b340 tx=0x7efe74007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:45.189 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.178+0000 7efe8bd24700 1 -- 172.21.15.174:0/1307768950 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe840a62e0 msgr2=0x7efe8405ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:45.189 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.178+0000 7efe88abe700 1 -- 172.21.15.174:0/1307768950 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe74011c20 con 0x7efe840a62e0 2020-04-02T23:21:45.189 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.178+0000 7efe8bd24700 1 --2- 172.21.15.174:0/1307768950 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe840a62e0 0x7efe8405ffc0 secure :-1 s=READY pgs=111 cs=0 l=1 rx=0x7efe8405b340 tx=0x7efe74007a40).stop 2020-04-02T23:21:45.189 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.179+0000 7efe8bd24700 1 -- 172.21.15.174:0/1307768950 shutdown_connections 2020-04-02T23:21:45.190 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.179+0000 7efe8bd24700 1 --2- 172.21.15.174:0/1307768950 >> v2:172.21.15.196:3300/0 conn(0x7efe840a5f00 0x7efe840a9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:45.190 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.179+0000 7efe8bd24700 1 --2- 172.21.15.174:0/1307768950 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe840a62e0 0x7efe8405ffc0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:45.190 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.179+0000 7efe8bd24700 1 -- 172.21.15.174:0/1307768950 >> 172.21.15.174:0/1307768950 conn(0x7efe840ab320 msgr2=0x7efe840ab730 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:45.190 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.179+0000 7efe8bd24700 1 -- 172.21.15.174:0/1307768950 shutdown_connections 2020-04-02T23:21:45.190 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.179+0000 7efe8bd24700 1 -- 172.21.15.174:0/1307768950 wait complete. 2020-04-02T23:21:45.190 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.180+0000 7efe8bd24700 1 Processor -- start 2020-04-02T23:21:45.190 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.180+0000 7efe8bd24700 1 -- start start 2020-04-02T23:21:45.190 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.180+0000 7efe8bd24700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7efe840a5f00 0x7efe840a2e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:45.191 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.180+0000 7efe8bd24700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7efe840a62e0 0x7efe84148fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:45.191 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.180+0000 7efe8bd24700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe840a3450 con 0x7efe8413b600 2020-04-02T23:21:45.191 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.180+0000 7efe8bd24700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe84148b30 con 0x7efe840a5f00 2020-04-02T23:21:45.191 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.180+0000 7efe8bd24700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe84137bd0 con 0x7efe840a62e0 2020-04-02T23:21:45.191 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.180+0000 7efe89ac0700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7efe840a5f00 0x7efe840a2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:45.191 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.180+0000 7efe89ac0700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7efe840a5f00 0x7efe840a2e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:39790/0 (socket says 172.21.15.174:39790) 2020-04-02T23:21:45.191 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.180+0000 7efe89ac0700 1 -- 172.21.15.174:0/2813632346 learned_addr learned my addr 172.21.15.174:0/2813632346 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:21:45.192 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.180+0000 7efe8a2c1700 1 --1- 172.21.15.174:0/2813632346 >> v1:172.21.15.174:6789/0 conn(0x7efe8413b600 0x7efe84137f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:44832/0 (socket says 172.21.15.174:44832) 2020-04-02T23:21:45.192 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.180+0000 7efe892bf700 1 --2- 172.21.15.174:0/2813632346 >> v2:172.21.15.196:3300/0 conn(0x7efe840a62e0 0x7efe84148fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:45.192 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.180+0000 7efe89ac0700 1 -- 172.21.15.174:0/2813632346 >> v2:172.21.15.196:3300/0 conn(0x7efe840a62e0 msgr2=0x7efe84148fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:45.192 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.180+0000 7efe89ac0700 1 --2- 172.21.15.174:0/2813632346 >> v2:172.21.15.196:3300/0 conn(0x7efe840a62e0 0x7efe84148fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:45.192 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.180+0000 7efe89ac0700 1 -- 172.21.15.174:0/2813632346 >> v1:172.21.15.174:6789/0 conn(0x7efe8413b600 legacy=0x7efe84137f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:45.192 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.180+0000 7efe72ffd700 1 -- 172.21.15.174:0/2813632346 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2936129144 0 0) 0x7efe840a3450 con 0x7efe8413b600 2020-04-02T23:21:45.192 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.180+0000 7efe89ac0700 1 -- 172.21.15.174:0/2813632346 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe84134c50 con 0x7efe840a5f00 2020-04-02T23:21:45.193 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.181+0000 7efe89ac0700 1 --2- 172.21.15.174:0/2813632346 >> v2:172.21.15.174:3300/0 conn(0x7efe840a5f00 0x7efe840a2e60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efe84135370 tx=0x7efe840445b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:45.193 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.181+0000 7efe89ac0700 1 --2- 172.21.15.174:0/2813632346 >> v2:172.21.15.174:3300/0 conn(0x7efe840a5f00 0x7efe840a2e60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efe84135370 tx=0x7efe840445b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:45.193 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.181+0000 7efe89ac0700 1 --2- 172.21.15.174:0/2813632346 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe840a5f00 0x7efe840a2e60 secure :-1 s=READY pgs=113 cs=0 l=1 rx=0x7efe84135370 tx=0x7efe840445b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:45.193 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.181+0000 7efe89ac0700 1 --2- 172.21.15.174:0/2813632346 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe840a5f00 0x7efe840a2e60 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7efe84135370 tx=0x7efe840445b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:45.193 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.181+0000 7efe72ffd700 1 -- 172.21.15.174:0/2813632346 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe80007350 con 0x7efe840a5f00 2020-04-02T23:21:45.193 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.181+0000 7efe89ac0700 1 --2- 172.21.15.174:0/2813632346 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe840a5f00 0x7efe840a2e60 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7efe84135370 tx=0x7efe840445b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:45.193 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.181+0000 7efe89ac0700 1 --2- 172.21.15.174:0/2813632346 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe840a5f00 0x7efe840a2e60 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7efe84135370 tx=0x7efe840445b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:45.193 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.181+0000 7efe72ffd700 1 -- 172.21.15.174:0/2813632346 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe800074b0 con 0x7efe840a5f00 2020-04-02T23:21:45.194 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.181+0000 7efe8bd24700 1 -- 172.21.15.174:0/2813632346 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe841372f0 con 0x7efe840a5f00 2020-04-02T23:21:45.194 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.181+0000 7efe72ffd700 1 -- 172.21.15.174:0/2813632346 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe80007890 con 0x7efe840a5f00 2020-04-02T23:21:45.194 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.181+0000 7efe8bd24700 1 -- 172.21.15.174:0/2813632346 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe84149670 con 0x7efe840a5f00 2020-04-02T23:21:45.194 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.182+0000 7efe89ac0700 1 --2- 172.21.15.174:0/2813632346 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe840a5f00 0x7efe840a2e60 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7efe84135370 tx=0x7efe840445b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:45.194 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.182+0000 7efe72ffd700 1 -- 172.21.15.174:0/2813632346 <== mon.0 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7efe80012490 con 0x7efe840a5f00 2020-04-02T23:21:45.194 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.182+0000 7efe89ac0700 1 --2- 172.21.15.174:0/2813632346 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe840a5f00 0x7efe840a2e60 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7efe84135370 tx=0x7efe840445b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:45.194 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.182+0000 7efe8bd24700 1 -- 172.21.15.174:0/2813632346 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe84056c50 con 0x7efe840a5f00 2020-04-02T23:21:45.195 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.182+0000 7efe72ffd700 1 --2- 172.21.15.174:0/2813632346 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7efe6404d420 0x7efe6404f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:45.195 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.182+0000 7efe72ffd700 1 -- 172.21.15.174:0/2813632346 <== mon.0 v2:172.21.15.174:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7efe800610c0 con 0x7efe840a5f00 2020-04-02T23:21:45.195 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.183+0000 7efe892bf700 1 --2- 172.21.15.174:0/2813632346 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7efe6404d420 0x7efe6404f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:45.195 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.183+0000 7efe892bf700 1 --2- 172.21.15.174:0/2813632346 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7efe6404d420 0x7efe6404f8e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efe8405b340 tx=0x7efe74007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:45.195 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.183+0000 7efe892bf700 1 --2- 172.21.15.174:0/2813632346 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7efe6404d420 0x7efe6404f8e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efe8405b340 tx=0x7efe74007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:45.195 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.183+0000 7efe892bf700 1 --2- 172.21.15.174:0/2813632346 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7efe6404d420 0x7efe6404f8e0 secure :-1 s=READY pgs=65 cs=0 l=1 rx=0x7efe8405b340 tx=0x7efe74007a40).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:45.196 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.185+0000 7efe89ac0700 1 --2- 172.21.15.174:0/2813632346 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe840a5f00 0x7efe840a2e60 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7efe84135370 tx=0x7efe840445b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:45.196 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.186+0000 7efe72ffd700 1 -- 172.21.15.174:0/2813632346 <== mon.0 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7efe8003c880 con 0x7efe840a5f00 2020-04-02T23:21:45.359 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.357+0000 7efe8bd24700 1 -- 172.21.15.174:0/2813632346 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7efe8413c4a0 con 0x7efe840a5f00 2020-04-02T23:21:45.365 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.359+0000 7efe89ac0700 1 --2- 172.21.15.174:0/2813632346 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe840a5f00 0x7efe840a2e60 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7efe84135370 tx=0x7efe840445b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:45.366 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.359+0000 7efe72ffd700 1 -- 172.21.15.174:0/2813632346 <== mon.0 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) v1 ==== 74+0+119893 (secure 0 0 0) 0x7efe8003fea0 con 0x7efe840a5f00 2020-04-02T23:21:45.366 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.361+0000 7efe8bd24700 1 -- 172.21.15.174:0/2813632346 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7efe6404d420 msgr2=0x7efe6404f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:45.366 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.361+0000 7efe8bd24700 1 --2- 172.21.15.174:0/2813632346 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7efe6404d420 0x7efe6404f8e0 secure :-1 s=READY pgs=65 cs=0 l=1 rx=0x7efe8405b340 tx=0x7efe74007a40).stop 2020-04-02T23:21:45.366 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.361+0000 7efe8bd24700 1 -- 172.21.15.174:0/2813632346 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe840a5f00 msgr2=0x7efe840a2e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:45.366 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.361+0000 7efe8bd24700 1 --2- 172.21.15.174:0/2813632346 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe840a5f00 0x7efe840a2e60 secure :-1 s=READY pgs=113 cs=0 l=1 rx=0x7efe84135370 tx=0x7efe840445b0).stop 2020-04-02T23:21:45.366 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.361+0000 7efe8bd24700 1 -- 172.21.15.174:0/2813632346 shutdown_connections 2020-04-02T23:21:45.367 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.361+0000 7efe8bd24700 1 --2- 172.21.15.174:0/2813632346 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7efe6404d420 0x7efe6404f8e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:45.367 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.361+0000 7efe8bd24700 1 --2- 172.21.15.174:0/2813632346 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe840a5f00 0x7efe840a2e60 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:45.367 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.361+0000 7efe8bd24700 1 --2- 172.21.15.174:0/2813632346 >> v2:172.21.15.196:3300/0 conn(0x7efe840a62e0 0x7efe84148fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:45.367 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.361+0000 7efe8bd24700 1 -- 172.21.15.174:0/2813632346 >> 172.21.15.174:0/2813632346 conn(0x7efe840ab320 msgr2=0x7efe840ae000 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:45.367 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.361+0000 7efe8bd24700 1 -- 172.21.15.174:0/2813632346 shutdown_connections 2020-04-02T23:21:45.367 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.361+0000 7efe8bd24700 1 -- 172.21.15.174:0/2813632346 wait complete. 2020-04-02T23:21:45.367 INFO:teuthology.orchestra.run.smithi174.stdout: 2020-04-02T23:21:45.374 INFO:teuthology.orchestra.run.smithi174.stdout:{"epoch":4,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":23210},{"type":"v1","addr":"172.21.15.196:6801","nonce":23210}]},"active_addr":"172.21.15.196:6801/23210","active_change":"2020-04-02T23:21:22.177186+0000","active_mgr_features":4540138292836696063,"available":true,"standbys":[{"gid":4104,"name":"y","mgr_features":4540138292836696063,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","osd_support","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.196:0","nonce":2519130441}]},{"addrvec":[{"type":"v2","addr":"172.21.15.196:0","nonce":803154942}]},{"addrvec":[{"type":"v2","addr":"172.21.15.196:0","nonce":2749291226}]}]}} 2020-04-02T23:21:45.381 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2020-04-02T23:21:45.382 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2020-04-02T23:21:45.382 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:45.395 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-02T23:21:45.541 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.538+0000 7f825c716700 1 Processor -- start 2020-04-02T23:21:45.541 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.538+0000 7f825c716700 1 -- start start 2020-04-02T23:21:45.547 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.539+0000 7f825c716700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f82540a7a60 0x7f82540a38f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:45.547 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.539+0000 7f825c716700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f82540a1fe0 0x7f8254138480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:45.547 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.539+0000 7f825c716700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82540a40d0 con 0x7f82541388e0 2020-04-02T23:21:45.548 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.539+0000 7f825c716700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82540a3ec0 con 0x7f82540a7a60 2020-04-02T23:21:45.548 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.539+0000 7f825c716700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82540a4370 con 0x7f82540a1fe0 2020-04-02T23:21:45.548 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.539+0000 7f825a4b2700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f82540a7a60 0x7f82540a38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:45.548 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.539+0000 7f825a4b2700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f82540a7a60 0x7f82540a38f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:39798/0 (socket says 172.21.15.174:39798) 2020-04-02T23:21:45.548 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.539+0000 7f825a4b2700 1 -- 172.21.15.174:0/3708430463 learned_addr learned my addr 172.21.15.174:0/3708430463 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:21:45.548 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.539+0000 7f8259cb1700 1 --2- 172.21.15.174:0/3708430463 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f82540a1fe0 0x7f8254138480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:45.548 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.540+0000 7f825a4b2700 1 -- 172.21.15.174:0/3708430463 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f82540a1fe0 msgr2=0x7f8254138480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:45.549 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.540+0000 7f825a4b2700 1 --2- 172.21.15.174:0/3708430463 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f82540a1fe0 0x7f8254138480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:45.549 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.540+0000 7f825a4b2700 1 -- 172.21.15.174:0/3708430463 >> v1:172.21.15.196:6789/0 conn(0x7f82541388e0 legacy=0x7f825412e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:45.549 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.540+0000 7f825a4b2700 1 -- 172.21.15.174:0/3708430463 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8254138d50 con 0x7f82540a7a60 2020-04-02T23:21:45.549 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.540+0000 7f825a4b2700 1 --2- 172.21.15.174:0/3708430463 >> v2:172.21.15.174:3300/0 conn(0x7f82540a7a60 0x7f82540a38f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8244002f30 tx=0x7f8244007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:45.550 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.540+0000 7f825a4b2700 1 --2- 172.21.15.174:0/3708430463 >> v2:172.21.15.174:3300/0 conn(0x7f82540a7a60 0x7f82540a38f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8244002f30 tx=0x7f8244007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:45.550 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.540+0000 7f825a4b2700 1 --2- 172.21.15.174:0/3708430463 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f82540a7a60 0x7f82540a38f0 secure :-1 s=READY pgs=114 cs=0 l=1 rx=0x7f8244002f30 tx=0x7f8244007a40).ready entity=mon.0 client_cookie=8b4c1f4b3806c71b server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:45.550 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.540+0000 7f825a4b2700 1 --2- 172.21.15.174:0/3708430463 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f82540a7a60 0x7f82540a38f0 secure :-1 s=THROTTLE_DONE pgs=114 cs=0 l=1 rx=0x7f8244002f30 tx=0x7f8244007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:45.550 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.540+0000 7f82594b0700 1 -- 172.21.15.174:0/3708430463 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8244011720 con 0x7f82540a7a60 2020-04-02T23:21:45.550 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.540+0000 7f825a4b2700 1 --2- 172.21.15.174:0/3708430463 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f82540a7a60 0x7f82540a38f0 secure :-1 s=THROTTLE_DONE pgs=114 cs=0 l=1 rx=0x7f8244002f30 tx=0x7f8244007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:45.550 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.540+0000 7f825a4b2700 1 --2- 172.21.15.174:0/3708430463 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f82540a7a60 0x7f82540a38f0 secure :-1 s=THROTTLE_DONE pgs=114 cs=0 l=1 rx=0x7f8244002f30 tx=0x7f8244007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:45.550 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.540+0000 7f82594b0700 1 -- 172.21.15.174:0/3708430463 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8244011880 con 0x7f82540a7a60 2020-04-02T23:21:45.551 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.540+0000 7f82594b0700 1 -- 172.21.15.174:0/3708430463 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8244011ca0 con 0x7f82540a7a60 2020-04-02T23:21:45.551 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.540+0000 7f825c716700 1 -- 172.21.15.174:0/3708430463 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f82540a7a60 msgr2=0x7f82540a38f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:45.551 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.540+0000 7f825c716700 1 --2- 172.21.15.174:0/3708430463 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f82540a7a60 0x7f82540a38f0 secure :-1 s=READY pgs=114 cs=0 l=1 rx=0x7f8244002f30 tx=0x7f8244007a40).stop 2020-04-02T23:21:45.551 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.540+0000 7f825c716700 1 -- 172.21.15.174:0/3708430463 shutdown_connections 2020-04-02T23:21:45.551 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.540+0000 7f825c716700 1 --2- 172.21.15.174:0/3708430463 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f82540a7a60 0x7f82540a38f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:45.551 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.540+0000 7f825c716700 1 --2- 172.21.15.174:0/3708430463 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f82540a1fe0 0x7f8254138480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:45.551 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.540+0000 7f825c716700 1 -- 172.21.15.174:0/3708430463 >> 172.21.15.174:0/3708430463 conn(0x7f82540aaf80 msgr2=0x7f82540a6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:45.551 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.540+0000 7f825c716700 1 -- 172.21.15.174:0/3708430463 shutdown_connections 2020-04-02T23:21:45.552 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.541+0000 7f825c716700 1 -- 172.21.15.174:0/3708430463 wait complete. 2020-04-02T23:21:45.552 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.541+0000 7f825c716700 1 Processor -- start 2020-04-02T23:21:45.552 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.541+0000 7f825c716700 1 -- start start 2020-04-02T23:21:45.552 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.542+0000 7f825c716700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f82540a7a60 0x7f8254135040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:45.552 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.542+0000 7f825c716700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f82541388e0 0x7f82540a0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:45.552 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.542+0000 7f825c716700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8254132b40 con 0x7f82540a1fe0 2020-04-02T23:21:45.552 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.542+0000 7f825c716700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82540a0a60 con 0x7f82541388e0 2020-04-02T23:21:45.553 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.542+0000 7f825c716700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82540a0ca0 con 0x7f82540a7a60 2020-04-02T23:21:45.553 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.542+0000 7f8259cb1700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f82540a7a60 0x7f8254135040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:45.553 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.542+0000 7f825acb3700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f82541388e0 0x7f82540a0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:45.553 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.542+0000 7f8259cb1700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f82540a7a60 0x7f8254135040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.174:34394/0 (socket says 172.21.15.174:34394) 2020-04-02T23:21:45.553 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.542+0000 7f8259cb1700 1 -- 172.21.15.174:0/1596237687 learned_addr learned my addr 172.21.15.174:0/1596237687 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:21:45.554 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.542+0000 7f8259cb1700 1 -- 172.21.15.174:0/1596237687 >> v2:172.21.15.196:3300/0 conn(0x7f82541388e0 msgr2=0x7f82540a0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:45.554 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.542+0000 7f8259cb1700 1 --2- 172.21.15.174:0/1596237687 >> v2:172.21.15.196:3300/0 conn(0x7f82541388e0 0x7f82540a0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:45.554 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.542+0000 7f8259cb1700 1 -- 172.21.15.174:0/1596237687 >> v1:172.21.15.196:6789/0 conn(0x7f82540a1fe0 legacy=0x7f825409ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:45.554 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.542+0000 7f8259cb1700 1 -- 172.21.15.174:0/1596237687 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f825409e5c0 con 0x7f82540a7a60 2020-04-02T23:21:45.554 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.542+0000 7f825acb3700 1 --2- 172.21.15.174:0/1596237687 >> v2:172.21.15.196:3300/0 conn(0x7f82541388e0 0x7f82540a0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:21:45.554 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.542+0000 7f8259cb1700 1 --2- 172.21.15.174:0/1596237687 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f82540a7a60 0x7f8254135040 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8250002f30 tx=0x7f8250010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:45.554 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.543+0000 7f8259cb1700 1 --2- 172.21.15.174:0/1596237687 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f82540a7a60 0x7f8254135040 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8250002f30 tx=0x7f8250010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:45.555 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.543+0000 7f8259cb1700 1 --2- 172.21.15.174:0/1596237687 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f82540a7a60 0x7f8254135040 secure :-1 s=READY pgs=24 cs=0 l=1 rx=0x7f8250002f30 tx=0x7f8250010c70).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:45.555 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.543+0000 7f8259cb1700 1 --2- 172.21.15.174:0/1596237687 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f82540a7a60 0x7f8254135040 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7f8250002f30 tx=0x7f8250010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:45.555 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.543+0000 7f82437fe700 1 -- 172.21.15.174:0/1596237687 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82500128b0 con 0x7f82540a7a60 2020-04-02T23:21:45.555 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.543+0000 7f8259cb1700 1 --2- 172.21.15.174:0/1596237687 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f82540a7a60 0x7f8254135040 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7f8250002f30 tx=0x7f8250010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:45.555 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.543+0000 7f82437fe700 1 -- 172.21.15.174:0/1596237687 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8250012a10 con 0x7f82540a7a60 2020-04-02T23:21:45.555 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.543+0000 7f8259cb1700 1 --2- 172.21.15.174:0/1596237687 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f82540a7a60 0x7f8254135040 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7f8250002f30 tx=0x7f8250010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:45.555 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.543+0000 7f825c716700 1 -- 172.21.15.174:0/1596237687 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f825409f170 con 0x7f82540a7a60 2020-04-02T23:21:45.555 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.543+0000 7f82437fe700 1 -- 172.21.15.174:0/1596237687 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8250012e30 con 0x7f82540a7a60 2020-04-02T23:21:45.556 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.543+0000 7f825c716700 1 -- 172.21.15.174:0/1596237687 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82540a13e0 con 0x7f82540a7a60 2020-04-02T23:21:45.556 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.543+0000 7f8259cb1700 1 --2- 172.21.15.174:0/1596237687 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f82540a7a60 0x7f8254135040 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7f8250002f30 tx=0x7f8250010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:45.556 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.544+0000 7f825c716700 1 -- 172.21.15.174:0/1596237687 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8254056c50 con 0x7f82540a7a60 2020-04-02T23:21:45.556 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.544+0000 7f8259cb1700 1 --2- 172.21.15.174:0/1596237687 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f82540a7a60 0x7f8254135040 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7f8250002f30 tx=0x7f8250010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:45.556 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.544+0000 7f82437fe700 1 -- 172.21.15.174:0/1596237687 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f8250007170 con 0x7f82540a7a60 2020-04-02T23:21:45.556 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.544+0000 7f82437fe700 1 --2- 172.21.15.174:0/1596237687 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f823404d560 0x7f823404fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:45.556 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.544+0000 7f82437fe700 1 -- 172.21.15.174:0/1596237687 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f82500612e0 con 0x7f82540a7a60 2020-04-02T23:21:45.557 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.544+0000 7f825a4b2700 1 --2- 172.21.15.174:0/1596237687 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f823404d560 0x7f823404fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:45.557 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.545+0000 7f825a4b2700 1 --2- 172.21.15.174:0/1596237687 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f823404d560 0x7f823404fa20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f825405f050 tx=0x7f8244007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:45.557 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.545+0000 7f825a4b2700 1 --2- 172.21.15.174:0/1596237687 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f823404d560 0x7f823404fa20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f825405f050 tx=0x7f8244007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:45.557 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.545+0000 7f825a4b2700 1 --2- 172.21.15.174:0/1596237687 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f823404d560 0x7f823404fa20 secure :-1 s=READY pgs=66 cs=0 l=1 rx=0x7f825405f050 tx=0x7f8244007a40).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:45.557 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.548+0000 7f8259cb1700 1 --2- 172.21.15.174:0/1596237687 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f82540a7a60 0x7f8254135040 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7f8250002f30 tx=0x7f8250010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:45.558 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.548+0000 7f82437fe700 1 -- 172.21.15.174:0/1596237687 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f825003c980 con 0x7f82540a7a60 2020-04-02T23:21:45.688 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.686+0000 7f825c716700 1 -- 172.21.15.174:0/1596237687 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f82540a26f0 con 0x7f82540a7a60 2020-04-02T23:21:45.690 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.687+0000 7f8259cb1700 1 --2- 172.21.15.174:0/1596237687 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f82540a7a60 0x7f8254135040 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7f8250002f30 tx=0x7f8250010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:45.690 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.687+0000 7f82437fe700 1 -- 172.21.15.174:0/1596237687 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16134 (secure 0 0 0) 0x7f825003ffa0 con 0x7f82540a7a60 2020-04-02T23:21:45.690 INFO:teuthology.orchestra.run.smithi174.stdout: 2020-04-02T23:21:45.690 INFO:teuthology.orchestra.run.smithi174.stdout:{"epoch":23,"fsid":"06504ece-4284-40ba-b298-58864abc4224","created":"2020-04-02T23:21:19.153932+0000","modified":"2020-04-02T23:21:41.535533+0000","last_up_change":"2020-04-02T23:21:29.337390+0000","last_in_change":"2020-04-02T23:21:29.337390+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-02T23:21:22.199702+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-02T23:21:35.314601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-04-02T23:21:38.762876+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-04-02T23:21:39.474986+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c9d748ee-c52f-4f21-b8c9-2a53a937be1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":24590},{"type":"v1","addr":"172.21.15.174:6801","nonce":24590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":24590},{"type":"v1","addr":"172.21.15.174:6803","nonce":24590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":24590},{"type":"v1","addr":"172.21.15.174:6807","nonce":24590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":24590},{"type":"v1","addr":"172.21.15.174:6805","nonce":24590}]},"public_addr":"172.21.15.174:6801/24590","cluster_addr":"172.21.15.174:6803/24590","heartbeat_back_addr":"172.21.15.174:6807/24590","heartbeat_front_addr":"172.21.15.174:6805/24590","state":["exists","up"]},{"osd":1,"uuid":"27c05faf-11f5-4cef-9bde-1a6653a9e533","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":24754},{"type":"v1","addr":"172.21.15.174:6809","nonce":24754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":24754},{"type":"v1","addr":"172.21.15.174:6811","nonce":24754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":24754},{"type":"v1","addr":"172.21.15.174:6815","nonce":24754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":24754},{"type":"v1","addr":"172.21.15.174:6813","nonce":24754}]},"public_addr":"172.21.15.174:6809/24754","cluster_addr":"172.21.15.174:6811/24754","heartbeat_back_addr":"172.21.15.174:6815/24754","heartbeat_front_addr":"172.21.15.174:6813/24754","state":["exists","up"]},{"osd":2,"uuid":"02b1b455-b518-4393-b257-40c3a76af157","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":24781},{"type":"v1","addr":"172.21.15.174:6817","nonce":24781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":24781},{"type":"v1","addr":"172.21.15.174:6819","nonce":24781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":24781},{"type":"v1","addr":"172.21.15.174:6823","nonce":24781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":24781},{"type":"v1","addr":"172.21.15.174:6821","nonce":24781}]},"public_addr":"172.21.15.174:6817/24781","cluster_addr":"172.21.15.174:6819/24781","heartbeat_back_addr":"172.21.15.174:6823/24781","heartbeat_front_addr":"172.21.15.174:6821/24781","state":["exists","up"]},{"osd":3,"uuid":"d7fb3499-9e13-4076-b3cf-28f27eb62967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":24972},{"type":"v1","addr":"172.21.15.174:6825","nonce":24972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":24972},{"type":"v1","addr":"172.21.15.174:6827","nonce":24972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":24972},{"type":"v1","addr":"172.21.15.174:6831","nonce":24972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":24972},{"type":"v1","addr":"172.21.15.174:6829","nonce":24972}]},"public_addr":"172.21.15.174:6825/24972","cluster_addr":"172.21.15.174:6827/24972","heartbeat_back_addr":"172.21.15.174:6831/24972","heartbeat_front_addr":"172.21.15.174:6829/24972","state":["exists","up"]},{"osd":4,"uuid":"16923c47-2f21-43ea-9647-5ead4b1b2101","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":24034},{"type":"v1","addr":"172.21.15.196:6803","nonce":24034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":24034},{"type":"v1","addr":"172.21.15.196:6805","nonce":24034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":24034},{"type":"v1","addr":"172.21.15.196:6809","nonce":24034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":24034},{"type":"v1","addr":"172.21.15.196:6807","nonce":24034}]},"public_addr":"172.21.15.196:6803/24034","cluster_addr":"172.21.15.196:6805/24034","heartbeat_back_addr":"172.21.15.196:6809/24034","heartbeat_front_addr":"172.21.15.196:6807/24034","state":["exists","up"]},{"osd":5,"uuid":"7cf2859b-2226-4908-8d70-6e699d1acb0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":24190},{"type":"v1","addr":"172.21.15.196:6811","nonce":24190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":24190},{"type":"v1","addr":"172.21.15.196:6813","nonce":24190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":24190},{"type":"v1","addr":"172.21.15.196:6817","nonce":24190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":24190},{"type":"v1","addr":"172.21.15.196:6815","nonce":24190}]},"public_addr":"172.21.15.196:6811/24190","cluster_addr":"172.21.15.196:6813/24190","heartbeat_back_addr":"172.21.15.196:6817/24190","heartbeat_front_addr":"172.21.15.196:6815/24190","state":["exists","up"]},{"osd":6,"uuid":"441081ef-133a-41ec-8041-094e129707e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":24212},{"type":"v1","addr":"172.21.15.196:6819","nonce":24212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":24212},{"type":"v1","addr":"172.21.15.196:6821","nonce":24212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":24212},{"type":"v1","addr":"172.21.15.196:6825","nonce":24212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":24212},{"type":"v1","addr":"172.21.15.196:6823","nonce":24212}]},"public_addr":"172.21.15.196:6819/24212","cluster_addr":"172.21.15.196:6821/24212","heartbeat_back_addr":"172.21.15.196:6825/24212","heartbeat_front_addr":"172.21.15.196:6823/24212","state":["exists","up"]},{"osd":7,"uuid":"17ee8d46-46bf-4ef0-8d02-82cbc4ef5a5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":24408},{"type":"v1","addr":"172.21.15.196:6827","nonce":24408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":24408},{"type":"v1","addr":"172.21.15.196:6829","nonce":24408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":24408},{"type":"v1","addr":"172.21.15.196:6833","nonce":24408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":24408},{"type":"v1","addr":"172.21.15.196:6831","nonce":24408}]},"public_addr":"172.21.15.196:6827/24408","cluster_addr":"172.21.15.196:6829/24408","heartbeat_back_addr":"172.21.15.196:6833/24408","heartbeat_front_addr":"172.21.15.196:6831/24408","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.725574+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.732598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.775890+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.854998+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.545334+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.591623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.627501+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.614807+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-02T23:21:45.692 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.689+0000 7f825c716700 1 -- 172.21.15.174:0/1596237687 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f823404d560 msgr2=0x7f823404fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:45.692 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.689+0000 7f825c716700 1 --2- 172.21.15.174:0/1596237687 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f823404d560 0x7f823404fa20 secure :-1 s=READY pgs=66 cs=0 l=1 rx=0x7f825405f050 tx=0x7f8244007a40).stop 2020-04-02T23:21:45.692 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.689+0000 7f825c716700 1 -- 172.21.15.174:0/1596237687 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f82540a7a60 msgr2=0x7f8254135040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:45.692 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.689+0000 7f825c716700 1 --2- 172.21.15.174:0/1596237687 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f82540a7a60 0x7f8254135040 secure :-1 s=READY pgs=24 cs=0 l=1 rx=0x7f8250002f30 tx=0x7f8250010c70).stop 2020-04-02T23:21:45.692 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.689+0000 7f825c716700 1 -- 172.21.15.174:0/1596237687 shutdown_connections 2020-04-02T23:21:45.692 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.689+0000 7f825c716700 1 --2- 172.21.15.174:0/1596237687 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f823404d560 0x7f823404fa20 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:45.693 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.689+0000 7f825c716700 1 --2- 172.21.15.174:0/1596237687 >> v2:172.21.15.196:3300/0 conn(0x7f82541388e0 0x7f82540a0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:45.693 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.689+0000 7f825c716700 1 --2- 172.21.15.174:0/1596237687 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f82540a7a60 0x7f8254135040 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:45.693 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.689+0000 7f825c716700 1 -- 172.21.15.174:0/1596237687 >> 172.21.15.174:0/1596237687 conn(0x7f82540aaf80 msgr2=0x7f8254137960 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:45.693 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.689+0000 7f825c716700 1 -- 172.21.15.174:0/1596237687 shutdown_connections 2020-04-02T23:21:45.693 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.689+0000 7f825c716700 1 -- 172.21.15.174:0/1596237687 wait complete. 2020-04-02T23:21:45.702 INFO:tasks.ceph.ceph_manager.ceph:all up! 2020-04-02T23:21:45.702 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:45.715 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-02T23:21:45.860 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.858+0000 7fae58c86700 1 Processor -- start 2020-04-02T23:21:45.860 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.858+0000 7fae58c86700 1 -- start start 2020-04-02T23:21:45.863 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.858+0000 7fae58c86700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fae540a38f0 0x7fae54138480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:45.863 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.858+0000 7fae58c86700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fae541388e0 0x7fae54134d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:45.863 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.858+0000 7fae58c86700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae540a3e30 con 0x7fae540a7a60 2020-04-02T23:21:45.864 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.858+0000 7fae58c86700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae540a40d0 con 0x7fae540a38f0 2020-04-02T23:21:45.864 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.858+0000 7fae58c86700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae540a4370 con 0x7fae541388e0 2020-04-02T23:21:45.864 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.859+0000 7fae51d9b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fae540a38f0 0x7fae54138480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:45.864 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.859+0000 7fae51d9b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fae540a38f0 0x7fae54138480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:39812/0 (socket says 172.21.15.174:39812) 2020-04-02T23:21:45.864 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.859+0000 7fae51d9b700 1 -- 172.21.15.174:0/3422980853 learned_addr learned my addr 172.21.15.174:0/3422980853 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:21:45.864 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.859+0000 7fae52d9d700 1 --2- 172.21.15.174:0/3422980853 >> v2:172.21.15.196:3300/0 conn(0x7fae541388e0 0x7fae54134d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:45.864 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.859+0000 7fae51d9b700 1 -- 172.21.15.174:0/3422980853 >> v2:172.21.15.196:3300/0 conn(0x7fae541388e0 msgr2=0x7fae54134d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:45.865 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.859+0000 7fae51d9b700 1 --2- 172.21.15.174:0/3422980853 >> v2:172.21.15.196:3300/0 conn(0x7fae541388e0 0x7fae54134d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:45.865 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.859+0000 7fae51d9b700 1 -- 172.21.15.174:0/3422980853 >> v1:172.21.15.196:6789/0 conn(0x7fae540a7a60 legacy=0x7fae540a1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:45.865 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.859+0000 7fae51d9b700 1 -- 172.21.15.174:0/3422980853 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae54138d50 con 0x7fae540a38f0 2020-04-02T23:21:45.865 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.859+0000 7fae51d9b700 1 --2- 172.21.15.174:0/3422980853 >> v2:172.21.15.174:3300/0 conn(0x7fae540a38f0 0x7fae54138480 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fae54069f20 tx=0x7fae44007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:45.865 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.859+0000 7fae51d9b700 1 --2- 172.21.15.174:0/3422980853 >> v2:172.21.15.174:3300/0 conn(0x7fae540a38f0 0x7fae54138480 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fae54069f20 tx=0x7fae44007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:45.865 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.859+0000 7fae51d9b700 1 --2- 172.21.15.174:0/3422980853 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae540a38f0 0x7fae54138480 secure :-1 s=READY pgs=115 cs=0 l=1 rx=0x7fae54069f20 tx=0x7fae44007a40).ready entity=mon.0 client_cookie=99f8cbf3524af85e server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:45.865 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.859+0000 7fae51d9b700 1 --2- 172.21.15.174:0/3422980853 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae540a38f0 0x7fae54138480 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7fae54069f20 tx=0x7fae44007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:45.865 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.859+0000 7fae51d9b700 1 --2- 172.21.15.174:0/3422980853 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae540a38f0 0x7fae54138480 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7fae54069f20 tx=0x7fae44007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:45.866 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.859+0000 7fae5159a700 1 -- 172.21.15.174:0/3422980853 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae440116e0 con 0x7fae540a38f0 2020-04-02T23:21:45.866 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.859+0000 7fae51d9b700 1 --2- 172.21.15.174:0/3422980853 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae540a38f0 0x7fae54138480 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7fae54069f20 tx=0x7fae44007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:45.866 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.859+0000 7fae5159a700 1 -- 172.21.15.174:0/3422980853 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae44011840 con 0x7fae540a38f0 2020-04-02T23:21:45.867 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.859+0000 7fae5159a700 1 -- 172.21.15.174:0/3422980853 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae44011c20 con 0x7fae540a38f0 2020-04-02T23:21:45.867 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.859+0000 7fae58c86700 1 -- 172.21.15.174:0/3422980853 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae540a38f0 msgr2=0x7fae54138480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:45.867 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.859+0000 7fae58c86700 1 --2- 172.21.15.174:0/3422980853 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae540a38f0 0x7fae54138480 secure :-1 s=READY pgs=115 cs=0 l=1 rx=0x7fae54069f20 tx=0x7fae44007a40).stop 2020-04-02T23:21:45.867 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.860+0000 7fae58c86700 1 -- 172.21.15.174:0/3422980853 shutdown_connections 2020-04-02T23:21:45.867 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.860+0000 7fae58c86700 1 --2- 172.21.15.174:0/3422980853 >> v2:172.21.15.196:3300/0 conn(0x7fae541388e0 0x7fae54134d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:45.867 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.860+0000 7fae58c86700 1 --2- 172.21.15.174:0/3422980853 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae540a38f0 0x7fae54138480 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:45.867 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.860+0000 7fae58c86700 1 -- 172.21.15.174:0/3422980853 >> 172.21.15.174:0/3422980853 conn(0x7fae540aaf80 msgr2=0x7fae540a6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:45.868 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.860+0000 7fae58c86700 1 -- 172.21.15.174:0/3422980853 shutdown_connections 2020-04-02T23:21:45.868 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.860+0000 7fae58c86700 1 -- 172.21.15.174:0/3422980853 wait complete. 2020-04-02T23:21:45.868 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.861+0000 7fae58c86700 1 Processor -- start 2020-04-02T23:21:45.868 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.861+0000 7fae58c86700 1 -- start start 2020-04-02T23:21:45.871 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.861+0000 7fae58c86700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fae540a7a60 0x7fae5412d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:45.871 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.861+0000 7fae58c86700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae540666e0 con 0x7fae540a38f0 2020-04-02T23:21:45.872 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.861+0000 7fae58c86700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae54134f00 con 0x7fae541388e0 2020-04-02T23:21:45.872 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.861+0000 7fae58c86700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae541351a0 con 0x7fae540a7a60 2020-04-02T23:21:45.872 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.861+0000 7fae51d9b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fae540a7a60 0x7fae5412d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:45.872 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.861+0000 7fae51d9b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fae540a7a60 0x7fae5412d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:39818/0 (socket says 172.21.15.174:39818) 2020-04-02T23:21:45.872 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.861+0000 7fae51d9b700 1 -- 172.21.15.174:0/2215513153 learned_addr learned my addr 172.21.15.174:0/2215513153 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:21:45.872 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.861+0000 7fae51d9b700 1 -- 172.21.15.174:0/2215513153 >> v1:172.21.15.196:6789/0 conn(0x7fae541388e0 legacy=0x7fae5412db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:45.873 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.861+0000 7fae51d9b700 1 -- 172.21.15.174:0/2215513153 >> v1:172.21.15.174:6789/0 conn(0x7fae540a38f0 legacy=0x7fae54132f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:45.873 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.861+0000 7fae437fe700 1 -- 172.21.15.174:0/2215513153 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1291660844 0 0) 0x7fae540666e0 con 0x7fae540a38f0 2020-04-02T23:21:45.873 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.861+0000 7fae51d9b700 1 -- 172.21.15.174:0/2215513153 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae54135aa0 con 0x7fae540a7a60 2020-04-02T23:21:45.873 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.861+0000 7fae51d9b700 1 --2- 172.21.15.174:0/2215513153 >> v2:172.21.15.174:3300/0 conn(0x7fae540a7a60 0x7fae5412d6b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fae54069f20 tx=0x7fae44007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:45.873 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.862+0000 7fae51d9b700 1 --2- 172.21.15.174:0/2215513153 >> v2:172.21.15.174:3300/0 conn(0x7fae540a7a60 0x7fae5412d6b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fae54069f20 tx=0x7fae44007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:45.873 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.862+0000 7fae51d9b700 1 --2- 172.21.15.174:0/2215513153 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae540a7a60 0x7fae5412d6b0 secure :-1 s=READY pgs=117 cs=0 l=1 rx=0x7fae54069f20 tx=0x7fae44007a40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:45.873 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.862+0000 7fae51d9b700 1 --2- 172.21.15.174:0/2215513153 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae540a7a60 0x7fae5412d6b0 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7fae54069f20 tx=0x7fae44007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:45.874 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.862+0000 7fae437fe700 1 -- 172.21.15.174:0/2215513153 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae44007340 con 0x7fae540a7a60 2020-04-02T23:21:45.874 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.862+0000 7fae51d9b700 1 --2- 172.21.15.174:0/2215513153 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae540a7a60 0x7fae5412d6b0 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7fae54069f20 tx=0x7fae44007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:45.874 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.862+0000 7fae51d9b700 1 --2- 172.21.15.174:0/2215513153 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae540a7a60 0x7fae5412d6b0 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7fae54069f20 tx=0x7fae44007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:45.874 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.862+0000 7fae437fe700 1 -- 172.21.15.174:0/2215513153 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae440074a0 con 0x7fae540a7a60 2020-04-02T23:21:45.874 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.862+0000 7fae437fe700 1 -- 172.21.15.174:0/2215513153 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae440058b0 con 0x7fae540a7a60 2020-04-02T23:21:45.874 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.862+0000 7fae58c86700 1 -- 172.21.15.174:0/2215513153 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae54065b90 con 0x7fae540a7a60 2020-04-02T23:21:45.874 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.862+0000 7fae58c86700 1 -- 172.21.15.174:0/2215513153 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae54133690 con 0x7fae540a7a60 2020-04-02T23:21:45.875 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.862+0000 7fae51d9b700 1 --2- 172.21.15.174:0/2215513153 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae540a7a60 0x7fae5412d6b0 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7fae54069f20 tx=0x7fae44007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:45.875 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.863+0000 7fae437fe700 1 -- 172.21.15.174:0/2215513153 <== mon.0 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fae44005b20 con 0x7fae540a7a60 2020-04-02T23:21:45.875 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.863+0000 7fae51d9b700 1 --2- 172.21.15.174:0/2215513153 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae540a7a60 0x7fae5412d6b0 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7fae54069f20 tx=0x7fae44007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:45.875 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.863+0000 7fae58c86700 1 -- 172.21.15.174:0/2215513153 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae54056c50 con 0x7fae540a7a60 2020-04-02T23:21:45.875 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.863+0000 7fae437fe700 1 --2- 172.21.15.174:0/2215513153 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fae3004d350 0x7fae3004f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:45.875 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.863+0000 7fae437fe700 1 -- 172.21.15.174:0/2215513153 <== mon.0 v2:172.21.15.174:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fae44061670 con 0x7fae540a7a60 2020-04-02T23:21:45.875 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.863+0000 7fae5259c700 1 --2- 172.21.15.174:0/2215513153 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fae3004d350 0x7fae3004f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:45.876 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.863+0000 7fae5259c700 1 --2- 172.21.15.174:0/2215513153 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fae3004d350 0x7fae3004f810 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fae48001020 tx=0x7fae480015f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:45.876 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.863+0000 7fae5259c700 1 --2- 172.21.15.174:0/2215513153 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fae3004d350 0x7fae3004f810 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fae48001020 tx=0x7fae480015f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:45.876 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.864+0000 7fae5259c700 1 --2- 172.21.15.174:0/2215513153 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fae3004d350 0x7fae3004f810 secure :-1 s=READY pgs=67 cs=0 l=1 rx=0x7fae48001020 tx=0x7fae480015f0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:45.876 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.866+0000 7fae51d9b700 1 --2- 172.21.15.174:0/2215513153 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae540a7a60 0x7fae5412d6b0 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7fae54069f20 tx=0x7fae44007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:45.876 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:45.866+0000 7fae437fe700 1 -- 172.21.15.174:0/2215513153 <== mon.0 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fae4403ce90 con 0x7fae540a7a60 2020-04-02T23:21:46.005 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.003+0000 7fae58c86700 1 -- 172.21.15.174:0/2215513153 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fae54134cd0 con 0x7fae540a7a60 2020-04-02T23:21:46.006 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.004+0000 7fae51d9b700 1 --2- 172.21.15.174:0/2215513153 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae540a7a60 0x7fae5412d6b0 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7fae54069f20 tx=0x7fae44007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:46.006 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.004+0000 7fae437fe700 1 -- 172.21.15.174:0/2215513153 <== mon.0 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16134 (secure 0 0 0) 0x7fae440404b0 con 0x7fae540a7a60 2020-04-02T23:21:46.007 INFO:teuthology.orchestra.run.smithi174.stdout: 2020-04-02T23:21:46.007 INFO:teuthology.orchestra.run.smithi174.stdout:{"epoch":23,"fsid":"06504ece-4284-40ba-b298-58864abc4224","created":"2020-04-02T23:21:19.153932+0000","modified":"2020-04-02T23:21:41.535533+0000","last_up_change":"2020-04-02T23:21:29.337390+0000","last_in_change":"2020-04-02T23:21:29.337390+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-02T23:21:22.199702+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-02T23:21:35.314601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-04-02T23:21:38.762876+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-04-02T23:21:39.474986+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c9d748ee-c52f-4f21-b8c9-2a53a937be1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":24590},{"type":"v1","addr":"172.21.15.174:6801","nonce":24590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":24590},{"type":"v1","addr":"172.21.15.174:6803","nonce":24590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":24590},{"type":"v1","addr":"172.21.15.174:6807","nonce":24590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":24590},{"type":"v1","addr":"172.21.15.174:6805","nonce":24590}]},"public_addr":"172.21.15.174:6801/24590","cluster_addr":"172.21.15.174:6803/24590","heartbeat_back_addr":"172.21.15.174:6807/24590","heartbeat_front_addr":"172.21.15.174:6805/24590","state":["exists","up"]},{"osd":1,"uuid":"27c05faf-11f5-4cef-9bde-1a6653a9e533","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":24754},{"type":"v1","addr":"172.21.15.174:6809","nonce":24754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":24754},{"type":"v1","addr":"172.21.15.174:6811","nonce":24754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":24754},{"type":"v1","addr":"172.21.15.174:6815","nonce":24754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":24754},{"type":"v1","addr":"172.21.15.174:6813","nonce":24754}]},"public_addr":"172.21.15.174:6809/24754","cluster_addr":"172.21.15.174:6811/24754","heartbeat_back_addr":"172.21.15.174:6815/24754","heartbeat_front_addr":"172.21.15.174:6813/24754","state":["exists","up"]},{"osd":2,"uuid":"02b1b455-b518-4393-b257-40c3a76af157","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":24781},{"type":"v1","addr":"172.21.15.174:6817","nonce":24781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":24781},{"type":"v1","addr":"172.21.15.174:6819","nonce":24781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":24781},{"type":"v1","addr":"172.21.15.174:6823","nonce":24781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":24781},{"type":"v1","addr":"172.21.15.174:6821","nonce":24781}]},"public_addr":"172.21.15.174:6817/24781","cluster_addr":"172.21.15.174:6819/24781","heartbeat_back_addr":"172.21.15.174:6823/24781","heartbeat_front_addr":"172.21.15.174:6821/24781","state":["exists","up"]},{"osd":3,"uuid":"d7fb3499-9e13-4076-b3cf-28f27eb62967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":24972},{"type":"v1","addr":"172.21.15.174:6825","nonce":24972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":24972},{"type":"v1","addr":"172.21.15.174:6827","nonce":24972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":24972},{"type":"v1","addr":"172.21.15.174:6831","nonce":24972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":24972},{"type":"v1","addr":"172.21.15.174:6829","nonce":24972}]},"public_addr":"172.21.15.174:6825/24972","cluster_addr":"172.21.15.174:6827/24972","heartbeat_back_addr":"172.21.15.174:6831/24972","heartbeat_front_addr":"172.21.15.174:6829/24972","state":["exists","up"]},{"osd":4,"uuid":"16923c47-2f21-43ea-9647-5ead4b1b2101","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":24034},{"type":"v1","addr":"172.21.15.196:6803","nonce":24034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":24034},{"type":"v1","addr":"172.21.15.196:6805","nonce":24034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":24034},{"type":"v1","addr":"172.21.15.196:6809","nonce":24034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":24034},{"type":"v1","addr":"172.21.15.196:6807","nonce":24034}]},"public_addr":"172.21.15.196:6803/24034","cluster_addr":"172.21.15.196:6805/24034","heartbeat_back_addr":"172.21.15.196:6809/24034","heartbeat_front_addr":"172.21.15.196:6807/24034","state":["exists","up"]},{"osd":5,"uuid":"7cf2859b-2226-4908-8d70-6e699d1acb0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":24190},{"type":"v1","addr":"172.21.15.196:6811","nonce":24190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":24190},{"type":"v1","addr":"172.21.15.196:6813","nonce":24190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":24190},{"type":"v1","addr":"172.21.15.196:6817","nonce":24190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":24190},{"type":"v1","addr":"172.21.15.196:6815","nonce":24190}]},"public_addr":"172.21.15.196:6811/24190","cluster_addr":"172.21.15.196:6813/24190","heartbeat_back_addr":"172.21.15.196:6817/24190","heartbeat_front_addr":"172.21.15.196:6815/24190","state":["exists","up"]},{"osd":6,"uuid":"441081ef-133a-41ec-8041-094e129707e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":24212},{"type":"v1","addr":"172.21.15.196:6819","nonce":24212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":24212},{"type":"v1","addr":"172.21.15.196:6821","nonce":24212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":24212},{"type":"v1","addr":"172.21.15.196:6825","nonce":24212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":24212},{"type":"v1","addr":"172.21.15.196:6823","nonce":24212}]},"public_addr":"172.21.15.196:6819/24212","cluster_addr":"172.21.15.196:6821/24212","heartbeat_back_addr":"172.21.15.196:6825/24212","heartbeat_front_addr":"172.21.15.196:6823/24212","state":["exists","up"]},{"osd":7,"uuid":"17ee8d46-46bf-4ef0-8d02-82cbc4ef5a5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":24408},{"type":"v1","addr":"172.21.15.196:6827","nonce":24408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":24408},{"type":"v1","addr":"172.21.15.196:6829","nonce":24408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":24408},{"type":"v1","addr":"172.21.15.196:6833","nonce":24408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":24408},{"type":"v1","addr":"172.21.15.196:6831","nonce":24408}]},"public_addr":"172.21.15.196:6827/24408","cluster_addr":"172.21.15.196:6829/24408","heartbeat_back_addr":"172.21.15.196:6833/24408","heartbeat_front_addr":"172.21.15.196:6831/24408","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.725574+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.732598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.775890+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.854998+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.545334+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.591623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.627501+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.614807+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-02T23:21:46.008 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.005+0000 7fae58c86700 1 -- 172.21.15.174:0/2215513153 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fae3004d350 msgr2=0x7fae3004f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:46.008 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.005+0000 7fae58c86700 1 --2- 172.21.15.174:0/2215513153 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fae3004d350 0x7fae3004f810 secure :-1 s=READY pgs=67 cs=0 l=1 rx=0x7fae48001020 tx=0x7fae480015f0).stop 2020-04-02T23:21:46.008 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.005+0000 7fae58c86700 1 -- 172.21.15.174:0/2215513153 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae540a7a60 msgr2=0x7fae5412d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:46.009 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.005+0000 7fae58c86700 1 --2- 172.21.15.174:0/2215513153 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae540a7a60 0x7fae5412d6b0 secure :-1 s=READY pgs=117 cs=0 l=1 rx=0x7fae54069f20 tx=0x7fae44007a40).stop 2020-04-02T23:21:46.009 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.005+0000 7fae58c86700 1 -- 172.21.15.174:0/2215513153 shutdown_connections 2020-04-02T23:21:46.009 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.005+0000 7fae58c86700 1 --2- 172.21.15.174:0/2215513153 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fae3004d350 0x7fae3004f810 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:46.009 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.005+0000 7fae58c86700 1 --2- 172.21.15.174:0/2215513153 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae540a7a60 0x7fae5412d6b0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:46.009 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.005+0000 7fae58c86700 1 -- 172.21.15.174:0/2215513153 >> 172.21.15.174:0/2215513153 conn(0x7fae540aaf80 msgr2=0x7fae541372a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:46.009 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.005+0000 7fae58c86700 1 -- 172.21.15.174:0/2215513153 shutdown_connections 2020-04-02T23:21:46.010 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.005+0000 7fae58c86700 1 -- 172.21.15.174:0/2215513153 wait complete. 2020-04-02T23:21:46.023 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:46.036 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.0 flush_pg_stats 2020-04-02T23:21:46.189 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.179+0000 7fe585aca700 1 Processor -- start 2020-04-02T23:21:46.190 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.180+0000 7fe585aca700 1 -- start start 2020-04-02T23:21:46.190 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.180+0000 7fe585aca700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fe58005bf90 0x7fe58009e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:46.190 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.180+0000 7fe585aca700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5800a2a70 con 0x7fe58009ec70 2020-04-02T23:21:46.190 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.180+0000 7fe585aca700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe58009e140 con 0x7fe5801391b0 2020-04-02T23:21:46.190 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.180+0000 7fe585aca700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe58009e3e0 con 0x7fe58005bf90 2020-04-02T23:21:46.190 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.180+0000 7fe57ffff700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fe58009ec70 0x7fe580138aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:44862/0 (socket says 172.21.15.174:44862) 2020-04-02T23:21:46.190 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.180+0000 7fe57ffff700 1 -- 172.21.15.174:0/2393199094 learned_addr learned my addr 172.21.15.174:0/2393199094 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:21:46.191 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.180+0000 7fe584ac8700 1 --2- 172.21.15.174:0/2393199094 >> v2:172.21.15.196:3300/0 conn(0x7fe58005bf90 0x7fe58009e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:46.191 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.181+0000 7fe57f7fe700 1 -- 172.21.15.174:0/2393199094 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2016272616 0 0) 0x7fe5800a2a70 con 0x7fe58009ec70 2020-04-02T23:21:46.191 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.181+0000 7fe57f7fe700 1 -- 172.21.15.174:0/2393199094 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe56c003230 con 0x7fe58009ec70 2020-04-02T23:21:46.191 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.181+0000 7fe57f7fe700 1 -- 172.21.15.174:0/2393199094 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2444306210 0 0) 0x7fe58009e140 con 0x7fe5801391b0 2020-04-02T23:21:46.191 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.181+0000 7fe57f7fe700 1 -- 172.21.15.174:0/2393199094 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5800a2a70 con 0x7fe5801391b0 2020-04-02T23:21:46.191 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.181+0000 7fe57f7fe700 1 -- 172.21.15.174:0/2393199094 <== mon.0 v1:172.21.15.174:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 448727848 0 0) 0x7fe56c003230 con 0x7fe58009ec70 2020-04-02T23:21:46.191 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.181+0000 7fe57f7fe700 1 -- 172.21.15.174:0/2393199094 >> v2:172.21.15.196:3300/0 conn(0x7fe58005bf90 msgr2=0x7fe58009e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:46.191 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.181+0000 7fe57f7fe700 1 --2- 172.21.15.174:0/2393199094 >> v2:172.21.15.196:3300/0 conn(0x7fe58005bf90 0x7fe58009e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:46.192 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.181+0000 7fe57f7fe700 1 -- 172.21.15.174:0/2393199094 >> v1:172.21.15.196:6789/0 conn(0x7fe5801391b0 legacy=0x7fe58013fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:46.192 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.181+0000 7fe57f7fe700 1 -- 172.21.15.174:0/2393199094 --> v1:172.21.15.174:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5800a65b0 con 0x7fe58009ec70 2020-04-02T23:21:46.192 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.181+0000 7fe57f7fe700 1 -- 172.21.15.174:0/2393199094 <== mon.0 v1:172.21.15.174:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2811762909 0 0) 0x7fe5740016d0 con 0x7fe58009ec70 2020-04-02T23:21:46.192 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.181+0000 7fe57f7fe700 1 -- 172.21.15.174:0/2393199094 >> v1:172.21.15.174:6789/0 conn(0x7fe58009ec70 legacy=0x7fe580138aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:46.192 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.181+0000 7fe57f7fe700 1 --2- 172.21.15.174:0/2393199094 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe56c0038b0 0x7fe56c003cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:46.192 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.181+0000 7fe57f7fe700 1 --2- 172.21.15.174:0/2393199094 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe56c0044d0 0x7fe56c004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:46.192 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.181+0000 7fe57f7fe700 1 --2- 172.21.15.174:0/2393199094 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe56c004db0 0x7fe56c00b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:46.193 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.181+0000 7fe57f7fe700 1 -- 172.21.15.174:0/2393199094 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe58009e3e0 con 0x7fe56c0038b0 2020-04-02T23:21:46.193 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.181+0000 7fe57f7fe700 1 -- 172.21.15.174:0/2393199094 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe56c0053a0 con 0x7fe56c0044d0 2020-04-02T23:21:46.193 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.181+0000 7fe57f7fe700 1 -- 172.21.15.174:0/2393199094 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe56c00bc00 con 0x7fe56c004db0 2020-04-02T23:21:46.193 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.181+0000 7fe584ac8700 1 --2- 172.21.15.174:0/2393199094 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe56c0038b0 0x7fe56c003cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:46.193 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.181+0000 7fe57ffff700 1 --2- 172.21.15.174:0/2393199094 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe56c0044d0 0x7fe56c004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:46.193 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.181+0000 7fe5852c9700 1 --2- 172.21.15.174:0/2393199094 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe56c004db0 0x7fe56c00b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:46.193 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.181+0000 7fe584ac8700 1 -- 172.21.15.174:0/2393199094 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe56c004db0 msgr2=0x7fe56c00b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:46.194 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.181+0000 7fe584ac8700 1 --2- 172.21.15.174:0/2393199094 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe56c004db0 0x7fe56c00b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:46.194 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.181+0000 7fe584ac8700 1 -- 172.21.15.174:0/2393199094 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe56c0044d0 msgr2=0x7fe56c004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:46.194 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.181+0000 7fe584ac8700 1 --2- 172.21.15.174:0/2393199094 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe56c0044d0 0x7fe56c004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:46.194 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.181+0000 7fe584ac8700 1 -- 172.21.15.174:0/2393199094 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe56c003230 con 0x7fe56c0038b0 2020-04-02T23:21:46.194 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.181+0000 7fe5852c9700 1 -- 172.21.15.174:0/2393199094 reap_dead start 2020-04-02T23:21:46.194 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.181+0000 7fe584ac8700 1 --2- 172.21.15.174:0/2393199094 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe56c0038b0 0x7fe56c003cb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe570002f30 tx=0x7fe570010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:46.194 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.181+0000 7fe584ac8700 1 --2- 172.21.15.174:0/2393199094 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe56c0038b0 0x7fe56c003cb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe570002f30 tx=0x7fe570010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:46.194 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.181+0000 7fe584ac8700 1 --2- 172.21.15.174:0/2393199094 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe56c0038b0 0x7fe56c003cb0 secure :-1 s=READY pgs=119 cs=0 l=1 rx=0x7fe570002f30 tx=0x7fe570010020).ready entity=mon.0 client_cookie=78701eb4b021431b server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:46.195 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.181+0000 7fe584ac8700 1 --2- 172.21.15.174:0/2393199094 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe56c0038b0 0x7fe56c003cb0 secure :-1 s=THROTTLE_DONE pgs=119 cs=0 l=1 rx=0x7fe570002f30 tx=0x7fe570010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:46.195 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.181+0000 7fe57f7fe700 1 -- 172.21.15.174:0/2393199094 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe570008d30 con 0x7fe56c0038b0 2020-04-02T23:21:46.195 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.181+0000 7fe584ac8700 1 --2- 172.21.15.174:0/2393199094 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe56c0038b0 0x7fe56c003cb0 secure :-1 s=THROTTLE_DONE pgs=119 cs=0 l=1 rx=0x7fe570002f30 tx=0x7fe570010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:46.195 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.182+0000 7fe57f7fe700 1 -- 172.21.15.174:0/2393199094 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe570008e90 con 0x7fe56c0038b0 2020-04-02T23:21:46.195 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.182+0000 7fe584ac8700 1 --2- 172.21.15.174:0/2393199094 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe56c0038b0 0x7fe56c003cb0 secure :-1 s=THROTTLE_DONE pgs=119 cs=0 l=1 rx=0x7fe570002f30 tx=0x7fe570010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:46.195 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.182+0000 7fe57f7fe700 1 -- 172.21.15.174:0/2393199094 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe570010b40 con 0x7fe56c0038b0 2020-04-02T23:21:46.196 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.182+0000 7fe585aca700 1 -- 172.21.15.174:0/2393199094 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe56c0038b0 msgr2=0x7fe56c003cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:46.196 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.182+0000 7fe585aca700 1 --2- 172.21.15.174:0/2393199094 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe56c0038b0 0x7fe56c003cb0 secure :-1 s=READY pgs=119 cs=0 l=1 rx=0x7fe570002f30 tx=0x7fe570010020).stop 2020-04-02T23:21:46.196 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.182+0000 7fe585aca700 1 -- 172.21.15.174:0/2393199094 shutdown_connections 2020-04-02T23:21:46.196 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.182+0000 7fe585aca700 1 --2- 172.21.15.174:0/2393199094 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe56c0038b0 0x7fe56c003cb0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:46.197 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.182+0000 7fe585aca700 1 -- 172.21.15.174:0/2393199094 >> 172.21.15.174:0/2393199094 conn(0x7fe5800a6d00 msgr2=0x7fe5800a7110 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:46.197 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.182+0000 7fe585aca700 1 -- 172.21.15.174:0/2393199094 shutdown_connections 2020-04-02T23:21:46.197 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.182+0000 7fe585aca700 1 -- 172.21.15.174:0/2393199094 wait complete. 2020-04-02T23:21:46.197 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.183+0000 7fe585aca700 1 Processor -- start 2020-04-02T23:21:46.197 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.183+0000 7fe585aca700 1 -- start start 2020-04-02T23:21:46.197 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.184+0000 7fe585aca700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe5801341b0 0x7fe580131190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:46.197 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.184+0000 7fe585aca700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe5801349d0 0x7fe580060c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:46.197 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.184+0000 7fe585aca700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe580133740 con 0x7fe56c0038b0 2020-04-02T23:21:46.198 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.184+0000 7fe585aca700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe580133970 con 0x7fe5801341b0 2020-04-02T23:21:46.198 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.184+0000 7fe585aca700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe580133c10 con 0x7fe5801349d0 2020-04-02T23:21:46.198 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.184+0000 7fe584ac8700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fe56c0038b0 0x7fe580145b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:44874/0 (socket says 172.21.15.174:44874) 2020-04-02T23:21:46.198 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.184+0000 7fe57ffff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe5801341b0 0x7fe580131190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:46.198 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.184+0000 7fe584ac8700 1 -- 172.21.15.174:0/2024386439 learned_addr learned my addr 172.21.15.174:0/2024386439 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:21:46.198 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.184+0000 7fe5852c9700 1 --2- 172.21.15.174:0/2024386439 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe5801349d0 0x7fe580060c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:46.198 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.184+0000 7fe57ffff700 1 -- 172.21.15.174:0/2024386439 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe5801349d0 msgr2=0x7fe580060c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:46.199 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.184+0000 7fe57ffff700 1 --2- 172.21.15.174:0/2024386439 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe5801349d0 0x7fe580060c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:46.199 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.184+0000 7fe57ffff700 1 -- 172.21.15.174:0/2024386439 >> v1:172.21.15.174:6789/0 conn(0x7fe56c0038b0 legacy=0x7fe580145b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:46.199 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.184+0000 7fe57dffb700 1 -- 172.21.15.174:0/2024386439 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3064955177 0 0) 0x7fe580133740 con 0x7fe56c0038b0 2020-04-02T23:21:46.199 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.184+0000 7fe57ffff700 1 -- 172.21.15.174:0/2024386439 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5800a7820 con 0x7fe5801341b0 2020-04-02T23:21:46.199 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.184+0000 7fe57ffff700 1 --2- 172.21.15.174:0/2024386439 >> v2:172.21.15.174:3300/0 conn(0x7fe5801341b0 0x7fe580131190 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe5740014a0 tx=0x7fe574008530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:46.199 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.184+0000 7fe57ffff700 1 --2- 172.21.15.174:0/2024386439 >> v2:172.21.15.174:3300/0 conn(0x7fe5801341b0 0x7fe580131190 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe5740014a0 tx=0x7fe574008530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:46.199 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.184+0000 7fe57ffff700 1 --2- 172.21.15.174:0/2024386439 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe5801341b0 0x7fe580131190 secure :-1 s=READY pgs=121 cs=0 l=1 rx=0x7fe5740014a0 tx=0x7fe574008530).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:46.199 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.185+0000 7fe57ffff700 1 --2- 172.21.15.174:0/2024386439 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe5801341b0 0x7fe580131190 secure :-1 s=THROTTLE_DONE pgs=121 cs=0 l=1 rx=0x7fe5740014a0 tx=0x7fe574008530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:46.200 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.185+0000 7fe57dffb700 1 -- 172.21.15.174:0/2024386439 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe574007430 con 0x7fe5801341b0 2020-04-02T23:21:46.200 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.185+0000 7fe57ffff700 1 --2- 172.21.15.174:0/2024386439 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe5801341b0 0x7fe580131190 secure :-1 s=THROTTLE_DONE pgs=121 cs=0 l=1 rx=0x7fe5740014a0 tx=0x7fe574008530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:46.200 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.185+0000 7fe57ffff700 1 --2- 172.21.15.174:0/2024386439 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe5801341b0 0x7fe580131190 secure :-1 s=THROTTLE_DONE pgs=121 cs=0 l=1 rx=0x7fe5740014a0 tx=0x7fe574008530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:46.200 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.185+0000 7fe57dffb700 1 -- 172.21.15.174:0/2024386439 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe574004b90 con 0x7fe5801341b0 2020-04-02T23:21:46.200 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.185+0000 7fe585aca700 1 -- 172.21.15.174:0/2024386439 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5800610f0 con 0x7fe5801341b0 2020-04-02T23:21:46.200 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.185+0000 7fe57dffb700 1 -- 172.21.15.174:0/2024386439 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe574012410 con 0x7fe5801341b0 2020-04-02T23:21:46.200 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.185+0000 7fe585aca700 1 -- 172.21.15.174:0/2024386439 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5801318f0 con 0x7fe5801341b0 2020-04-02T23:21:46.201 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.185+0000 7fe57ffff700 1 --2- 172.21.15.174:0/2024386439 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe5801341b0 0x7fe580131190 secure :-1 s=THROTTLE_DONE pgs=121 cs=0 l=1 rx=0x7fe5740014a0 tx=0x7fe574008530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:46.201 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.186+0000 7fe585aca700 1 -- 172.21.15.174:0/2024386439 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe580130ef0 con 0x7fe5801341b0 2020-04-02T23:21:46.201 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.186+0000 7fe57dffb700 1 -- 172.21.15.174:0/2024386439 <== mon.0 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fe57400fa00 con 0x7fe5801341b0 2020-04-02T23:21:46.201 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.186+0000 7fe57ffff700 1 --2- 172.21.15.174:0/2024386439 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe5801341b0 0x7fe580131190 secure :-1 s=THROTTLE_DONE pgs=121 cs=0 l=1 rx=0x7fe5740014a0 tx=0x7fe574008530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:46.201 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.186+0000 7fe57ffff700 1 --2- 172.21.15.174:0/2024386439 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe5801341b0 0x7fe580131190 secure :-1 s=THROTTLE_DONE pgs=121 cs=0 l=1 rx=0x7fe5740014a0 tx=0x7fe574008530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:46.201 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.186+0000 7fe57dffb700 1 --2- 172.21.15.174:0/2024386439 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fe56004d4a0 0x7fe56004f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:46.201 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.186+0000 7fe57dffb700 1 -- 172.21.15.174:0/2024386439 <== mon.0 v2:172.21.15.174:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe574060b70 con 0x7fe5801341b0 2020-04-02T23:21:46.201 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.186+0000 7fe57dffb700 1 --2- 172.21.15.174:0/2024386439 >> [v2:172.21.15.174:6800/24590,v1:172.21.15.174:6801/24590] conn(0x7fe560054080 0x7fe5600564a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:46.202 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.186+0000 7fe57dffb700 1 -- 172.21.15.174:0/2024386439 --> [v2:172.21.15.174:6800/24590,v1:172.21.15.174:6801/24590] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe560056a60 con 0x7fe560054080 2020-04-02T23:21:46.202 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.186+0000 7fe57dffb700 1 -- 172.21.15.174:0/2024386439 <== mon.0 v2:172.21.15.174:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe574062030 con 0x7fe5801341b0 2020-04-02T23:21:46.202 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.186+0000 7fe584ac8700 1 --2- 172.21.15.174:0/2024386439 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fe56004d4a0 0x7fe56004f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:46.202 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.186+0000 7fe5852c9700 1 --2- 172.21.15.174:0/2024386439 >> [v2:172.21.15.174:6800/24590,v1:172.21.15.174:6801/24590] conn(0x7fe560054080 0x7fe5600564a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:46.202 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.186+0000 7fe584ac8700 1 --2- 172.21.15.174:0/2024386439 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fe56004d4a0 0x7fe56004f960 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe570008620 tx=0x7fe570010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:46.202 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.186+0000 7fe5852c9700 1 --2- 172.21.15.174:0/2024386439 >> [v2:172.21.15.174:6800/24590,v1:172.21.15.174:6801/24590] conn(0x7fe560054080 0x7fe5600564a0 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:46.202 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.186+0000 7fe584ac8700 1 --2- 172.21.15.174:0/2024386439 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fe56004d4a0 0x7fe56004f960 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe570008620 tx=0x7fe570010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:46.203 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.187+0000 7fe584ac8700 1 --2- 172.21.15.174:0/2024386439 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fe56004d4a0 0x7fe56004f960 secure :-1 s=READY pgs=68 cs=0 l=1 rx=0x7fe570008620 tx=0x7fe570010020).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:46.203 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.187+0000 7fe57dffb700 1 -- 172.21.15.174:0/2024386439 <== osd.0 v2:172.21.15.174:6800/24590 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21407 (crc 0 0 0) 0x7fe560056a60 con 0x7fe560054080 2020-04-02T23:21:46.207 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.203+0000 7fe585aca700 1 -- 172.21.15.174:0/2024386439 --> [v2:172.21.15.174:6800/24590,v1:172.21.15.174:6801/24590] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe580056c50 con 0x7fe560054080 2020-04-02T23:21:46.207 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.203+0000 7fe57dffb700 1 -- 172.21.15.174:0/2024386439 <== osd.0 v2:172.21.15.174:6800/24590 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe580056c50 con 0x7fe560054080 2020-04-02T23:21:46.207 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.203+0000 7fe585aca700 1 -- 172.21.15.174:0/2024386439 >> [v2:172.21.15.174:6800/24590,v1:172.21.15.174:6801/24590] conn(0x7fe560054080 msgr2=0x7fe5600564a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:46.208 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.203+0000 7fe585aca700 1 --2- 172.21.15.174:0/2024386439 >> [v2:172.21.15.174:6800/24590,v1:172.21.15.174:6801/24590] conn(0x7fe560054080 0x7fe5600564a0 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:46.208 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.203+0000 7fe585aca700 1 -- 172.21.15.174:0/2024386439 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fe56004d4a0 msgr2=0x7fe56004f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:46.208 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.203+0000 7fe585aca700 1 --2- 172.21.15.174:0/2024386439 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fe56004d4a0 0x7fe56004f960 secure :-1 s=READY pgs=68 cs=0 l=1 rx=0x7fe570008620 tx=0x7fe570010020).stop 2020-04-02T23:21:46.208 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.203+0000 7fe585aca700 1 -- 172.21.15.174:0/2024386439 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe5801341b0 msgr2=0x7fe580131190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:46.209 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.203+0000 7fe585aca700 1 --2- 172.21.15.174:0/2024386439 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe5801341b0 0x7fe580131190 secure :-1 s=READY pgs=121 cs=0 l=1 rx=0x7fe5740014a0 tx=0x7fe574008530).stop 2020-04-02T23:21:46.209 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.203+0000 7fe5852c9700 1 -- 172.21.15.174:0/2024386439 reap_dead start 2020-04-02T23:21:46.209 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.203+0000 7fe585aca700 1 -- 172.21.15.174:0/2024386439 shutdown_connections 2020-04-02T23:21:46.209 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.203+0000 7fe585aca700 1 --2- 172.21.15.174:0/2024386439 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe5801341b0 0x7fe580131190 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:46.209 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.203+0000 7fe585aca700 1 -- 172.21.15.174:0/2024386439 >> 172.21.15.174:0/2024386439 conn(0x7fe5800a6d00 msgr2=0x7fe5800a7110 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:46.209 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.203+0000 7fe585aca700 1 -- 172.21.15.174:0/2024386439 shutdown_connections 2020-04-02T23:21:46.209 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.203+0000 7fe585aca700 1 -- 172.21.15.174:0/2024386439 wait complete. 2020-04-02T23:21:46.215 INFO:teuthology.orchestra.run.smithi174.stdout:60129542150 2020-04-02T23:21:46.216 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:46.232 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.1 flush_pg_stats 2020-04-02T23:21:46.378 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.375+0000 7f1f513b8700 1 Processor -- start 2020-04-02T23:21:46.378 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.376+0000 7f1f513b8700 1 -- start start 2020-04-02T23:21:46.393 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.376+0000 7f1f513b8700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f1f4c0a62e0 0x7f1f4c05ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:46.393 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.376+0000 7f1f513b8700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f4c0a9150 con 0x7f1f4c13b600 2020-04-02T23:21:46.393 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.376+0000 7f1f513b8700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f4c05c3b0 con 0x7f1f4c0a5f00 2020-04-02T23:21:46.394 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.376+0000 7f1f513b8700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f4c0aa720 con 0x7f1f4c0a62e0 2020-04-02T23:21:46.394 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.376+0000 7f1f4b7fe700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f1f4c13b600 0x7f1f4c1429a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:44888/0 (socket says 172.21.15.174:44888) 2020-04-02T23:21:46.394 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.376+0000 7f1f4b7fe700 1 -- 172.21.15.174:0/3673770733 learned_addr learned my addr 172.21.15.174:0/3673770733 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:21:46.394 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.377+0000 7f1f4a7fc700 1 --2- 172.21.15.174:0/3673770733 >> v2:172.21.15.196:3300/0 conn(0x7f1f4c0a62e0 0x7f1f4c05ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:46.394 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.377+0000 7f1f49ffb700 1 -- 172.21.15.174:0/3673770733 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 975706744 0 0) 0x7f1f4c0a9150 con 0x7f1f4c13b600 2020-04-02T23:21:46.394 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.377+0000 7f1f49ffb700 1 -- 172.21.15.174:0/3673770733 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f2c003230 con 0x7f1f4c13b600 2020-04-02T23:21:46.394 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.377+0000 7f1f49ffb700 1 -- 172.21.15.174:0/3673770733 <== mon.0 v1:172.21.15.174:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1650789666 0 0) 0x7f1f2c003230 con 0x7f1f4c13b600 2020-04-02T23:21:46.395 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.377+0000 7f1f49ffb700 1 -- 172.21.15.174:0/3673770733 >> v2:172.21.15.196:3300/0 conn(0x7f1f4c0a62e0 msgr2=0x7f1f4c05ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:46.395 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.377+0000 7f1f49ffb700 1 --2- 172.21.15.174:0/3673770733 >> v2:172.21.15.196:3300/0 conn(0x7f1f4c0a62e0 0x7f1f4c05ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:46.395 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.377+0000 7f1f49ffb700 1 -- 172.21.15.174:0/3673770733 >> v1:172.21.15.196:6789/0 conn(0x7f1f4c0a5f00 legacy=0x7f1f4c0a9a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:46.395 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.377+0000 7f1f49ffb700 1 -- 172.21.15.174:0/3673770733 --> v1:172.21.15.174:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f4c05c650 con 0x7f1f4c13b600 2020-04-02T23:21:46.395 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.377+0000 7f1f49ffb700 1 -- 172.21.15.174:0/3673770733 <== mon.0 v1:172.21.15.174:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2811762909 0 0) 0x7f1f44001a50 con 0x7f1f4c13b600 2020-04-02T23:21:46.395 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.377+0000 7f1f49ffb700 1 -- 172.21.15.174:0/3673770733 >> v1:172.21.15.174:6789/0 conn(0x7f1f4c13b600 legacy=0x7f1f4c1429a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:46.395 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.377+0000 7f1f49ffb700 1 --2- 172.21.15.174:0/3673770733 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f2c003720 0x7f1f2c003b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:46.396 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.377+0000 7f1f49ffb700 1 --2- 172.21.15.174:0/3673770733 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f2c0044d0 0x7f1f2c004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:46.396 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.377+0000 7f1f49ffb700 1 --2- 172.21.15.174:0/3673770733 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1f2c004db0 0x7f1f2c00b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:46.396 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.377+0000 7f1f49ffb700 1 -- 172.21.15.174:0/3673770733 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4c0aa720 con 0x7f1f2c0044d0 2020-04-02T23:21:46.396 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.377+0000 7f1f49ffb700 1 -- 172.21.15.174:0/3673770733 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2c0041e0 con 0x7f1f2c004db0 2020-04-02T23:21:46.396 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.377+0000 7f1f49ffb700 1 -- 172.21.15.174:0/3673770733 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2c00bb80 con 0x7f1f2c003720 2020-04-02T23:21:46.396 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.377+0000 7f1f4a7fc700 1 --2- 172.21.15.174:0/3673770733 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f2c0044d0 0x7f1f2c004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:46.397 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.377+0000 7f1f4b7fe700 1 --2- 172.21.15.174:0/3673770733 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1f2c004db0 0x7f1f2c00b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:46.397 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.377+0000 7f1f4affd700 1 --2- 172.21.15.174:0/3673770733 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f2c003720 0x7f1f2c003b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:46.397 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.377+0000 7f1f4a7fc700 1 -- 172.21.15.174:0/3673770733 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f2c003720 msgr2=0x7f1f2c003b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:46.397 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.377+0000 7f1f4a7fc700 1 --2- 172.21.15.174:0/3673770733 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f2c003720 0x7f1f2c003b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:46.397 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.377+0000 7f1f4a7fc700 1 -- 172.21.15.174:0/3673770733 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1f2c004db0 msgr2=0x7f1f2c00b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:46.397 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.377+0000 7f1f4a7fc700 1 --2- 172.21.15.174:0/3673770733 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1f2c004db0 0x7f1f2c00b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:46.397 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.377+0000 7f1f4b7fe700 1 -- 172.21.15.174:0/3673770733 reap_dead start 2020-04-02T23:21:46.398 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.377+0000 7f1f4a7fc700 1 -- 172.21.15.174:0/3673770733 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f2c003230 con 0x7f1f2c0044d0 2020-04-02T23:21:46.398 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.377+0000 7f1f4a7fc700 1 --2- 172.21.15.174:0/3673770733 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f2c0044d0 0x7f1f2c004950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1f34008910 tx=0x7f1f34010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:46.398 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.377+0000 7f1f4a7fc700 1 --2- 172.21.15.174:0/3673770733 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f2c0044d0 0x7f1f2c004950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1f34008910 tx=0x7f1f34010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:46.398 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.377+0000 7f1f4a7fc700 1 --2- 172.21.15.174:0/3673770733 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f2c0044d0 0x7f1f2c004950 secure :-1 s=READY pgs=123 cs=0 l=1 rx=0x7f1f34008910 tx=0x7f1f34010050).ready entity=mon.0 client_cookie=6a7a0d8d3c38c738 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:46.398 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.378+0000 7f1f4a7fc700 1 --2- 172.21.15.174:0/3673770733 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f2c0044d0 0x7f1f2c004950 secure :-1 s=THROTTLE_DONE pgs=123 cs=0 l=1 rx=0x7f1f34008910 tx=0x7f1f34010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:46.398 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.378+0000 7f1f49ffb700 1 -- 172.21.15.174:0/3673770733 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f34008d30 con 0x7f1f2c0044d0 2020-04-02T23:21:46.399 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.378+0000 7f1f4a7fc700 1 --2- 172.21.15.174:0/3673770733 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f2c0044d0 0x7f1f2c004950 secure :-1 s=THROTTLE_DONE pgs=123 cs=0 l=1 rx=0x7f1f34008910 tx=0x7f1f34010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:46.399 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.378+0000 7f1f4a7fc700 1 --2- 172.21.15.174:0/3673770733 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f2c0044d0 0x7f1f2c004950 secure :-1 s=THROTTLE_DONE pgs=123 cs=0 l=1 rx=0x7f1f34008910 tx=0x7f1f34010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:46.399 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.378+0000 7f1f49ffb700 1 -- 172.21.15.174:0/3673770733 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f34008e90 con 0x7f1f2c0044d0 2020-04-02T23:21:46.399 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.378+0000 7f1f49ffb700 1 -- 172.21.15.174:0/3673770733 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f34010a80 con 0x7f1f2c0044d0 2020-04-02T23:21:46.399 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.378+0000 7f1f513b8700 1 -- 172.21.15.174:0/3673770733 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f2c0044d0 msgr2=0x7f1f2c004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:46.399 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.378+0000 7f1f513b8700 1 --2- 172.21.15.174:0/3673770733 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f2c0044d0 0x7f1f2c004950 secure :-1 s=READY pgs=123 cs=0 l=1 rx=0x7f1f34008910 tx=0x7f1f34010050).stop 2020-04-02T23:21:46.399 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.378+0000 7f1f513b8700 1 -- 172.21.15.174:0/3673770733 shutdown_connections 2020-04-02T23:21:46.400 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.378+0000 7f1f513b8700 1 --2- 172.21.15.174:0/3673770733 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f2c0044d0 0x7f1f2c004950 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:46.400 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.378+0000 7f1f513b8700 1 -- 172.21.15.174:0/3673770733 >> 172.21.15.174:0/3673770733 conn(0x7f1f4c0ab320 msgr2=0x7f1f4c0ab730 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:46.400 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.378+0000 7f1f513b8700 1 -- 172.21.15.174:0/3673770733 shutdown_connections 2020-04-02T23:21:46.400 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.378+0000 7f1f513b8700 1 -- 172.21.15.174:0/3673770733 wait complete. 2020-04-02T23:21:46.400 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.379+0000 7f1f513b8700 1 Processor -- start 2020-04-02T23:21:46.400 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.379+0000 7f1f513b8700 1 -- start start 2020-04-02T23:21:46.400 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.380+0000 7f1f513b8700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f2c0044d0 0x7f1f4c1333d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:46.400 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.380+0000 7f1f513b8700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f1f4c131640 0x7f1f4c131ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:46.401 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.380+0000 7f1f513b8700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f4c05b590 con 0x7f1f4c136690 2020-04-02T23:21:46.401 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.380+0000 7f1f513b8700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f4c0a8fb0 con 0x7f1f4c131640 2020-04-02T23:21:46.401 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.380+0000 7f1f513b8700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4c133830 con 0x7f1f2c0044d0 2020-04-02T23:21:46.401 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.380+0000 7f1f4affd700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f2c0044d0 0x7f1f4c1333d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:46.401 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.380+0000 7f1f4b7fe700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f1f4c131640 0x7f1f4c131ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:46.401 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.380+0000 7f1f4affd700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f2c0044d0 0x7f1f4c1333d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.174:34446/0 (socket says 172.21.15.174:34446) 2020-04-02T23:21:46.401 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.380+0000 7f1f4affd700 1 -- 172.21.15.174:0/2340566340 learned_addr learned my addr 172.21.15.174:0/2340566340 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:21:46.402 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.380+0000 7f1f4affd700 1 -- 172.21.15.174:0/2340566340 >> v2:172.21.15.196:3300/0 conn(0x7f1f4c131640 msgr2=0x7f1f4c131ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:46.402 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.380+0000 7f1f4affd700 1 --2- 172.21.15.174:0/2340566340 >> v2:172.21.15.196:3300/0 conn(0x7f1f4c131640 0x7f1f4c131ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:46.402 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.380+0000 7f1f4affd700 1 -- 172.21.15.174:0/2340566340 >> v1:172.21.15.196:6789/0 conn(0x7f1f4c136690 legacy=0x7f1f4c137080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:46.402 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.380+0000 7f1f4affd700 1 -- 172.21.15.174:0/2340566340 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f4c137f70 con 0x7f1f2c0044d0 2020-04-02T23:21:46.402 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.380+0000 7f1f4affd700 1 --2- 172.21.15.174:0/2340566340 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f2c0044d0 0x7f1f4c1333d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1f3c0011c0 tx=0x7f1f4c0445b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:46.402 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.380+0000 7f1f4affd700 1 --2- 172.21.15.174:0/2340566340 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f2c0044d0 0x7f1f4c1333d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1f3c0011c0 tx=0x7f1f4c0445b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:46.402 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.380+0000 7f1f4affd700 1 --2- 172.21.15.174:0/2340566340 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f2c0044d0 0x7f1f4c1333d0 secure :-1 s=READY pgs=25 cs=0 l=1 rx=0x7f1f3c0011c0 tx=0x7f1f4c0445b0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:46.402 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.380+0000 7f1f4affd700 1 --2- 172.21.15.174:0/2340566340 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f2c0044d0 0x7f1f4c1333d0 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7f1f3c0011c0 tx=0x7f1f4c0445b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:46.403 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.380+0000 7f1f43fff700 1 -- 172.21.15.174:0/2340566340 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f3c00c860 con 0x7f1f2c0044d0 2020-04-02T23:21:46.403 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.380+0000 7f1f4affd700 1 --2- 172.21.15.174:0/2340566340 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f2c0044d0 0x7f1f4c1333d0 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7f1f3c0011c0 tx=0x7f1f4c0445b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:46.403 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.380+0000 7f1f43fff700 1 -- 172.21.15.174:0/2340566340 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f3c00c9c0 con 0x7f1f2c0044d0 2020-04-02T23:21:46.403 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.380+0000 7f1f4affd700 1 --2- 172.21.15.174:0/2340566340 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f2c0044d0 0x7f1f4c1333d0 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7f1f3c0011c0 tx=0x7f1f4c0445b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:46.403 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.380+0000 7f1f513b8700 1 -- 172.21.15.174:0/2340566340 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f4c137790 con 0x7f1f2c0044d0 2020-04-02T23:21:46.403 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.380+0000 7f1f43fff700 1 -- 172.21.15.174:0/2340566340 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f3c00cda0 con 0x7f1f2c0044d0 2020-04-02T23:21:46.403 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.380+0000 7f1f513b8700 1 -- 172.21.15.174:0/2340566340 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f4c0a9b70 con 0x7f1f2c0044d0 2020-04-02T23:21:46.404 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.381+0000 7f1f513b8700 1 -- 172.21.15.174:0/2340566340 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1f4c136da0 con 0x7f1f2c0044d0 2020-04-02T23:21:46.404 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.381+0000 7f1f4affd700 1 --2- 172.21.15.174:0/2340566340 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f2c0044d0 0x7f1f4c1333d0 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7f1f3c0011c0 tx=0x7f1f4c0445b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:46.404 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.382+0000 7f1f43fff700 1 -- 172.21.15.174:0/2340566340 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f1f3c006530 con 0x7f1f2c0044d0 2020-04-02T23:21:46.404 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.382+0000 7f1f4affd700 1 --2- 172.21.15.174:0/2340566340 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f2c0044d0 0x7f1f4c1333d0 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7f1f3c0011c0 tx=0x7f1f4c0445b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:46.404 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.382+0000 7f1f4affd700 1 --2- 172.21.15.174:0/2340566340 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f2c0044d0 0x7f1f4c1333d0 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7f1f3c0011c0 tx=0x7f1f4c0445b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:46.405 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.382+0000 7f1f43fff700 1 --2- 172.21.15.174:0/2340566340 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f1f3004d5d0 0x7f1f3004fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:46.405 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.382+0000 7f1f43fff700 1 -- 172.21.15.174:0/2340566340 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1f3c060c00 con 0x7f1f2c0044d0 2020-04-02T23:21:46.405 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.382+0000 7f1f43fff700 1 --2- 172.21.15.174:0/2340566340 >> [v2:172.21.15.174:6808/24754,v1:172.21.15.174:6809/24754] conn(0x7f1f300541b0 0x7f1f300565d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:46.405 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.382+0000 7f1f43fff700 1 -- 172.21.15.174:0/2340566340 --> [v2:172.21.15.174:6808/24754,v1:172.21.15.174:6809/24754] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1f30056b90 con 0x7f1f300541b0 2020-04-02T23:21:46.405 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.382+0000 7f1f43fff700 1 -- 172.21.15.174:0/2340566340 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1f3c062120 con 0x7f1f2c0044d0 2020-04-02T23:21:46.406 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.382+0000 7f1f4a7fc700 1 --2- 172.21.15.174:0/2340566340 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f1f3004d5d0 0x7f1f3004fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:46.406 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.382+0000 7f1f4b7fe700 1 --2- 172.21.15.174:0/2340566340 >> [v2:172.21.15.174:6808/24754,v1:172.21.15.174:6809/24754] conn(0x7f1f300541b0 0x7f1f300565d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:46.407 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.382+0000 7f1f4a7fc700 1 --2- 172.21.15.174:0/2340566340 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f1f3004d5d0 0x7f1f3004fa90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1f4c136f60 tx=0x7f1f34010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:46.407 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.382+0000 7f1f4b7fe700 1 --2- 172.21.15.174:0/2340566340 >> [v2:172.21.15.174:6808/24754,v1:172.21.15.174:6809/24754] conn(0x7f1f300541b0 0x7f1f300565d0 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:46.407 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.382+0000 7f1f4a7fc700 1 --2- 172.21.15.174:0/2340566340 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f1f3004d5d0 0x7f1f3004fa90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1f4c136f60 tx=0x7f1f34010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:46.407 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.382+0000 7f1f4a7fc700 1 --2- 172.21.15.174:0/2340566340 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f1f3004d5d0 0x7f1f3004fa90 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7f1f4c136f60 tx=0x7f1f34010050).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:46.408 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.383+0000 7f1f43fff700 1 -- 172.21.15.174:0/2340566340 <== osd.1 v2:172.21.15.174:6808/24754 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21407 (crc 0 0 0) 0x7f1f30056b90 con 0x7f1f300541b0 2020-04-02T23:21:46.409 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.398+0000 7f1f513b8700 1 -- 172.21.15.174:0/2340566340 --> [v2:172.21.15.174:6808/24754,v1:172.21.15.174:6809/24754] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1f4c132310 con 0x7f1f300541b0 2020-04-02T23:21:46.409 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.398+0000 7f1f43fff700 1 -- 172.21.15.174:0/2340566340 <== osd.1 v2:172.21.15.174:6808/24754 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1f4c132310 con 0x7f1f300541b0 2020-04-02T23:21:46.410 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.399+0000 7f1f513b8700 1 -- 172.21.15.174:0/2340566340 >> [v2:172.21.15.174:6808/24754,v1:172.21.15.174:6809/24754] conn(0x7f1f300541b0 msgr2=0x7f1f300565d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:46.410 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.399+0000 7f1f513b8700 1 --2- 172.21.15.174:0/2340566340 >> [v2:172.21.15.174:6808/24754,v1:172.21.15.174:6809/24754] conn(0x7f1f300541b0 0x7f1f300565d0 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:46.410 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.399+0000 7f1f513b8700 1 -- 172.21.15.174:0/2340566340 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f1f3004d5d0 msgr2=0x7f1f3004fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:46.410 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.399+0000 7f1f513b8700 1 --2- 172.21.15.174:0/2340566340 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f1f3004d5d0 0x7f1f3004fa90 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7f1f4c136f60 tx=0x7f1f34010050).stop 2020-04-02T23:21:46.410 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.399+0000 7f1f513b8700 1 -- 172.21.15.174:0/2340566340 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f2c0044d0 msgr2=0x7f1f4c1333d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:46.410 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.399+0000 7f1f513b8700 1 --2- 172.21.15.174:0/2340566340 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f2c0044d0 0x7f1f4c1333d0 secure :-1 s=READY pgs=25 cs=0 l=1 rx=0x7f1f3c0011c0 tx=0x7f1f4c0445b0).stop 2020-04-02T23:21:46.410 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.399+0000 7f1f4b7fe700 1 -- 172.21.15.174:0/2340566340 reap_dead start 2020-04-02T23:21:46.411 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.399+0000 7f1f513b8700 1 -- 172.21.15.174:0/2340566340 shutdown_connections 2020-04-02T23:21:46.411 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.399+0000 7f1f513b8700 1 -- 172.21.15.174:0/2340566340 >> 172.21.15.174:0/2340566340 conn(0x7f1f4c0ab320 msgr2=0x7f1f4c0695c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:46.411 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.399+0000 7f1f513b8700 1 -- 172.21.15.174:0/2340566340 shutdown_connections 2020-04-02T23:21:46.411 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.399+0000 7f1f513b8700 1 -- 172.21.15.174:0/2340566340 wait complete. 2020-04-02T23:21:46.412 INFO:teuthology.orchestra.run.smithi174.stdout:60129542150 2020-04-02T23:21:46.412 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:46.435 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.2 flush_pg_stats 2020-04-02T23:21:46.585 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.580+0000 7f9c27bc5700 1 Processor -- start 2020-04-02T23:21:46.585 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.580+0000 7f9c27bc5700 1 -- start start 2020-04-02T23:21:46.586 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.581+0000 7f9c27bc5700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9c20138bb0 0x7f9c200a22b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:46.586 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.581+0000 7f9c27bc5700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c200a3ae0 con 0x7f9c200a7a60 2020-04-02T23:21:46.586 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.581+0000 7f9c27bc5700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c200a3d80 con 0x7f9c200a4330 2020-04-02T23:21:46.586 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.581+0000 7f9c27bc5700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c200a4020 con 0x7f9c20138bb0 2020-04-02T23:21:46.586 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.581+0000 7f9c26162700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9c20138bb0 0x7f9c200a22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:46.586 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.581+0000 7f9c26162700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9c20138bb0 0x7f9c200a22b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:39872/0 (socket says 172.21.15.174:39872) 2020-04-02T23:21:46.586 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.581+0000 7f9c26162700 1 -- 172.21.15.174:0/583982987 learned_addr learned my addr 172.21.15.174:0/583982987 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:21:46.587 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.581+0000 7f9c26162700 1 -- 172.21.15.174:0/583982987 >> v1:172.21.15.196:6789/0 conn(0x7f9c200a4330 legacy=0x7f9c20134dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:46.587 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.581+0000 7f9c26162700 1 -- 172.21.15.174:0/583982987 >> v1:172.21.15.174:6789/0 conn(0x7f9c200a7a60 legacy=0x7f9c201384a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:46.587 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.581+0000 7f9c26162700 1 -- 172.21.15.174:0/583982987 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c200a1a60 con 0x7f9c20138bb0 2020-04-02T23:21:46.587 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.581+0000 7f9c2495f700 1 -- 172.21.15.174:0/583982987 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1785711880 0 0) 0x7f9c200a3ae0 con 0x7f9c200a7a60 2020-04-02T23:21:46.587 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.581+0000 7f9c26162700 1 --2- 172.21.15.174:0/583982987 >> v2:172.21.15.174:3300/0 conn(0x7f9c20138bb0 0x7f9c200a22b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9c180032b0 tx=0x7f9c18007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:46.587 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.581+0000 7f9c26162700 1 --2- 172.21.15.174:0/583982987 >> v2:172.21.15.174:3300/0 conn(0x7f9c20138bb0 0x7f9c200a22b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9c180032b0 tx=0x7f9c18007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:46.587 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.581+0000 7f9c26162700 1 --2- 172.21.15.174:0/583982987 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9c20138bb0 0x7f9c200a22b0 secure :-1 s=READY pgs=125 cs=0 l=1 rx=0x7f9c180032b0 tx=0x7f9c18007dc0).ready entity=mon.0 client_cookie=38204e4841667754 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:46.588 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.581+0000 7f9c26162700 1 --2- 172.21.15.174:0/583982987 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9c20138bb0 0x7f9c200a22b0 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7f9c180032b0 tx=0x7f9c18007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:46.588 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.581+0000 7f9c2495f700 1 -- 172.21.15.174:0/583982987 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c1800a160 con 0x7f9c20138bb0 2020-04-02T23:21:46.588 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.581+0000 7f9c26162700 1 --2- 172.21.15.174:0/583982987 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9c20138bb0 0x7f9c200a22b0 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7f9c180032b0 tx=0x7f9c18007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:46.588 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.581+0000 7f9c26162700 1 --2- 172.21.15.174:0/583982987 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9c20138bb0 0x7f9c200a22b0 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7f9c180032b0 tx=0x7f9c18007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:46.588 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.581+0000 7f9c2495f700 1 -- 172.21.15.174:0/583982987 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c1800a2c0 con 0x7f9c20138bb0 2020-04-02T23:21:46.588 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.581+0000 7f9c2495f700 1 -- 172.21.15.174:0/583982987 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c1800a6e0 con 0x7f9c20138bb0 2020-04-02T23:21:46.588 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.581+0000 7f9c27bc5700 1 -- 172.21.15.174:0/583982987 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9c20138bb0 msgr2=0x7f9c200a22b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:46.594 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.581+0000 7f9c27bc5700 1 --2- 172.21.15.174:0/583982987 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9c20138bb0 0x7f9c200a22b0 secure :-1 s=READY pgs=125 cs=0 l=1 rx=0x7f9c180032b0 tx=0x7f9c18007dc0).stop 2020-04-02T23:21:46.595 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.582+0000 7f9c27bc5700 1 -- 172.21.15.174:0/583982987 shutdown_connections 2020-04-02T23:21:46.595 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.582+0000 7f9c27bc5700 1 --2- 172.21.15.174:0/583982987 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9c20138bb0 0x7f9c200a22b0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:46.595 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.582+0000 7f9c27bc5700 1 -- 172.21.15.174:0/583982987 >> 172.21.15.174:0/583982987 conn(0x7f9c200aaf80 msgr2=0x7f9c200a6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:46.595 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.582+0000 7f9c27bc5700 1 -- 172.21.15.174:0/583982987 shutdown_connections 2020-04-02T23:21:46.595 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.582+0000 7f9c27bc5700 1 -- 172.21.15.174:0/583982987 wait complete. 2020-04-02T23:21:46.596 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.583+0000 7f9c27bc5700 1 Processor -- start 2020-04-02T23:21:46.596 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.583+0000 7f9c27bc5700 1 -- start start 2020-04-02T23:21:46.601 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.583+0000 7f9c27bc5700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9c200a4330 0x7f9c20126020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:46.602 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.583+0000 7f9c27bc5700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f9c20138bb0 0x7f9c20131570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:46.606 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.583+0000 7f9c27bc5700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c2005c2c0 con 0x7f9c200a7a60 2020-04-02T23:21:46.606 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.583+0000 7f9c27bc5700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c20126bd0 con 0x7f9c20138bb0 2020-04-02T23:21:46.607 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.583+0000 7f9c27bc5700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c20126930 con 0x7f9c200a4330 2020-04-02T23:21:46.607 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.583+0000 7f9c25160700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f9c200a7a60 0x7f9c201249f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:44914/0 (socket says 172.21.15.174:44914) 2020-04-02T23:21:46.607 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.584+0000 7f9c25160700 1 -- 172.21.15.174:0/3826250944 learned_addr learned my addr 172.21.15.174:0/3826250944 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:21:46.607 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.584+0000 7f9c25961700 1 --2- 172.21.15.174:0/3826250944 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9c200a4330 0x7f9c20126020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:46.608 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.584+0000 7f9c26162700 1 --2- 172.21.15.174:0/3826250944 >> v2:172.21.15.196:3300/0 conn(0x7f9c20138bb0 0x7f9c20131570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:46.608 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.584+0000 7f9c0effd700 1 -- 172.21.15.174:0/3826250944 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3632093928 0 0) 0x7f9c2005c2c0 con 0x7f9c200a7a60 2020-04-02T23:21:46.608 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.584+0000 7f9c0effd700 1 -- 172.21.15.174:0/3826250944 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c00002fe0 con 0x7f9c200a7a60 2020-04-02T23:21:46.608 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.584+0000 7f9c0effd700 1 -- 172.21.15.174:0/3826250944 <== mon.0 v1:172.21.15.174:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 898708177 0 0) 0x7f9c00002fe0 con 0x7f9c200a7a60 2020-04-02T23:21:46.609 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.584+0000 7f9c0effd700 1 -- 172.21.15.174:0/3826250944 --> v1:172.21.15.174:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9c2005c2c0 con 0x7f9c200a7a60 2020-04-02T23:21:46.609 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.584+0000 7f9c0effd700 1 -- 172.21.15.174:0/3826250944 <== mon.0 v1:172.21.15.174:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2811762909 0 0) 0x7f9c1c0018d0 con 0x7f9c200a7a60 2020-04-02T23:21:46.609 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.584+0000 7f9c26162700 1 -- 172.21.15.174:0/3826250944 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9c200a4330 msgr2=0x7f9c20126020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:46.609 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.584+0000 7f9c26162700 1 --2- 172.21.15.174:0/3826250944 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9c200a4330 0x7f9c20126020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:46.609 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.584+0000 7f9c26162700 1 -- 172.21.15.174:0/3826250944 >> v1:172.21.15.174:6789/0 conn(0x7f9c200a7a60 legacy=0x7f9c201249f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:46.610 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.584+0000 7f9c26162700 1 -- 172.21.15.174:0/3826250944 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c20124550 con 0x7f9c20138bb0 2020-04-02T23:21:46.610 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.584+0000 7f9c25961700 1 --2- 172.21.15.174:0/3826250944 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9c200a4330 0x7f9c20126020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:21:46.610 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.584+0000 7f9c26162700 1 --2- 172.21.15.174:0/3826250944 >> v2:172.21.15.196:3300/0 conn(0x7f9c20138bb0 0x7f9c20131570 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9c180032b0 tx=0x7f9c18007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:46.610 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.584+0000 7f9c26162700 1 --2- 172.21.15.174:0/3826250944 >> v2:172.21.15.196:3300/0 conn(0x7f9c20138bb0 0x7f9c20131570 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9c180032b0 tx=0x7f9c18007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:46.611 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.584+0000 7f9c26162700 1 --2- 172.21.15.174:0/3826250944 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9c20138bb0 0x7f9c20131570 secure :-1 s=READY pgs=94 cs=0 l=1 rx=0x7f9c180032b0 tx=0x7f9c18007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:46.611 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.584+0000 7f9c26162700 1 --2- 172.21.15.174:0/3826250944 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9c20138bb0 0x7f9c20131570 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7f9c180032b0 tx=0x7f9c18007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:46.611 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.584+0000 7f9c0effd700 1 -- 172.21.15.174:0/3826250944 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c18005a40 con 0x7f9c20138bb0 2020-04-02T23:21:46.611 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.584+0000 7f9c26162700 1 --2- 172.21.15.174:0/3826250944 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9c20138bb0 0x7f9c20131570 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7f9c180032b0 tx=0x7f9c18007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:46.612 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.584+0000 7f9c26162700 1 --2- 172.21.15.174:0/3826250944 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9c20138bb0 0x7f9c20131570 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7f9c180032b0 tx=0x7f9c18007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:46.612 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.584+0000 7f9c0effd700 1 -- 172.21.15.174:0/3826250944 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c18005ba0 con 0x7f9c20138bb0 2020-04-02T23:21:46.612 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.584+0000 7f9c27bc5700 1 -- 172.21.15.174:0/3826250944 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c20126480 con 0x7f9c20138bb0 2020-04-02T23:21:46.612 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.584+0000 7f9c0effd700 1 -- 172.21.15.174:0/3826250944 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c18007150 con 0x7f9c20138bb0 2020-04-02T23:21:46.613 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.584+0000 7f9c27bc5700 1 -- 172.21.15.174:0/3826250944 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c20134c90 con 0x7f9c20138bb0 2020-04-02T23:21:46.613 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.585+0000 7f9c26162700 1 --2- 172.21.15.174:0/3826250944 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9c20138bb0 0x7f9c20131570 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7f9c180032b0 tx=0x7f9c18007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:46.613 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.585+0000 7f9c27bc5700 1 -- 172.21.15.174:0/3826250944 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9c20126760 con 0x7f9c20138bb0 2020-04-02T23:21:46.613 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.585+0000 7f9c0effd700 1 -- 172.21.15.174:0/3826250944 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f9c18007350 con 0x7f9c20138bb0 2020-04-02T23:21:46.613 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.585+0000 7f9c26162700 1 --2- 172.21.15.174:0/3826250944 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9c20138bb0 0x7f9c20131570 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7f9c180032b0 tx=0x7f9c18007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:46.614 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.585+0000 7f9c26162700 1 --2- 172.21.15.174:0/3826250944 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9c20138bb0 0x7f9c20131570 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7f9c180032b0 tx=0x7f9c18007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:46.614 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.585+0000 7f9c0effd700 1 --2- 172.21.15.174:0/3826250944 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f9c0004db20 0x7f9c0004ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:46.614 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.586+0000 7f9c0effd700 1 -- 172.21.15.174:0/3826250944 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9c18061a00 con 0x7f9c20138bb0 2020-04-02T23:21:46.614 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.586+0000 7f9c0effd700 1 --2- 172.21.15.174:0/3826250944 >> [v2:172.21.15.174:6816/24781,v1:172.21.15.174:6817/24781] conn(0x7f9c00054600 0x7f9c00056a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:46.615 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.586+0000 7f9c0effd700 1 -- 172.21.15.174:0/3826250944 --> [v2:172.21.15.174:6816/24781,v1:172.21.15.174:6817/24781] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9c00056fe0 con 0x7f9c00054600 2020-04-02T23:21:46.615 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.586+0000 7f9c0effd700 1 -- 172.21.15.174:0/3826250944 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9c18062ec0 con 0x7f9c20138bb0 2020-04-02T23:21:46.615 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.586+0000 7f9c25961700 1 --2- 172.21.15.174:0/3826250944 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f9c0004db20 0x7f9c0004ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:46.616 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.586+0000 7f9c25160700 1 --2- 172.21.15.174:0/3826250944 >> [v2:172.21.15.174:6816/24781,v1:172.21.15.174:6817/24781] conn(0x7f9c00054600 0x7f9c00056a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:46.616 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.586+0000 7f9c25961700 1 --2- 172.21.15.174:0/3826250944 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f9c0004db20 0x7f9c0004ffe0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9c10000b80 tx=0x7f9c1000cc10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:46.616 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.586+0000 7f9c25961700 1 --2- 172.21.15.174:0/3826250944 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f9c0004db20 0x7f9c0004ffe0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9c10000b80 tx=0x7f9c1000cc10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:46.616 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.586+0000 7f9c25961700 1 --2- 172.21.15.174:0/3826250944 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f9c0004db20 0x7f9c0004ffe0 secure :-1 s=READY pgs=70 cs=0 l=1 rx=0x7f9c10000b80 tx=0x7f9c1000cc10).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:46.617 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.586+0000 7f9c25160700 1 --2- 172.21.15.174:0/3826250944 >> [v2:172.21.15.174:6816/24781,v1:172.21.15.174:6817/24781] conn(0x7f9c00054600 0x7f9c00056a20 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:46.617 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.587+0000 7f9c0effd700 1 -- 172.21.15.174:0/3826250944 <== osd.2 v2:172.21.15.174:6816/24781 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21407 (crc 0 0 0) 0x7f9c00056fe0 con 0x7f9c00054600 2020-04-02T23:21:46.620 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.602+0000 7f9c27bc5700 1 -- 172.21.15.174:0/3826250944 --> [v2:172.21.15.174:6816/24781,v1:172.21.15.174:6817/24781] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9c20056c50 con 0x7f9c00054600 2020-04-02T23:21:46.620 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.602+0000 7f9c0effd700 1 -- 172.21.15.174:0/3826250944 <== osd.2 v2:172.21.15.174:6816/24781 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9c20056c50 con 0x7f9c00054600 2020-04-02T23:21:46.620 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.602+0000 7f9c27bc5700 1 -- 172.21.15.174:0/3826250944 >> [v2:172.21.15.174:6816/24781,v1:172.21.15.174:6817/24781] conn(0x7f9c00054600 msgr2=0x7f9c00056a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:46.621 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.602+0000 7f9c27bc5700 1 --2- 172.21.15.174:0/3826250944 >> [v2:172.21.15.174:6816/24781,v1:172.21.15.174:6817/24781] conn(0x7f9c00054600 0x7f9c00056a20 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:46.621 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.602+0000 7f9c27bc5700 1 -- 172.21.15.174:0/3826250944 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f9c0004db20 msgr2=0x7f9c0004ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:46.621 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.602+0000 7f9c27bc5700 1 --2- 172.21.15.174:0/3826250944 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f9c0004db20 0x7f9c0004ffe0 secure :-1 s=READY pgs=70 cs=0 l=1 rx=0x7f9c10000b80 tx=0x7f9c1000cc10).stop 2020-04-02T23:21:46.621 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.602+0000 7f9c27bc5700 1 -- 172.21.15.174:0/3826250944 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9c20138bb0 msgr2=0x7f9c20131570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:46.622 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.602+0000 7f9c27bc5700 1 --2- 172.21.15.174:0/3826250944 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9c20138bb0 0x7f9c20131570 secure :-1 s=READY pgs=94 cs=0 l=1 rx=0x7f9c180032b0 tx=0x7f9c18007dc0).stop 2020-04-02T23:21:46.622 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.602+0000 7f9c26162700 1 -- 172.21.15.174:0/3826250944 reap_dead start 2020-04-02T23:21:46.622 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.602+0000 7f9c27bc5700 1 -- 172.21.15.174:0/3826250944 shutdown_connections 2020-04-02T23:21:46.622 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.602+0000 7f9c27bc5700 1 --2- 172.21.15.174:0/3826250944 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9c20138bb0 0x7f9c20131570 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:46.622 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.602+0000 7f9c27bc5700 1 -- 172.21.15.174:0/3826250944 >> 172.21.15.174:0/3826250944 conn(0x7f9c200aaf80 msgr2=0x7f9c200a4bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:46.623 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.603+0000 7f9c27bc5700 1 -- 172.21.15.174:0/3826250944 shutdown_connections 2020-04-02T23:21:46.623 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.603+0000 7f9c27bc5700 1 -- 172.21.15.174:0/3826250944 wait complete. 2020-04-02T23:21:46.623 INFO:teuthology.orchestra.run.smithi174.stdout:60129542150 2020-04-02T23:21:46.624 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:46.638 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.3 flush_pg_stats 2020-04-02T23:21:46.804 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.787+0000 7f433e395700 1 Processor -- start 2020-04-02T23:21:46.804 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.787+0000 7f433e395700 1 -- start start 2020-04-02T23:21:46.804 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.788+0000 7f433e395700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f43380a14f0 0x7f43380a4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:46.805 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.788+0000 7f433e395700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f433812f860 0x7f433812fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:46.805 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.788+0000 7f433e395700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43380a6aa0 con 0x7f43380a7a60 2020-04-02T23:21:46.805 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.788+0000 7f433e395700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43380a5e70 con 0x7f43380a14f0 2020-04-02T23:21:46.805 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.788+0000 7f433e395700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f433809ed60 con 0x7f433812f860 2020-04-02T23:21:46.805 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.788+0000 7f433c932700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f433812f860 0x7f433812fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:46.805 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.788+0000 7f432ffff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f43380a14f0 0x7f43380a4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:46.805 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.788+0000 7f4337fff700 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f43380a7a60 0x7f43380a3c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.174:51016/0 (socket says 172.21.15.174:51016) 2020-04-02T23:21:46.806 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.788+0000 7f4337fff700 1 -- 172.21.15.174:0/3280994405 learned_addr learned my addr 172.21.15.174:0/3280994405 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:21:46.806 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.788+0000 7f43377fe700 1 -- 172.21.15.174:0/3280994405 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1581961963 0 0) 0x7f43380a6aa0 con 0x7f43380a7a60 2020-04-02T23:21:46.806 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.788+0000 7f43377fe700 1 -- 172.21.15.174:0/3280994405 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4318003230 con 0x7f43380a7a60 2020-04-02T23:21:46.806 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.788+0000 7f433c932700 1 -- 172.21.15.174:0/3280994405 >> v2:172.21.15.196:3300/0 conn(0x7f43380a14f0 msgr2=0x7f43380a4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:46.806 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.788+0000 7f433c932700 1 --2- 172.21.15.174:0/3280994405 >> v2:172.21.15.196:3300/0 conn(0x7f43380a14f0 0x7f43380a4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:46.806 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.788+0000 7f433c932700 1 -- 172.21.15.174:0/3280994405 >> v1:172.21.15.196:6789/0 conn(0x7f43380a7a60 legacy=0x7f43380a3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:46.806 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.788+0000 7f433c932700 1 -- 172.21.15.174:0/3280994405 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43380a5430 con 0x7f433812f860 2020-04-02T23:21:46.807 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.788+0000 7f433c932700 1 --2- 172.21.15.174:0/3280994405 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f433812f860 0x7f433812fcf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f43300032b0 tx=0x7f4330007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:46.807 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.788+0000 7f433c932700 1 --2- 172.21.15.174:0/3280994405 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f433812f860 0x7f433812fcf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f43300032b0 tx=0x7f4330007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:46.807 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.788+0000 7f433c932700 1 --2- 172.21.15.174:0/3280994405 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f433812f860 0x7f433812fcf0 secure :-1 s=READY pgs=26 cs=0 l=1 rx=0x7f43300032b0 tx=0x7f4330007dc0).ready entity=mon.2 client_cookie=71f2590a739fd9a9 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:46.807 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.789+0000 7f433c932700 1 --2- 172.21.15.174:0/3280994405 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f433812f860 0x7f433812fcf0 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7f43300032b0 tx=0x7f4330007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:46.807 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.789+0000 7f43377fe700 1 -- 172.21.15.174:0/3280994405 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4330011d70 con 0x7f433812f860 2020-04-02T23:21:46.807 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.789+0000 7f433c932700 1 --2- 172.21.15.174:0/3280994405 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f433812f860 0x7f433812fcf0 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7f43300032b0 tx=0x7f4330007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:46.807 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.789+0000 7f433c932700 1 --2- 172.21.15.174:0/3280994405 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f433812f860 0x7f433812fcf0 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7f43300032b0 tx=0x7f4330007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:46.808 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.789+0000 7f43377fe700 1 -- 172.21.15.174:0/3280994405 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f433000a160 con 0x7f433812f860 2020-04-02T23:21:46.808 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.789+0000 7f43377fe700 1 -- 172.21.15.174:0/3280994405 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f433000a580 con 0x7f433812f860 2020-04-02T23:21:46.808 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.789+0000 7f433e395700 1 -- 172.21.15.174:0/3280994405 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f433812f860 msgr2=0x7f433812fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:46.808 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.789+0000 7f433e395700 1 --2- 172.21.15.174:0/3280994405 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f433812f860 0x7f433812fcf0 secure :-1 s=READY pgs=26 cs=0 l=1 rx=0x7f43300032b0 tx=0x7f4330007dc0).stop 2020-04-02T23:21:46.808 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.789+0000 7f433e395700 1 -- 172.21.15.174:0/3280994405 shutdown_connections 2020-04-02T23:21:46.808 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.789+0000 7f433e395700 1 --2- 172.21.15.174:0/3280994405 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f433812f860 0x7f433812fcf0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:46.813 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.789+0000 7f433e395700 1 --2- 172.21.15.174:0/3280994405 >> v2:172.21.15.196:3300/0 conn(0x7f43380a14f0 0x7f43380a4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:46.813 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.789+0000 7f433e395700 1 -- 172.21.15.174:0/3280994405 >> 172.21.15.174:0/3280994405 conn(0x7f43380aaf80 msgr2=0x7f43380a6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:46.813 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.789+0000 7f433e395700 1 -- 172.21.15.174:0/3280994405 shutdown_connections 2020-04-02T23:21:46.813 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.789+0000 7f433e395700 1 -- 172.21.15.174:0/3280994405 wait complete. 2020-04-02T23:21:46.813 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.790+0000 7f433e395700 1 Processor -- start 2020-04-02T23:21:46.813 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.790+0000 7f433e395700 1 -- start start 2020-04-02T23:21:46.813 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.791+0000 7f433e395700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f43380a14f0 0x7f43381366c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:46.814 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.791+0000 7f433e395700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f433812f860 0x7f4338135170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:46.814 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.791+0000 7f433e395700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4338136b20 con 0x7f43380a7a60 2020-04-02T23:21:46.814 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.791+0000 7f433e395700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43381318e0 con 0x7f43380a14f0 2020-04-02T23:21:46.814 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.791+0000 7f433e395700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4338131b80 con 0x7f433812f860 2020-04-02T23:21:46.814 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.791+0000 7f433c932700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f433812f860 0x7f4338135170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:46.814 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.791+0000 7f4337fff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f43380a14f0 0x7f43381366c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:46.815 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.791+0000 7f432ffff700 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f43380a7a60 0x7f433812b7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.174:51024/0 (socket says 172.21.15.174:51024) 2020-04-02T23:21:46.815 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.791+0000 7f433c932700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f433812f860 0x7f4338135170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.174:34482/0 (socket says 172.21.15.174:34482) 2020-04-02T23:21:46.815 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.791+0000 7f432ffff700 1 -- 172.21.15.174:0/474355704 learned_addr learned my addr 172.21.15.174:0/474355704 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:21:46.815 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.791+0000 7f4337fff700 1 -- 172.21.15.174:0/474355704 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f433812f860 msgr2=0x7f4338135170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:46.815 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.791+0000 7f4337fff700 1 --2- 172.21.15.174:0/474355704 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f433812f860 0x7f4338135170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:46.815 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.791+0000 7f4337fff700 1 -- 172.21.15.174:0/474355704 >> v1:172.21.15.196:6789/0 conn(0x7f43380a7a60 legacy=0x7f433812b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:46.816 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.791+0000 7f4335ffb700 1 -- 172.21.15.174:0/474355704 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2305326747 0 0) 0x7f4320001ec0 con 0x7f43380a7a60 2020-04-02T23:21:46.816 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.791+0000 7f4337fff700 1 -- 172.21.15.174:0/474355704 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4338131e20 con 0x7f43380a14f0 2020-04-02T23:21:46.816 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.791+0000 7f433c932700 1 --2- 172.21.15.174:0/474355704 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f433812f860 0x7f4338135170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:21:46.816 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.791+0000 7f4337fff700 1 --2- 172.21.15.174:0/474355704 >> v2:172.21.15.196:3300/0 conn(0x7f43380a14f0 0x7f43381366c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f43280010d0 tx=0x7f43280108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:46.816 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.791+0000 7f4337fff700 1 --2- 172.21.15.174:0/474355704 >> v2:172.21.15.196:3300/0 conn(0x7f43380a14f0 0x7f43381366c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f43280010d0 tx=0x7f43280108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:46.816 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.791+0000 7f4337fff700 1 --2- 172.21.15.174:0/474355704 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f43380a14f0 0x7f43381366c0 secure :-1 s=READY pgs=97 cs=0 l=1 rx=0x7f43280010d0 tx=0x7f43280108b0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:46.816 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.791+0000 7f4337fff700 1 --2- 172.21.15.174:0/474355704 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f43380a14f0 0x7f43381366c0 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7f43280010d0 tx=0x7f43280108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:46.817 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.791+0000 7f4335ffb700 1 -- 172.21.15.174:0/474355704 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4328005cc0 con 0x7f43380a14f0 2020-04-02T23:21:46.817 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.791+0000 7f4337fff700 1 --2- 172.21.15.174:0/474355704 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f43380a14f0 0x7f43381366c0 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7f43280010d0 tx=0x7f43280108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:46.817 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.791+0000 7f4337fff700 1 --2- 172.21.15.174:0/474355704 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f43380a14f0 0x7f43381366c0 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7f43280010d0 tx=0x7f43280108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:46.817 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.791+0000 7f4335ffb700 1 -- 172.21.15.174:0/474355704 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4328005e20 con 0x7f43380a14f0 2020-04-02T23:21:46.817 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.791+0000 7f433e395700 1 -- 172.21.15.174:0/474355704 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43381320c0 con 0x7f43380a14f0 2020-04-02T23:21:46.817 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.791+0000 7f4335ffb700 1 -- 172.21.15.174:0/474355704 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43280062b0 con 0x7f43380a14f0 2020-04-02T23:21:46.817 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.792+0000 7f433e395700 1 -- 172.21.15.174:0/474355704 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f433812bed0 con 0x7f43380a14f0 2020-04-02T23:21:46.818 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.792+0000 7f4337fff700 1 --2- 172.21.15.174:0/474355704 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f43380a14f0 0x7f43381366c0 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7f43280010d0 tx=0x7f43280108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:46.821 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.792+0000 7f433e395700 1 -- 172.21.15.174:0/474355704 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4338134ed0 con 0x7f43380a14f0 2020-04-02T23:21:46.821 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.793+0000 7f4335ffb700 1 -- 172.21.15.174:0/474355704 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f43280064b0 con 0x7f43380a14f0 2020-04-02T23:21:46.821 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.793+0000 7f4337fff700 1 --2- 172.21.15.174:0/474355704 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f43380a14f0 0x7f43381366c0 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7f43280010d0 tx=0x7f43280108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:46.821 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.793+0000 7f4335ffb700 1 --2- 172.21.15.174:0/474355704 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f431c04d420 0x7f431c04f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:46.821 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.793+0000 7f4337fff700 1 --2- 172.21.15.174:0/474355704 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f43380a14f0 0x7f43381366c0 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7f43280010d0 tx=0x7f43280108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:46.821 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.793+0000 7f4335ffb700 1 -- 172.21.15.174:0/474355704 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4328060ea0 con 0x7f43380a14f0 2020-04-02T23:21:46.821 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.793+0000 7f4335ffb700 1 --2- 172.21.15.174:0/474355704 >> [v2:172.21.15.174:6824/24972,v1:172.21.15.174:6825/24972] conn(0x7f431c054000 0x7f431c056420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:46.822 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.793+0000 7f432ffff700 1 --2- 172.21.15.174:0/474355704 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f431c04d420 0x7f431c04f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:46.822 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.793+0000 7f4335ffb700 1 -- 172.21.15.174:0/474355704 --> [v2:172.21.15.174:6824/24972,v1:172.21.15.174:6825/24972] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f431c0569e0 con 0x7f431c054000 2020-04-02T23:21:46.822 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.793+0000 7f4335ffb700 1 -- 172.21.15.174:0/474355704 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4328040060 con 0x7f43380a14f0 2020-04-02T23:21:46.822 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.793+0000 7f433c932700 1 --2- 172.21.15.174:0/474355704 >> [v2:172.21.15.174:6824/24972,v1:172.21.15.174:6825/24972] conn(0x7f431c054000 0x7f431c056420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:46.822 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.793+0000 7f432ffff700 1 --2- 172.21.15.174:0/474355704 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f431c04d420 0x7f431c04f8e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4320007fe0 tx=0x7f4320002250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:46.823 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.793+0000 7f432ffff700 1 --2- 172.21.15.174:0/474355704 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f431c04d420 0x7f431c04f8e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4320007fe0 tx=0x7f4320002250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:46.823 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.793+0000 7f432ffff700 1 --2- 172.21.15.174:0/474355704 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f431c04d420 0x7f431c04f8e0 secure :-1 s=READY pgs=71 cs=0 l=1 rx=0x7f4320007fe0 tx=0x7f4320002250).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:46.823 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.793+0000 7f433c932700 1 --2- 172.21.15.174:0/474355704 >> [v2:172.21.15.174:6824/24972,v1:172.21.15.174:6825/24972] conn(0x7f431c054000 0x7f431c056420 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:46.823 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.794+0000 7f4335ffb700 1 -- 172.21.15.174:0/474355704 <== osd.3 v2:172.21.15.174:6824/24972 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21407 (crc 0 0 0) 0x7f431c0569e0 con 0x7f431c054000 2020-04-02T23:21:46.825 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.809+0000 7f433e395700 1 -- 172.21.15.174:0/474355704 --> [v2:172.21.15.174:6824/24972,v1:172.21.15.174:6825/24972] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4338056c50 con 0x7f431c054000 2020-04-02T23:21:46.825 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.810+0000 7f4335ffb700 1 -- 172.21.15.174:0/474355704 <== osd.3 v2:172.21.15.174:6824/24972 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4338056c50 con 0x7f431c054000 2020-04-02T23:21:46.826 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.810+0000 7f433e395700 1 -- 172.21.15.174:0/474355704 >> [v2:172.21.15.174:6824/24972,v1:172.21.15.174:6825/24972] conn(0x7f431c054000 msgr2=0x7f431c056420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:46.826 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.810+0000 7f433e395700 1 --2- 172.21.15.174:0/474355704 >> [v2:172.21.15.174:6824/24972,v1:172.21.15.174:6825/24972] conn(0x7f431c054000 0x7f431c056420 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:46.826 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.810+0000 7f433e395700 1 -- 172.21.15.174:0/474355704 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f431c04d420 msgr2=0x7f431c04f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:46.826 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.810+0000 7f433e395700 1 --2- 172.21.15.174:0/474355704 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f431c04d420 0x7f431c04f8e0 secure :-1 s=READY pgs=71 cs=0 l=1 rx=0x7f4320007fe0 tx=0x7f4320002250).stop 2020-04-02T23:21:46.826 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.810+0000 7f433e395700 1 -- 172.21.15.174:0/474355704 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f43380a14f0 msgr2=0x7f43381366c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:46.826 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.810+0000 7f433e395700 1 --2- 172.21.15.174:0/474355704 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f43380a14f0 0x7f43381366c0 secure :-1 s=READY pgs=97 cs=0 l=1 rx=0x7f43280010d0 tx=0x7f43280108b0).stop 2020-04-02T23:21:46.827 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.810+0000 7f433c932700 1 -- 172.21.15.174:0/474355704 reap_dead start 2020-04-02T23:21:46.827 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.810+0000 7f433e395700 1 -- 172.21.15.174:0/474355704 shutdown_connections 2020-04-02T23:21:46.827 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.810+0000 7f433e395700 1 --2- 172.21.15.174:0/474355704 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f43380a14f0 0x7f43381366c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:46.827 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.810+0000 7f433e395700 1 -- 172.21.15.174:0/474355704 >> 172.21.15.174:0/474355704 conn(0x7f43380aaf80 msgr2=0x7f433805ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:46.827 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.810+0000 7f433e395700 1 -- 172.21.15.174:0/474355704 shutdown_connections 2020-04-02T23:21:46.827 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.810+0000 7f433e395700 1 -- 172.21.15.174:0/474355704 wait complete. 2020-04-02T23:21:46.836 INFO:teuthology.orchestra.run.smithi174.stdout:60129542149 2020-04-02T23:21:46.836 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:46.850 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.4 flush_pg_stats 2020-04-02T23:21:46.996 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.993+0000 7f293d232700 1 Processor -- start 2020-04-02T23:21:46.996 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.993+0000 7f293d232700 1 -- start start 2020-04-02T23:21:47.011 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.994+0000 7f293d232700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f29380a62e0 0x7f293805ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:47.011 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.994+0000 7f293d232700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f293813b600 0x7f293813ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:47.011 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.994+0000 7f293d232700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29380a9150 con 0x7f29380a5f00 2020-04-02T23:21:47.011 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.994+0000 7f293d232700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29380aa720 con 0x7f29380a62e0 2020-04-02T23:21:47.011 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.994+0000 7f293d232700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29380a6770 con 0x7f293813b600 2020-04-02T23:21:47.012 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.994+0000 7f293659c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f29380a62e0 0x7f293805ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:47.012 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.994+0000 7f293659c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f29380a62e0 0x7f293805ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:39900/0 (socket says 172.21.15.174:39900) 2020-04-02T23:21:47.012 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.994+0000 7f293659c700 1 -- 172.21.15.174:0/3001867441 learned_addr learned my addr 172.21.15.174:0/3001867441 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:21:47.012 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.995+0000 7f293759e700 1 --2- 172.21.15.174:0/3001867441 >> v2:172.21.15.196:3300/0 conn(0x7f293813b600 0x7f293813ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:47.012 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.995+0000 7f293659c700 1 -- 172.21.15.174:0/3001867441 >> v2:172.21.15.196:3300/0 conn(0x7f293813b600 msgr2=0x7f293813ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:47.012 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.995+0000 7f293659c700 1 --2- 172.21.15.174:0/3001867441 >> v2:172.21.15.196:3300/0 conn(0x7f293813b600 0x7f293813ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:47.013 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.995+0000 7f293659c700 1 -- 172.21.15.174:0/3001867441 >> v1:172.21.15.174:6789/0 conn(0x7f29380a5f00 legacy=0x7f29380a9a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:47.013 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.995+0000 7f293659c700 1 -- 172.21.15.174:0/3001867441 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f293805c3b0 con 0x7f29380a62e0 2020-04-02T23:21:47.013 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.995+0000 7f2935d9b700 1 -- 172.21.15.174:0/3001867441 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1511439585 0 0) 0x7f29380a9150 con 0x7f29380a5f00 2020-04-02T23:21:47.013 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.995+0000 7f293759e700 1 --2- 172.21.15.174:0/3001867441 >> v2:172.21.15.196:3300/0 conn(0x7f293813b600 0x7f293813ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-02T23:21:47.013 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.995+0000 7f293659c700 1 --2- 172.21.15.174:0/3001867441 >> v2:172.21.15.174:3300/0 conn(0x7f29380a62e0 0x7f293805ffc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2920002f30 tx=0x7f2920007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:47.013 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.995+0000 7f293659c700 1 --2- 172.21.15.174:0/3001867441 >> v2:172.21.15.174:3300/0 conn(0x7f29380a62e0 0x7f293805ffc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2920002f30 tx=0x7f2920007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:47.013 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.995+0000 7f293659c700 1 --2- 172.21.15.174:0/3001867441 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f29380a62e0 0x7f293805ffc0 secure :-1 s=READY pgs=128 cs=0 l=1 rx=0x7f2920002f30 tx=0x7f2920007a40).ready entity=mon.0 client_cookie=7d1a70de31684463 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:47.014 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.995+0000 7f293659c700 1 --2- 172.21.15.174:0/3001867441 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f29380a62e0 0x7f293805ffc0 secure :-1 s=THROTTLE_DONE pgs=128 cs=0 l=1 rx=0x7f2920002f30 tx=0x7f2920007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:47.014 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.995+0000 7f2935d9b700 1 -- 172.21.15.174:0/3001867441 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2920011720 con 0x7f29380a62e0 2020-04-02T23:21:47.014 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.995+0000 7f293659c700 1 --2- 172.21.15.174:0/3001867441 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f29380a62e0 0x7f293805ffc0 secure :-1 s=THROTTLE_DONE pgs=128 cs=0 l=1 rx=0x7f2920002f30 tx=0x7f2920007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:47.014 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.995+0000 7f2935d9b700 1 -- 172.21.15.174:0/3001867441 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2920011880 con 0x7f29380a62e0 2020-04-02T23:21:47.014 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.995+0000 7f293659c700 1 --2- 172.21.15.174:0/3001867441 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f29380a62e0 0x7f293805ffc0 secure :-1 s=THROTTLE_DONE pgs=128 cs=0 l=1 rx=0x7f2920002f30 tx=0x7f2920007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:47.014 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.995+0000 7f2935d9b700 1 -- 172.21.15.174:0/3001867441 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2920011c20 con 0x7f29380a62e0 2020-04-02T23:21:47.014 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.995+0000 7f293d232700 1 -- 172.21.15.174:0/3001867441 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f29380a62e0 msgr2=0x7f293805ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:47.015 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.995+0000 7f293d232700 1 --2- 172.21.15.174:0/3001867441 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f29380a62e0 0x7f293805ffc0 secure :-1 s=READY pgs=128 cs=0 l=1 rx=0x7f2920002f30 tx=0x7f2920007a40).stop 2020-04-02T23:21:47.015 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.995+0000 7f293d232700 1 -- 172.21.15.174:0/3001867441 shutdown_connections 2020-04-02T23:21:47.015 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.995+0000 7f293d232700 1 --2- 172.21.15.174:0/3001867441 >> v2:172.21.15.196:3300/0 conn(0x7f293813b600 0x7f293813ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:47.019 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.995+0000 7f293d232700 1 --2- 172.21.15.174:0/3001867441 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f29380a62e0 0x7f293805ffc0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:47.019 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.995+0000 7f293d232700 1 -- 172.21.15.174:0/3001867441 >> 172.21.15.174:0/3001867441 conn(0x7f29380ab320 msgr2=0x7f29380ab730 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:47.019 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.995+0000 7f293d232700 1 -- 172.21.15.174:0/3001867441 shutdown_connections 2020-04-02T23:21:47.020 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.995+0000 7f293d232700 1 -- 172.21.15.174:0/3001867441 wait complete. 2020-04-02T23:21:47.020 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.996+0000 7f293d232700 1 Processor -- start 2020-04-02T23:21:47.020 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.996+0000 7f293d232700 1 -- start start 2020-04-02T23:21:47.020 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.997+0000 7f293d232700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f29380a5f00 0x7f2938134620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:47.020 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.997+0000 7f293d232700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f29380a62e0 0x7f29381333b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:47.023 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.997+0000 7f293d232700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2938134a80 con 0x7f293813b600 2020-04-02T23:21:47.023 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.997+0000 7f293d232700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29381351a0 con 0x7f29380a5f00 2020-04-02T23:21:47.023 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.997+0000 7f293d232700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2938133ee0 con 0x7f29380a62e0 2020-04-02T23:21:47.023 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.997+0000 7f293659c700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f29380a62e0 0x7f29381333b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:47.023 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.997+0000 7f2936d9d700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f29380a5f00 0x7f2938134620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:47.023 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.997+0000 7f293659c700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f29380a62e0 0x7f29381333b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.174:34492/0 (socket says 172.21.15.174:34492) 2020-04-02T23:21:47.023 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.997+0000 7f293659c700 1 -- 172.21.15.174:0/3552684514 learned_addr learned my addr 172.21.15.174:0/3552684514 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:21:47.024 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.997+0000 7f293759e700 1 --1- 172.21.15.174:0/3552684514 >> v1:172.21.15.196:6789/0 conn(0x7f293813b600 0x7f2938148ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.174:51040/0 (socket says 172.21.15.174:51040) 2020-04-02T23:21:47.024 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.998+0000 7f293659c700 1 -- 172.21.15.174:0/3552684514 >> v2:172.21.15.196:3300/0 conn(0x7f29380a5f00 msgr2=0x7f2938134620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:47.024 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.998+0000 7f293659c700 1 --2- 172.21.15.174:0/3552684514 >> v2:172.21.15.196:3300/0 conn(0x7f29380a5f00 0x7f2938134620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:47.024 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.998+0000 7f293659c700 1 -- 172.21.15.174:0/3552684514 >> v1:172.21.15.196:6789/0 conn(0x7f293813b600 legacy=0x7f2938148ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:47.024 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.998+0000 7f293659c700 1 -- 172.21.15.174:0/3552684514 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2938134180 con 0x7f29380a62e0 2020-04-02T23:21:47.024 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.998+0000 7f2936d9d700 1 --2- 172.21.15.174:0/3552684514 >> v2:172.21.15.196:3300/0 conn(0x7f29380a5f00 0x7f2938134620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:21:47.024 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.998+0000 7f293659c700 1 --2- 172.21.15.174:0/3552684514 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f29380a62e0 0x7f29381333b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2920002f30 tx=0x7f2920007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:47.025 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.998+0000 7f293659c700 1 --2- 172.21.15.174:0/3552684514 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f29380a62e0 0x7f29381333b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2920002f30 tx=0x7f2920007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:47.025 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.998+0000 7f293659c700 1 --2- 172.21.15.174:0/3552684514 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f29380a62e0 0x7f29381333b0 secure :-1 s=READY pgs=27 cs=0 l=1 rx=0x7f2920002f30 tx=0x7f2920007a40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:47.025 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.998+0000 7f293659c700 1 --2- 172.21.15.174:0/3552684514 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f29380a62e0 0x7f29381333b0 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7f2920002f30 tx=0x7f2920007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:47.025 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.998+0000 7f292ffff700 1 -- 172.21.15.174:0/3552684514 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2920007340 con 0x7f29380a62e0 2020-04-02T23:21:47.025 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.998+0000 7f293659c700 1 --2- 172.21.15.174:0/3552684514 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f29380a62e0 0x7f29381333b0 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7f2920002f30 tx=0x7f2920007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:47.025 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.998+0000 7f292ffff700 1 -- 172.21.15.174:0/3552684514 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29200074a0 con 0x7f29380a62e0 2020-04-02T23:21:47.025 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.998+0000 7f293659c700 1 --2- 172.21.15.174:0/3552684514 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f29380a62e0 0x7f29381333b0 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7f2920002f30 tx=0x7f2920007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:47.025 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.998+0000 7f292ffff700 1 -- 172.21.15.174:0/3552684514 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f29200058b0 con 0x7f29380a62e0 2020-04-02T23:21:47.026 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.998+0000 7f293d232700 1 -- 172.21.15.174:0/3552684514 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2938138a40 con 0x7f29380a62e0 2020-04-02T23:21:47.026 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.998+0000 7f293d232700 1 -- 172.21.15.174:0/3552684514 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29381339d0 con 0x7f29380a62e0 2020-04-02T23:21:47.026 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.999+0000 7f293d232700 1 -- 172.21.15.174:0/3552684514 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2938134380 con 0x7f29380a62e0 2020-04-02T23:21:47.026 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.999+0000 7f293659c700 1 --2- 172.21.15.174:0/3552684514 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f29380a62e0 0x7f29381333b0 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7f2920002f30 tx=0x7f2920007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:47.026 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.999+0000 7f292ffff700 1 -- 172.21.15.174:0/3552684514 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f2920005af0 con 0x7f29380a62e0 2020-04-02T23:21:47.026 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.999+0000 7f293659c700 1 --2- 172.21.15.174:0/3552684514 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f29380a62e0 0x7f29381333b0 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7f2920002f30 tx=0x7f2920007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:47.026 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.999+0000 7f293659c700 1 --2- 172.21.15.174:0/3552684514 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f29380a62e0 0x7f29381333b0 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7f2920002f30 tx=0x7f2920007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:47.027 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.999+0000 7f292ffff700 1 --2- 172.21.15.174:0/3552684514 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f291c04d5a0 0x7f291c04fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:47.027 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.999+0000 7f292ffff700 1 -- 172.21.15.174:0/3552684514 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2920061690 con 0x7f29380a62e0 2020-04-02T23:21:47.027 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.999+0000 7f292ffff700 1 --2- 172.21.15.174:0/3552684514 >> [v2:172.21.15.196:6802/24034,v1:172.21.15.196:6803/24034] conn(0x7f291c054180 0x7f291c0565a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:47.027 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.999+0000 7f292ffff700 1 -- 172.21.15.174:0/3552684514 --> [v2:172.21.15.196:6802/24034,v1:172.21.15.196:6803/24034] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f291c056b60 con 0x7f291c054180 2020-04-02T23:21:47.027 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.999+0000 7f292ffff700 1 -- 172.21.15.174:0/3552684514 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2920062bb0 con 0x7f29380a62e0 2020-04-02T23:21:47.027 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:46.999+0000 7f2936d9d700 1 --2- 172.21.15.174:0/3552684514 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f291c04d5a0 0x7f291c04fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:47.027 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.000+0000 7f293759e700 1 --2- 172.21.15.174:0/3552684514 >> [v2:172.21.15.196:6802/24034,v1:172.21.15.196:6803/24034] conn(0x7f291c054180 0x7f291c0565a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:47.028 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.000+0000 7f2936d9d700 1 --2- 172.21.15.174:0/3552684514 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f291c04d5a0 0x7f291c04fa60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2928000b80 tx=0x7f29380445b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:47.028 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.000+0000 7f2936d9d700 1 --2- 172.21.15.174:0/3552684514 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f291c04d5a0 0x7f291c04fa60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2928000b80 tx=0x7f29380445b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:47.028 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.000+0000 7f2936d9d700 1 --2- 172.21.15.174:0/3552684514 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f291c04d5a0 0x7f291c04fa60 secure :-1 s=READY pgs=72 cs=0 l=1 rx=0x7f2928000b80 tx=0x7f29380445b0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:47.028 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.000+0000 7f293759e700 1 --2- 172.21.15.174:0/3552684514 >> [v2:172.21.15.196:6802/24034,v1:172.21.15.196:6803/24034] conn(0x7f291c054180 0x7f291c0565a0 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:47.028 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.001+0000 7f292ffff700 1 -- 172.21.15.174:0/3552684514 <== osd.4 v2:172.21.15.196:6802/24034 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21407 (crc 0 0 0) 0x7f291c056b60 con 0x7f291c054180 2020-04-02T23:21:47.031 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.016+0000 7f293d232700 1 -- 172.21.15.174:0/3552684514 --> [v2:172.21.15.196:6802/24034,v1:172.21.15.196:6803/24034] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2938056c50 con 0x7f291c054180 2020-04-02T23:21:47.031 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.016+0000 7f292ffff700 1 -- 172.21.15.174:0/3552684514 <== osd.4 v2:172.21.15.196:6802/24034 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2938056c50 con 0x7f291c054180 2020-04-02T23:21:47.031 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.017+0000 7f293d232700 1 -- 172.21.15.174:0/3552684514 >> [v2:172.21.15.196:6802/24034,v1:172.21.15.196:6803/24034] conn(0x7f291c054180 msgr2=0x7f291c0565a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:47.031 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.017+0000 7f293d232700 1 --2- 172.21.15.174:0/3552684514 >> [v2:172.21.15.196:6802/24034,v1:172.21.15.196:6803/24034] conn(0x7f291c054180 0x7f291c0565a0 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:47.031 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.017+0000 7f293d232700 1 -- 172.21.15.174:0/3552684514 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f291c04d5a0 msgr2=0x7f291c04fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:47.031 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.017+0000 7f293d232700 1 --2- 172.21.15.174:0/3552684514 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f291c04d5a0 0x7f291c04fa60 secure :-1 s=READY pgs=72 cs=0 l=1 rx=0x7f2928000b80 tx=0x7f29380445b0).stop 2020-04-02T23:21:47.031 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.017+0000 7f293d232700 1 -- 172.21.15.174:0/3552684514 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f29380a62e0 msgr2=0x7f29381333b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:47.032 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.017+0000 7f293d232700 1 --2- 172.21.15.174:0/3552684514 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f29380a62e0 0x7f29381333b0 secure :-1 s=READY pgs=27 cs=0 l=1 rx=0x7f2920002f30 tx=0x7f2920007a40).stop 2020-04-02T23:21:47.032 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.017+0000 7f293759e700 1 -- 172.21.15.174:0/3552684514 reap_dead start 2020-04-02T23:21:47.032 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.017+0000 7f293d232700 1 -- 172.21.15.174:0/3552684514 shutdown_connections 2020-04-02T23:21:47.032 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.017+0000 7f293d232700 1 -- 172.21.15.174:0/3552684514 >> 172.21.15.174:0/3552684514 conn(0x7f29380ab320 msgr2=0x7f29380a97b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:47.032 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.017+0000 7f293d232700 1 -- 172.21.15.174:0/3552684514 shutdown_connections 2020-04-02T23:21:47.032 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.017+0000 7f293d232700 1 -- 172.21.15.174:0/3552684514 wait complete. 2020-04-02T23:21:47.032 INFO:teuthology.orchestra.run.smithi174.stdout:60129542150 2020-04-02T23:21:47.033 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:47.047 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.5 flush_pg_stats 2020-04-02T23:21:47.200 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.190+0000 7f17495e2700 1 Processor -- start 2020-04-02T23:21:47.200 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.190+0000 7f17495e2700 1 -- start start 2020-04-02T23:21:47.200 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.191+0000 7f17495e2700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f17440a38f0 0x7f1744138480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:47.201 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.191+0000 7f17495e2700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f17441388e0 0x7f1744134d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:47.201 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.191+0000 7f17495e2700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17440a3e30 con 0x7f17440a7a60 2020-04-02T23:21:47.201 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.191+0000 7f17495e2700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17440a40d0 con 0x7f17440a38f0 2020-04-02T23:21:47.201 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.191+0000 7f17495e2700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17440a4370 con 0x7f17441388e0 2020-04-02T23:21:47.201 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.191+0000 7f17437fe700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f17441388e0 0x7f1744134d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:47.201 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.191+0000 7f1742ffd700 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f17440a7a60 0x7f17440a1fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.174:51046/0 (socket says 172.21.15.174:51046) 2020-04-02T23:21:47.201 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.191+0000 7f17427fc700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f17440a38f0 0x7f1744138480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:47.202 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.191+0000 7f1742ffd700 1 -- 172.21.15.174:0/1182546793 learned_addr learned my addr 172.21.15.174:0/1182546793 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:21:47.202 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.191+0000 7f1741ffb700 1 -- 172.21.15.174:0/1182546793 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 727618918 0 0) 0x7f17440a3e30 con 0x7f17440a7a60 2020-04-02T23:21:47.202 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.191+0000 7f1741ffb700 1 -- 172.21.15.174:0/1182546793 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1728003230 con 0x7f17440a7a60 2020-04-02T23:21:47.202 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.191+0000 7f17427fc700 1 -- 172.21.15.174:0/1182546793 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f17441388e0 msgr2=0x7f1744134d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:47.202 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.191+0000 7f17427fc700 1 --2- 172.21.15.174:0/1182546793 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f17441388e0 0x7f1744134d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:47.202 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.191+0000 7f17427fc700 1 -- 172.21.15.174:0/1182546793 >> v1:172.21.15.196:6789/0 conn(0x7f17440a7a60 legacy=0x7f17440a1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:47.202 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.191+0000 7f17427fc700 1 -- 172.21.15.174:0/1182546793 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1744138d20 con 0x7f17440a38f0 2020-04-02T23:21:47.203 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.191+0000 7f17437fe700 1 --2- 172.21.15.174:0/1182546793 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f17441388e0 0x7f1744134d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:21:47.203 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.191+0000 7f17427fc700 1 --2- 172.21.15.174:0/1182546793 >> v2:172.21.15.196:3300/0 conn(0x7f17440a38f0 0x7f1744138480 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1738002f30 tx=0x7f1738007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:47.203 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.191+0000 7f17427fc700 1 --2- 172.21.15.174:0/1182546793 >> v2:172.21.15.196:3300/0 conn(0x7f17440a38f0 0x7f1744138480 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1738002f30 tx=0x7f1738007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:47.203 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.191+0000 7f17427fc700 1 --2- 172.21.15.174:0/1182546793 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f17440a38f0 0x7f1744138480 secure :-1 s=READY pgs=100 cs=0 l=1 rx=0x7f1738002f30 tx=0x7f1738007a40).ready entity=mon.1 client_cookie=dad81b22585df071 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:47.203 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.192+0000 7f17427fc700 1 --2- 172.21.15.174:0/1182546793 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f17440a38f0 0x7f1744138480 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f1738002f30 tx=0x7f1738007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:47.203 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.192+0000 7f1741ffb700 1 -- 172.21.15.174:0/1182546793 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1738011310 con 0x7f17440a38f0 2020-04-02T23:21:47.203 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.192+0000 7f17427fc700 1 --2- 172.21.15.174:0/1182546793 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f17440a38f0 0x7f1744138480 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f1738002f30 tx=0x7f1738007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:47.203 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.192+0000 7f1741ffb700 1 -- 172.21.15.174:0/1182546793 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1738011470 con 0x7f17440a38f0 2020-04-02T23:21:47.204 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.192+0000 7f17427fc700 1 --2- 172.21.15.174:0/1182546793 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f17440a38f0 0x7f1744138480 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f1738002f30 tx=0x7f1738007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:47.204 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.192+0000 7f1741ffb700 1 -- 172.21.15.174:0/1182546793 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1738011850 con 0x7f17440a38f0 2020-04-02T23:21:47.204 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.192+0000 7f17495e2700 1 -- 172.21.15.174:0/1182546793 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f17440a38f0 msgr2=0x7f1744138480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:47.204 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.192+0000 7f17495e2700 1 --2- 172.21.15.174:0/1182546793 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f17440a38f0 0x7f1744138480 secure :-1 s=READY pgs=100 cs=0 l=1 rx=0x7f1738002f30 tx=0x7f1738007a40).stop 2020-04-02T23:21:47.204 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.192+0000 7f17495e2700 1 -- 172.21.15.174:0/1182546793 shutdown_connections 2020-04-02T23:21:47.204 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.192+0000 7f17495e2700 1 --2- 172.21.15.174:0/1182546793 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f17441388e0 0x7f1744134d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:47.205 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.192+0000 7f17495e2700 1 --2- 172.21.15.174:0/1182546793 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f17440a38f0 0x7f1744138480 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:47.205 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.192+0000 7f17495e2700 1 -- 172.21.15.174:0/1182546793 >> 172.21.15.174:0/1182546793 conn(0x7f17440aaf80 msgr2=0x7f17440a6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:47.205 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.192+0000 7f17495e2700 1 -- 172.21.15.174:0/1182546793 shutdown_connections 2020-04-02T23:21:47.205 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.192+0000 7f17495e2700 1 -- 172.21.15.174:0/1182546793 wait complete. 2020-04-02T23:21:47.205 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.193+0000 7f17495e2700 1 Processor -- start 2020-04-02T23:21:47.205 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.193+0000 7f17495e2700 1 -- start start 2020-04-02T23:21:47.205 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.194+0000 7f17495e2700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f17440a38f0 0x7f174405b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:47.205 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.194+0000 7f17495e2700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f17440a7a60 0x7f1744147260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:47.206 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.194+0000 7f17495e2700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1744146880 con 0x7f17441388e0 2020-04-02T23:21:47.206 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.194+0000 7f17495e2700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1744146b20 con 0x7f17440a7a60 2020-04-02T23:21:47.206 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.194+0000 7f17495e2700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1744146dc0 con 0x7f17440a38f0 2020-04-02T23:21:47.206 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.194+0000 7f1742ffd700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f17440a38f0 0x7f174405b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:47.206 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.194+0000 7f17427fc700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f17440a7a60 0x7f1744147260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:47.206 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.194+0000 7f17437fe700 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f17441388e0 0x7f1744131930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.174:51056/0 (socket says 172.21.15.174:51056) 2020-04-02T23:21:47.206 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.194+0000 7f17437fe700 1 -- 172.21.15.174:0/2199576502 learned_addr learned my addr 172.21.15.174:0/2199576502 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:21:47.207 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.194+0000 7f17427fc700 1 -- 172.21.15.174:0/2199576502 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f17440a38f0 msgr2=0x7f174405b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:47.207 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.194+0000 7f17427fc700 1 --2- 172.21.15.174:0/2199576502 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f17440a38f0 0x7f174405b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:47.207 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.194+0000 7f17427fc700 1 -- 172.21.15.174:0/2199576502 >> v1:172.21.15.196:6789/0 conn(0x7f17441388e0 legacy=0x7f1744131930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:47.207 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.194+0000 7f1733fff700 1 -- 172.21.15.174:0/2199576502 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 958635459 0 0) 0x7f1744146880 con 0x7f17441388e0 2020-04-02T23:21:47.207 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.194+0000 7f17427fc700 1 -- 172.21.15.174:0/2199576502 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17441476c0 con 0x7f17440a7a60 2020-04-02T23:21:47.207 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.194+0000 7f17427fc700 1 --2- 172.21.15.174:0/2199576502 >> v2:172.21.15.196:3300/0 conn(0x7f17440a7a60 0x7f1744147260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1738002f30 tx=0x7f1738007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:47.207 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.194+0000 7f17427fc700 1 --2- 172.21.15.174:0/2199576502 >> v2:172.21.15.196:3300/0 conn(0x7f17440a7a60 0x7f1744147260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1738002f30 tx=0x7f1738007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:47.207 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.194+0000 7f17427fc700 1 --2- 172.21.15.174:0/2199576502 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f17440a7a60 0x7f1744147260 secure :-1 s=READY pgs=102 cs=0 l=1 rx=0x7f1738002f30 tx=0x7f1738007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:47.208 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.195+0000 7f17427fc700 1 --2- 172.21.15.174:0/2199576502 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f17440a7a60 0x7f1744147260 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7f1738002f30 tx=0x7f1738007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:47.208 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.195+0000 7f1733fff700 1 -- 172.21.15.174:0/2199576502 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1738011710 con 0x7f17440a7a60 2020-04-02T23:21:47.208 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.195+0000 7f17427fc700 1 --2- 172.21.15.174:0/2199576502 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f17440a7a60 0x7f1744147260 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7f1738002f30 tx=0x7f1738007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:47.208 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.195+0000 7f1733fff700 1 -- 172.21.15.174:0/2199576502 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1738011870 con 0x7f17440a7a60 2020-04-02T23:21:47.208 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.195+0000 7f17427fc700 1 --2- 172.21.15.174:0/2199576502 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f17440a7a60 0x7f1744147260 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7f1738002f30 tx=0x7f1738007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:47.208 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.195+0000 7f1733fff700 1 -- 172.21.15.174:0/2199576502 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1738007340 con 0x7f17440a7a60 2020-04-02T23:21:47.208 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.195+0000 7f17495e2700 1 -- 172.21.15.174:0/2199576502 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17440a1a20 con 0x7f17440a7a60 2020-04-02T23:21:47.209 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.195+0000 7f17495e2700 1 -- 172.21.15.174:0/2199576502 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17440a16e0 con 0x7f17440a7a60 2020-04-02T23:21:47.209 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.195+0000 7f17427fc700 1 --2- 172.21.15.174:0/2199576502 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f17440a7a60 0x7f1744147260 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7f1738002f30 tx=0x7f1738007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:47.209 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.195+0000 7f17495e2700 1 -- 172.21.15.174:0/2199576502 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1744056c50 con 0x7f17440a7a60 2020-04-02T23:21:47.209 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.196+0000 7f1733fff700 1 -- 172.21.15.174:0/2199576502 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f17380056c0 con 0x7f17440a7a60 2020-04-02T23:21:47.209 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.196+0000 7f17427fc700 1 --2- 172.21.15.174:0/2199576502 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f17440a7a60 0x7f1744147260 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7f1738002f30 tx=0x7f1738007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:47.209 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.196+0000 7f17427fc700 1 --2- 172.21.15.174:0/2199576502 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f17440a7a60 0x7f1744147260 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7f1738002f30 tx=0x7f1738007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:47.209 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.196+0000 7f1733fff700 1 --2- 172.21.15.174:0/2199576502 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f172004d4a0 0x7f172004f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:47.210 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.196+0000 7f1733fff700 1 -- 172.21.15.174:0/2199576502 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1738061730 con 0x7f17440a7a60 2020-04-02T23:21:47.210 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.196+0000 7f1733fff700 1 --2- 172.21.15.174:0/2199576502 >> [v2:172.21.15.196:6810/24190,v1:172.21.15.196:6811/24190] conn(0x7f1720054080 0x7f17200564a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:47.210 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.196+0000 7f1742ffd700 1 --2- 172.21.15.174:0/2199576502 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f172004d4a0 0x7f172004f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:47.210 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.196+0000 7f1733fff700 1 -- 172.21.15.174:0/2199576502 --> [v2:172.21.15.196:6810/24190,v1:172.21.15.196:6811/24190] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1720056a60 con 0x7f1720054080 2020-04-02T23:21:47.210 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.196+0000 7f1733fff700 1 -- 172.21.15.174:0/2199576502 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1738062c50 con 0x7f17440a7a60 2020-04-02T23:21:47.210 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.196+0000 7f1742ffd700 1 --2- 172.21.15.174:0/2199576502 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f172004d4a0 0x7f172004f960 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f173c001450 tx=0x7f173c0020c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:47.210 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.196+0000 7f17437fe700 1 --2- 172.21.15.174:0/2199576502 >> [v2:172.21.15.196:6810/24190,v1:172.21.15.196:6811/24190] conn(0x7f1720054080 0x7f17200564a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:47.211 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.196+0000 7f1742ffd700 1 --2- 172.21.15.174:0/2199576502 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f172004d4a0 0x7f172004f960 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f173c001450 tx=0x7f173c0020c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:47.211 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.196+0000 7f1742ffd700 1 --2- 172.21.15.174:0/2199576502 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f172004d4a0 0x7f172004f960 secure :-1 s=READY pgs=73 cs=0 l=1 rx=0x7f173c001450 tx=0x7f173c0020c0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:47.211 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.197+0000 7f17437fe700 1 --2- 172.21.15.174:0/2199576502 >> [v2:172.21.15.196:6810/24190,v1:172.21.15.196:6811/24190] conn(0x7f1720054080 0x7f17200564a0 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:47.211 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.197+0000 7f1733fff700 1 -- 172.21.15.174:0/2199576502 <== osd.5 v2:172.21.15.196:6810/24190 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21407 (crc 0 0 0) 0x7f1720056a60 con 0x7f1720054080 2020-04-02T23:21:47.215 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.213+0000 7f17495e2700 1 -- 172.21.15.174:0/2199576502 --> [v2:172.21.15.196:6810/24190,v1:172.21.15.196:6811/24190] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1744146f30 con 0x7f1720054080 2020-04-02T23:21:47.216 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.213+0000 7f1733fff700 1 -- 172.21.15.174:0/2199576502 <== osd.5 v2:172.21.15.196:6810/24190 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1744146f30 con 0x7f1720054080 2020-04-02T23:21:47.217 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.214+0000 7f17495e2700 1 -- 172.21.15.174:0/2199576502 >> [v2:172.21.15.196:6810/24190,v1:172.21.15.196:6811/24190] conn(0x7f1720054080 msgr2=0x7f17200564a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:47.217 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.214+0000 7f17495e2700 1 --2- 172.21.15.174:0/2199576502 >> [v2:172.21.15.196:6810/24190,v1:172.21.15.196:6811/24190] conn(0x7f1720054080 0x7f17200564a0 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:47.217 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.214+0000 7f17495e2700 1 -- 172.21.15.174:0/2199576502 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f172004d4a0 msgr2=0x7f172004f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:47.218 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.214+0000 7f17495e2700 1 --2- 172.21.15.174:0/2199576502 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f172004d4a0 0x7f172004f960 secure :-1 s=READY pgs=73 cs=0 l=1 rx=0x7f173c001450 tx=0x7f173c0020c0).stop 2020-04-02T23:21:47.218 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.214+0000 7f17495e2700 1 -- 172.21.15.174:0/2199576502 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f17440a7a60 msgr2=0x7f1744147260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:47.218 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.214+0000 7f17495e2700 1 --2- 172.21.15.174:0/2199576502 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f17440a7a60 0x7f1744147260 secure :-1 s=READY pgs=102 cs=0 l=1 rx=0x7f1738002f30 tx=0x7f1738007a40).stop 2020-04-02T23:21:47.218 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.214+0000 7f17437fe700 1 -- 172.21.15.174:0/2199576502 reap_dead start 2020-04-02T23:21:47.218 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.214+0000 7f17495e2700 1 -- 172.21.15.174:0/2199576502 shutdown_connections 2020-04-02T23:21:47.218 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.214+0000 7f17495e2700 1 --2- 172.21.15.174:0/2199576502 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f17440a7a60 0x7f1744147260 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:47.218 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.214+0000 7f17495e2700 1 -- 172.21.15.174:0/2199576502 >> 172.21.15.174:0/2199576502 conn(0x7f17440aaf80 msgr2=0x7f17440a6700 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:47.219 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.214+0000 7f17495e2700 1 -- 172.21.15.174:0/2199576502 shutdown_connections 2020-04-02T23:21:47.219 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.214+0000 7f17495e2700 1 -- 172.21.15.174:0/2199576502 wait complete. 2020-04-02T23:21:47.226 INFO:teuthology.orchestra.run.smithi174.stdout:60129542150 2020-04-02T23:21:47.226 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:47.240 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.6 flush_pg_stats 2020-04-02T23:21:47.386 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.383+0000 7fc65ac6c700 1 Processor -- start 2020-04-02T23:21:47.386 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.384+0000 7fc65ac6c700 1 -- start start 2020-04-02T23:21:47.389 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.384+0000 7fc65ac6c700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc65405bf90 0x7fc6540a8330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:47.389 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.384+0000 7fc65ac6c700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fc6540a8790 0x7fc65413b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:47.390 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.384+0000 7fc65ac6c700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6540a6930 con 0x7fc65413bd40 2020-04-02T23:21:47.390 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.384+0000 7fc65ac6c700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc65405f5b0 con 0x7fc6540a8790 2020-04-02T23:21:47.390 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.384+0000 7fc65ac6c700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc65405f850 con 0x7fc65405bf90 2020-04-02T23:21:47.390 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.385+0000 7fc653fff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fc6540a8790 0x7fc65413b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:47.390 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.385+0000 7fc658a08700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc65405bf90 0x7fc6540a8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:47.390 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.385+0000 7fc659209700 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7fc65413bd40 0x7fc65413c1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.174:51062/0 (socket says 172.21.15.174:51062) 2020-04-02T23:21:47.390 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.385+0000 7fc659209700 1 -- 172.21.15.174:0/1998822352 learned_addr learned my addr 172.21.15.174:0/1998822352 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:21:47.391 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.385+0000 7fc653fff700 1 -- 172.21.15.174:0/1998822352 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc65405bf90 msgr2=0x7fc6540a8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:47.391 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.385+0000 7fc653fff700 1 --2- 172.21.15.174:0/1998822352 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc65405bf90 0x7fc6540a8330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:47.391 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.385+0000 7fc653fff700 1 -- 172.21.15.174:0/1998822352 >> v1:172.21.15.196:6789/0 conn(0x7fc65413bd40 legacy=0x7fc65413c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:47.391 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.385+0000 7fc653fff700 1 -- 172.21.15.174:0/1998822352 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc65405faf0 con 0x7fc6540a8790 2020-04-02T23:21:47.391 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.385+0000 7fc6537fe700 1 -- 172.21.15.174:0/1998822352 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2137659087 0 0) 0x7fc6540a6930 con 0x7fc65413bd40 2020-04-02T23:21:47.391 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.385+0000 7fc658a08700 1 --2- 172.21.15.174:0/1998822352 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc65405bf90 0x7fc6540a8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:21:47.391 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.385+0000 7fc653fff700 1 --2- 172.21.15.174:0/1998822352 >> v2:172.21.15.196:3300/0 conn(0x7fc6540a8790 0x7fc65413b8e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc648002f30 tx=0x7fc648007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:47.391 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.385+0000 7fc653fff700 1 --2- 172.21.15.174:0/1998822352 >> v2:172.21.15.196:3300/0 conn(0x7fc6540a8790 0x7fc65413b8e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc648002f30 tx=0x7fc648007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:47.392 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.385+0000 7fc653fff700 1 --2- 172.21.15.174:0/1998822352 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6540a8790 0x7fc65413b8e0 secure :-1 s=READY pgs=104 cs=0 l=1 rx=0x7fc648002f30 tx=0x7fc648007a40).ready entity=mon.1 client_cookie=c3357763498f8457 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:47.392 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.385+0000 7fc653fff700 1 --2- 172.21.15.174:0/1998822352 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6540a8790 0x7fc65413b8e0 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7fc648002f30 tx=0x7fc648007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:47.392 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.385+0000 7fc6537fe700 1 -- 172.21.15.174:0/1998822352 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6480113c0 con 0x7fc6540a8790 2020-04-02T23:21:47.392 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.385+0000 7fc653fff700 1 --2- 172.21.15.174:0/1998822352 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6540a8790 0x7fc65413b8e0 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7fc648002f30 tx=0x7fc648007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:47.392 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.385+0000 7fc653fff700 1 --2- 172.21.15.174:0/1998822352 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6540a8790 0x7fc65413b8e0 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7fc648002f30 tx=0x7fc648007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:47.392 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.385+0000 7fc6537fe700 1 -- 172.21.15.174:0/1998822352 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc648011520 con 0x7fc6540a8790 2020-04-02T23:21:47.392 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.385+0000 7fc6537fe700 1 -- 172.21.15.174:0/1998822352 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc648011900 con 0x7fc6540a8790 2020-04-02T23:21:47.393 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.385+0000 7fc65ac6c700 1 -- 172.21.15.174:0/1998822352 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6540a8790 msgr2=0x7fc65413b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:47.393 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.385+0000 7fc65ac6c700 1 --2- 172.21.15.174:0/1998822352 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6540a8790 0x7fc65413b8e0 secure :-1 s=READY pgs=104 cs=0 l=1 rx=0x7fc648002f30 tx=0x7fc648007a40).stop 2020-04-02T23:21:47.393 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.386+0000 7fc65ac6c700 1 -- 172.21.15.174:0/1998822352 shutdown_connections 2020-04-02T23:21:47.393 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.386+0000 7fc65ac6c700 1 --2- 172.21.15.174:0/1998822352 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc65405bf90 0x7fc6540a8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:47.393 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.386+0000 7fc65ac6c700 1 --2- 172.21.15.174:0/1998822352 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6540a8790 0x7fc65413b8e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:47.393 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.386+0000 7fc65ac6c700 1 -- 172.21.15.174:0/1998822352 >> 172.21.15.174:0/1998822352 conn(0x7fc6540ad160 msgr2=0x7fc6540a91b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:47.394 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.386+0000 7fc65ac6c700 1 -- 172.21.15.174:0/1998822352 shutdown_connections 2020-04-02T23:21:47.394 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.386+0000 7fc65ac6c700 1 -- 172.21.15.174:0/1998822352 wait complete. 2020-04-02T23:21:47.394 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.386+0000 7fc65ac6c700 1 Processor -- start 2020-04-02T23:21:47.395 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.387+0000 7fc65ac6c700 1 -- start start 2020-04-02T23:21:47.399 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.387+0000 7fc65ac6c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc65405bf90 0x7fc654065040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:47.399 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.387+0000 7fc65ac6c700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc6540a8790 0x7fc6541451b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:47.400 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.387+0000 7fc65ac6c700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fc65413bd40 0x7fc6540a2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:47.400 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.387+0000 7fc65ac6c700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc654146140 con 0x7fc65405bf90 2020-04-02T23:21:47.400 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.387+0000 7fc65ac6c700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc654063bc0 con 0x7fc65413bd40 2020-04-02T23:21:47.400 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.387+0000 7fc65ac6c700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc654063e60 con 0x7fc6540a8790 2020-04-02T23:21:47.400 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.387+0000 7fc658a08700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc65405bf90 0x7fc654065040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:47.400 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.387+0000 7fc658a08700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc65405bf90 0x7fc654065040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:39934/0 (socket says 172.21.15.174:39934) 2020-04-02T23:21:47.400 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.387+0000 7fc658a08700 1 -- 172.21.15.174:0/318920216 learned_addr learned my addr 172.21.15.174:0/318920216 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:21:47.401 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.388+0000 7fc659209700 1 --2- 172.21.15.174:0/318920216 >> v2:172.21.15.196:3300/0 conn(0x7fc65413bd40 0x7fc6540a2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:47.401 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.388+0000 7fc653fff700 1 --2- 172.21.15.174:0/318920216 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc6540a8790 0x7fc6541451b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:47.401 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.388+0000 7fc658a08700 1 -- 172.21.15.174:0/318920216 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc6540a8790 msgr2=0x7fc6541451b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:47.401 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.388+0000 7fc658a08700 1 --2- 172.21.15.174:0/318920216 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc6540a8790 0x7fc6541451b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:47.401 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.388+0000 7fc658a08700 1 -- 172.21.15.174:0/318920216 >> v2:172.21.15.196:3300/0 conn(0x7fc65413bd40 msgr2=0x7fc6540a2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:47.401 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.388+0000 7fc658a08700 1 --2- 172.21.15.174:0/318920216 >> v2:172.21.15.196:3300/0 conn(0x7fc65413bd40 0x7fc6540a2af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:47.401 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.388+0000 7fc658a08700 1 -- 172.21.15.174:0/318920216 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc654064100 con 0x7fc65405bf90 2020-04-02T23:21:47.402 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.388+0000 7fc658a08700 1 --2- 172.21.15.174:0/318920216 >> v2:172.21.15.174:3300/0 conn(0x7fc65405bf90 0x7fc654065040 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc644002ef0 tx=0x7fc644010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:47.402 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.388+0000 7fc658a08700 1 --2- 172.21.15.174:0/318920216 >> v2:172.21.15.174:3300/0 conn(0x7fc65405bf90 0x7fc654065040 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc644002ef0 tx=0x7fc644010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:47.402 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.388+0000 7fc658a08700 1 --2- 172.21.15.174:0/318920216 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc65405bf90 0x7fc654065040 secure :-1 s=READY pgs=129 cs=0 l=1 rx=0x7fc644002ef0 tx=0x7fc644010eb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:47.402 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.388+0000 7fc658a08700 1 --2- 172.21.15.174:0/318920216 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc65405bf90 0x7fc654065040 secure :-1 s=THROTTLE_DONE pgs=129 cs=0 l=1 rx=0x7fc644002ef0 tx=0x7fc644010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:47.402 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.388+0000 7fc651ffb700 1 -- 172.21.15.174:0/318920216 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc644007540 con 0x7fc65405bf90 2020-04-02T23:21:47.402 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.388+0000 7fc658a08700 1 --2- 172.21.15.174:0/318920216 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc65405bf90 0x7fc654065040 secure :-1 s=THROTTLE_DONE pgs=129 cs=0 l=1 rx=0x7fc644002ef0 tx=0x7fc644010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:47.402 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.388+0000 7fc658a08700 1 --2- 172.21.15.174:0/318920216 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc65405bf90 0x7fc654065040 secure :-1 s=THROTTLE_DONE pgs=129 cs=0 l=1 rx=0x7fc644002ef0 tx=0x7fc644010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:47.402 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.388+0000 7fc651ffb700 1 -- 172.21.15.174:0/318920216 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6440059c0 con 0x7fc65405bf90 2020-04-02T23:21:47.403 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.388+0000 7fc65ac6c700 1 -- 172.21.15.174:0/318920216 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc65413a4b0 con 0x7fc65405bf90 2020-04-02T23:21:47.403 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.388+0000 7fc651ffb700 1 -- 172.21.15.174:0/318920216 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc644005de0 con 0x7fc65405bf90 2020-04-02T23:21:47.403 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.388+0000 7fc65ac6c700 1 -- 172.21.15.174:0/318920216 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6540645a0 con 0x7fc65405bf90 2020-04-02T23:21:47.403 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.389+0000 7fc658a08700 1 --2- 172.21.15.174:0/318920216 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc65405bf90 0x7fc654065040 secure :-1 s=THROTTLE_DONE pgs=129 cs=0 l=1 rx=0x7fc644002ef0 tx=0x7fc644010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:47.403 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.389+0000 7fc65ac6c700 1 -- 172.21.15.174:0/318920216 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc654064300 con 0x7fc65405bf90 2020-04-02T23:21:47.403 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.389+0000 7fc651ffb700 1 -- 172.21.15.174:0/318920216 <== mon.0 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fc644010180 con 0x7fc65405bf90 2020-04-02T23:21:47.403 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.389+0000 7fc658a08700 1 --2- 172.21.15.174:0/318920216 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc65405bf90 0x7fc654065040 secure :-1 s=THROTTLE_DONE pgs=129 cs=0 l=1 rx=0x7fc644002ef0 tx=0x7fc644010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:47.404 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.389+0000 7fc658a08700 1 --2- 172.21.15.174:0/318920216 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc65405bf90 0x7fc654065040 secure :-1 s=THROTTLE_DONE pgs=129 cs=0 l=1 rx=0x7fc644002ef0 tx=0x7fc644010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:47.404 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.389+0000 7fc651ffb700 1 --2- 172.21.15.174:0/318920216 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fc63404d5d0 0x7fc63404fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:47.404 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.389+0000 7fc651ffb700 1 -- 172.21.15.174:0/318920216 <== mon.0 v2:172.21.15.174:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc6440610d0 con 0x7fc65405bf90 2020-04-02T23:21:47.404 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.389+0000 7fc651ffb700 1 --2- 172.21.15.174:0/318920216 >> [v2:172.21.15.196:6818/24212,v1:172.21.15.196:6819/24212] conn(0x7fc634054230 0x7fc634056650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:47.404 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.389+0000 7fc651ffb700 1 -- 172.21.15.174:0/318920216 --> [v2:172.21.15.196:6818/24212,v1:172.21.15.196:6819/24212] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc634056c10 con 0x7fc634054230 2020-04-02T23:21:47.404 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.389+0000 7fc651ffb700 1 -- 172.21.15.174:0/318920216 <== mon.0 v2:172.21.15.174:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc644062530 con 0x7fc65405bf90 2020-04-02T23:21:47.404 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.389+0000 7fc653fff700 1 --2- 172.21.15.174:0/318920216 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fc63404d5d0 0x7fc63404fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:47.406 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.390+0000 7fc659209700 1 --2- 172.21.15.174:0/318920216 >> [v2:172.21.15.196:6818/24212,v1:172.21.15.196:6819/24212] conn(0x7fc634054230 0x7fc634056650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:47.407 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.390+0000 7fc653fff700 1 --2- 172.21.15.174:0/318920216 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fc63404d5d0 0x7fc63404fa90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc648002f30 tx=0x7fc648007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:47.407 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.390+0000 7fc653fff700 1 --2- 172.21.15.174:0/318920216 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fc63404d5d0 0x7fc63404fa90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc648002f30 tx=0x7fc648007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:47.407 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.390+0000 7fc653fff700 1 --2- 172.21.15.174:0/318920216 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fc63404d5d0 0x7fc63404fa90 secure :-1 s=READY pgs=74 cs=0 l=1 rx=0x7fc648002f30 tx=0x7fc648007a40).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:47.407 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.390+0000 7fc659209700 1 --2- 172.21.15.174:0/318920216 >> [v2:172.21.15.196:6818/24212,v1:172.21.15.196:6819/24212] conn(0x7fc634054230 0x7fc634056650 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:47.407 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.391+0000 7fc651ffb700 1 -- 172.21.15.174:0/318920216 <== osd.6 v2:172.21.15.196:6818/24212 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21407 (crc 0 0 0) 0x7fc634056c10 con 0x7fc634054230 2020-04-02T23:21:47.408 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.406+0000 7fc65ac6c700 1 -- 172.21.15.174:0/318920216 --> [v2:172.21.15.196:6818/24212,v1:172.21.15.196:6819/24212] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc65409d7b0 con 0x7fc634054230 2020-04-02T23:21:47.409 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.407+0000 7fc651ffb700 1 -- 172.21.15.174:0/318920216 <== osd.6 v2:172.21.15.196:6818/24212 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc65409d7b0 con 0x7fc634054230 2020-04-02T23:21:47.410 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.407+0000 7fc65ac6c700 1 -- 172.21.15.174:0/318920216 >> [v2:172.21.15.196:6818/24212,v1:172.21.15.196:6819/24212] conn(0x7fc634054230 msgr2=0x7fc634056650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:47.411 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.407+0000 7fc65ac6c700 1 --2- 172.21.15.174:0/318920216 >> [v2:172.21.15.196:6818/24212,v1:172.21.15.196:6819/24212] conn(0x7fc634054230 0x7fc634056650 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:47.411 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.407+0000 7fc65ac6c700 1 -- 172.21.15.174:0/318920216 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fc63404d5d0 msgr2=0x7fc63404fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:47.411 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.407+0000 7fc65ac6c700 1 --2- 172.21.15.174:0/318920216 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fc63404d5d0 0x7fc63404fa90 secure :-1 s=READY pgs=74 cs=0 l=1 rx=0x7fc648002f30 tx=0x7fc648007a40).stop 2020-04-02T23:21:47.411 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.407+0000 7fc65ac6c700 1 -- 172.21.15.174:0/318920216 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc65405bf90 msgr2=0x7fc654065040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:47.411 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.407+0000 7fc65ac6c700 1 --2- 172.21.15.174:0/318920216 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc65405bf90 0x7fc654065040 secure :-1 s=READY pgs=129 cs=0 l=1 rx=0x7fc644002ef0 tx=0x7fc644010eb0).stop 2020-04-02T23:21:47.411 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.407+0000 7fc659209700 1 -- 172.21.15.174:0/318920216 reap_dead start 2020-04-02T23:21:47.411 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.407+0000 7fc65ac6c700 1 -- 172.21.15.174:0/318920216 shutdown_connections 2020-04-02T23:21:47.411 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.407+0000 7fc65ac6c700 1 --2- 172.21.15.174:0/318920216 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc65405bf90 0x7fc654065040 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:47.412 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.407+0000 7fc65ac6c700 1 -- 172.21.15.174:0/318920216 >> 172.21.15.174:0/318920216 conn(0x7fc6540ad160 msgr2=0x7fc65413c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:47.412 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.408+0000 7fc65ac6c700 1 -- 172.21.15.174:0/318920216 shutdown_connections 2020-04-02T23:21:47.412 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.408+0000 7fc65ac6c700 1 -- 172.21.15.174:0/318920216 wait complete. 2020-04-02T23:21:47.419 INFO:teuthology.orchestra.run.smithi174.stdout:60129542151 2020-04-02T23:21:47.420 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:47.433 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.7 flush_pg_stats 2020-04-02T23:21:47.581 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.578+0000 7f02a0fad700 1 Processor -- start 2020-04-02T23:21:47.581 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.579+0000 7f02a0fad700 1 -- start start 2020-04-02T23:21:47.588 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.579+0000 7f02a0fad700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f029c0a7a60 0x7f029c0a22b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:47.588 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.579+0000 7f02a0fad700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f029c0a4330 0x7f029c1384a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:47.588 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.579+0000 7f02a0fad700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f029c138900 0x7f029c12e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:47.588 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.579+0000 7f02a0fad700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f029c0a3ae0 con 0x7f029c0a7a60 2020-04-02T23:21:47.588 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.579+0000 7f02a0fad700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f029c0a3d80 con 0x7f029c138900 2020-04-02T23:21:47.588 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.579+0000 7f02a0fad700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f029c0a4020 con 0x7f029c0a4330 2020-04-02T23:21:47.589 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.579+0000 7f029a59c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f029c0a7a60 0x7f029c0a22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:47.589 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.580+0000 7f029a59c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f029c0a7a60 0x7f029c0a22b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:39946/0 (socket says 172.21.15.174:39946) 2020-04-02T23:21:47.589 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.580+0000 7f029a59c700 1 -- 172.21.15.174:0/1993758691 learned_addr learned my addr 172.21.15.174:0/1993758691 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:21:47.589 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.580+0000 7f029ad9d700 1 --2- 172.21.15.174:0/1993758691 >> v2:172.21.15.196:3300/0 conn(0x7f029c138900 0x7f029c12e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:47.589 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.580+0000 7f0299d9b700 1 --2- 172.21.15.174:0/1993758691 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f029c0a4330 0x7f029c1384a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:47.589 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.580+0000 7f029a59c700 1 -- 172.21.15.174:0/1993758691 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f029c0a4330 msgr2=0x7f029c1384a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:47.589 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.580+0000 7f029a59c700 1 --2- 172.21.15.174:0/1993758691 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f029c0a4330 0x7f029c1384a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:47.590 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.580+0000 7f029a59c700 1 -- 172.21.15.174:0/1993758691 >> v2:172.21.15.196:3300/0 conn(0x7f029c138900 msgr2=0x7f029c12e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:47.590 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.580+0000 7f029a59c700 1 --2- 172.21.15.174:0/1993758691 >> v2:172.21.15.196:3300/0 conn(0x7f029c138900 0x7f029c12e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:47.590 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.580+0000 7f029a59c700 1 -- 172.21.15.174:0/1993758691 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f029c0a1a60 con 0x7f029c0a7a60 2020-04-02T23:21:47.590 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.580+0000 7f029ad9d700 1 --2- 172.21.15.174:0/1993758691 >> v2:172.21.15.196:3300/0 conn(0x7f029c138900 0x7f029c12e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-02T23:21:47.590 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.580+0000 7f029a59c700 1 --2- 172.21.15.174:0/1993758691 >> v2:172.21.15.174:3300/0 conn(0x7f029c0a7a60 0x7f029c0a22b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0290002f30 tx=0x7f0290007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:47.590 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.580+0000 7f029a59c700 1 --2- 172.21.15.174:0/1993758691 >> v2:172.21.15.174:3300/0 conn(0x7f029c0a7a60 0x7f029c0a22b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0290002f30 tx=0x7f0290007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:47.590 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.580+0000 7f029a59c700 1 --2- 172.21.15.174:0/1993758691 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f029c0a7a60 0x7f029c0a22b0 secure :-1 s=READY pgs=130 cs=0 l=1 rx=0x7f0290002f30 tx=0x7f0290007a40).ready entity=mon.0 client_cookie=4161717fc343ac8 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:47.590 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.580+0000 7f029a59c700 1 --2- 172.21.15.174:0/1993758691 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f029c0a7a60 0x7f029c0a22b0 secure :-1 s=THROTTLE_DONE pgs=130 cs=0 l=1 rx=0x7f0290002f30 tx=0x7f0290007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:47.591 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.580+0000 7f029959a700 1 -- 172.21.15.174:0/1993758691 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0290008e10 con 0x7f029c0a7a60 2020-04-02T23:21:47.591 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.580+0000 7f029a59c700 1 --2- 172.21.15.174:0/1993758691 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f029c0a7a60 0x7f029c0a22b0 secure :-1 s=THROTTLE_DONE pgs=130 cs=0 l=1 rx=0x7f0290002f30 tx=0x7f0290007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:47.591 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.580+0000 7f029a59c700 1 --2- 172.21.15.174:0/1993758691 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f029c0a7a60 0x7f029c0a22b0 secure :-1 s=THROTTLE_DONE pgs=130 cs=0 l=1 rx=0x7f0290002f30 tx=0x7f0290007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:47.591 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.580+0000 7f029959a700 1 -- 172.21.15.174:0/1993758691 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02900107c0 con 0x7f029c0a7a60 2020-04-02T23:21:47.591 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.580+0000 7f029959a700 1 -- 172.21.15.174:0/1993758691 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0290010b60 con 0x7f029c0a7a60 2020-04-02T23:21:47.591 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.580+0000 7f02a0fad700 1 -- 172.21.15.174:0/1993758691 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f029c0a7a60 msgr2=0x7f029c0a22b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:47.591 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.580+0000 7f02a0fad700 1 --2- 172.21.15.174:0/1993758691 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f029c0a7a60 0x7f029c0a22b0 secure :-1 s=READY pgs=130 cs=0 l=1 rx=0x7f0290002f30 tx=0x7f0290007a40).stop 2020-04-02T23:21:47.592 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.581+0000 7f02a0fad700 1 -- 172.21.15.174:0/1993758691 shutdown_connections 2020-04-02T23:21:47.592 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.581+0000 7f02a0fad700 1 --2- 172.21.15.174:0/1993758691 >> v2:172.21.15.196:3300/0 conn(0x7f029c138900 0x7f029c12e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:47.592 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.581+0000 7f02a0fad700 1 --2- 172.21.15.174:0/1993758691 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f029c0a7a60 0x7f029c0a22b0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:47.592 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.581+0000 7f02a0fad700 1 --2- 172.21.15.174:0/1993758691 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f029c0a4330 0x7f029c1384a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:47.592 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.581+0000 7f02a0fad700 1 -- 172.21.15.174:0/1993758691 >> 172.21.15.174:0/1993758691 conn(0x7f029c0aaf80 msgr2=0x7f029c0a6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:47.592 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.581+0000 7f02a0fad700 1 -- 172.21.15.174:0/1993758691 shutdown_connections 2020-04-02T23:21:47.592 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.581+0000 7f02a0fad700 1 -- 172.21.15.174:0/1993758691 wait complete. 2020-04-02T23:21:47.592 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.581+0000 7f02a0fad700 1 Processor -- start 2020-04-02T23:21:47.593 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.582+0000 7f02a0fad700 1 -- start start 2020-04-02T23:21:47.593 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.582+0000 7f02a0fad700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f029c0a4330 0x7f029c135620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:47.593 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.582+0000 7f02a0fad700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f029c138900 0x7f029c1251d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:47.593 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.582+0000 7f02a0fad700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f029c0aa0a0 con 0x7f029c0a7a60 2020-04-02T23:21:47.593 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.582+0000 7f02a0fad700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f029c135a80 con 0x7f029c138900 2020-04-02T23:21:47.593 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.582+0000 7f02a0fad700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f029c13f040 con 0x7f029c0a4330 2020-04-02T23:21:47.593 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.582+0000 7f029ad9d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f029c138900 0x7f029c1251d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:47.594 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.582+0000 7f029a59c700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f029c0a4330 0x7f029c135620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:47.594 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.582+0000 7f029ad9d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f029c138900 0x7f029c1251d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:39954/0 (socket says 172.21.15.174:39954) 2020-04-02T23:21:47.594 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.582+0000 7f029ad9d700 1 -- 172.21.15.174:0/2169244365 learned_addr learned my addr 172.21.15.174:0/2169244365 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:21:47.594 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.582+0000 7f029ad9d700 1 -- 172.21.15.174:0/2169244365 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f029c0a4330 msgr2=0x7f029c135620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:47.594 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.582+0000 7f029ad9d700 1 --2- 172.21.15.174:0/2169244365 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f029c0a4330 0x7f029c135620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:47.594 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.582+0000 7f029ad9d700 1 -- 172.21.15.174:0/2169244365 >> v1:172.21.15.196:6789/0 conn(0x7f029c0a7a60 legacy=0x7f029c133370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:47.594 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.582+0000 7f029ad9d700 1 -- 172.21.15.174:0/2169244365 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f029c132f40 con 0x7f029c138900 2020-04-02T23:21:47.595 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.583+0000 7f029ad9d700 1 --2- 172.21.15.174:0/2169244365 >> v2:172.21.15.174:3300/0 conn(0x7f029c138900 0x7f029c1251d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f02940032b0 tx=0x7f0294010d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:47.595 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.583+0000 7f029ad9d700 1 --2- 172.21.15.174:0/2169244365 >> v2:172.21.15.174:3300/0 conn(0x7f029c138900 0x7f029c1251d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f02940032b0 tx=0x7f0294010d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:47.595 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.583+0000 7f029ad9d700 1 --2- 172.21.15.174:0/2169244365 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f029c138900 0x7f029c1251d0 secure :-1 s=READY pgs=131 cs=0 l=1 rx=0x7f02940032b0 tx=0x7f0294010d50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:47.595 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.583+0000 7f029ad9d700 1 --2- 172.21.15.174:0/2169244365 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f029c138900 0x7f029c1251d0 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7f02940032b0 tx=0x7f0294010d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:47.595 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.583+0000 7f028b7fe700 1 -- 172.21.15.174:0/2169244365 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0294005e30 con 0x7f029c138900 2020-04-02T23:21:47.595 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.583+0000 7f029ad9d700 1 --2- 172.21.15.174:0/2169244365 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f029c138900 0x7f029c1251d0 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7f02940032b0 tx=0x7f0294010d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:47.595 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.583+0000 7f029ad9d700 1 --2- 172.21.15.174:0/2169244365 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f029c138900 0x7f029c1251d0 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7f02940032b0 tx=0x7f0294010d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:47.595 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.583+0000 7f028b7fe700 1 -- 172.21.15.174:0/2169244365 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0294007540 con 0x7f029c138900 2020-04-02T23:21:47.596 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.583+0000 7f02a0fad700 1 -- 172.21.15.174:0/2169244365 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f029c132200 con 0x7f029c138900 2020-04-02T23:21:47.596 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.583+0000 7f028b7fe700 1 -- 172.21.15.174:0/2169244365 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f02940123f0 con 0x7f029c138900 2020-04-02T23:21:47.596 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.583+0000 7f02a0fad700 1 -- 172.21.15.174:0/2169244365 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f029c132470 con 0x7f029c138900 2020-04-02T23:21:47.596 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.583+0000 7f029ad9d700 1 --2- 172.21.15.174:0/2169244365 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f029c138900 0x7f029c1251d0 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7f02940032b0 tx=0x7f0294010d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:47.596 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.584+0000 7f02a0fad700 1 -- 172.21.15.174:0/2169244365 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f029c1330d0 con 0x7f029c138900 2020-04-02T23:21:47.596 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.584+0000 7f028b7fe700 1 -- 172.21.15.174:0/2169244365 <== mon.0 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f0294012660 con 0x7f029c138900 2020-04-02T23:21:47.596 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.584+0000 7f029ad9d700 1 --2- 172.21.15.174:0/2169244365 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f029c138900 0x7f029c1251d0 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7f02940032b0 tx=0x7f0294010d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:47.597 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.584+0000 7f029ad9d700 1 --2- 172.21.15.174:0/2169244365 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f029c138900 0x7f029c1251d0 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7f02940032b0 tx=0x7f0294010d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:47.597 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.584+0000 7f028b7fe700 1 --2- 172.21.15.174:0/2169244365 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f027804d470 0x7f027804f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:47.597 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.584+0000 7f028b7fe700 1 -- 172.21.15.174:0/2169244365 <== mon.0 v2:172.21.15.174:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0294061440 con 0x7f029c138900 2020-04-02T23:21:47.597 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.584+0000 7f028b7fe700 1 --2- 172.21.15.174:0/2169244365 >> [v2:172.21.15.196:6826/24408,v1:172.21.15.196:6827/24408] conn(0x7f0278054050 0x7f0278056470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:47.597 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.584+0000 7f028b7fe700 1 -- 172.21.15.174:0/2169244365 --> [v2:172.21.15.196:6826/24408,v1:172.21.15.196:6827/24408] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0278056a30 con 0x7f0278054050 2020-04-02T23:21:47.597 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.584+0000 7f028b7fe700 1 -- 172.21.15.174:0/2169244365 <== mon.0 v2:172.21.15.174:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0294062900 con 0x7f029c138900 2020-04-02T23:21:47.597 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.584+0000 7f029a59c700 1 --2- 172.21.15.174:0/2169244365 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f027804d470 0x7f027804f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:47.597 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.584+0000 7f0299d9b700 1 --2- 172.21.15.174:0/2169244365 >> [v2:172.21.15.196:6826/24408,v1:172.21.15.196:6827/24408] conn(0x7f0278054050 0x7f0278056470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:47.598 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.584+0000 7f029a59c700 1 --2- 172.21.15.174:0/2169244365 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f027804d470 0x7f027804f930 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0290002f30 tx=0x7f0290007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:47.598 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.585+0000 7f029a59c700 1 --2- 172.21.15.174:0/2169244365 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f027804d470 0x7f027804f930 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0290002f30 tx=0x7f0290007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:47.598 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.585+0000 7f029a59c700 1 --2- 172.21.15.174:0/2169244365 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f027804d470 0x7f027804f930 secure :-1 s=READY pgs=76 cs=0 l=1 rx=0x7f0290002f30 tx=0x7f0290007a40).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:47.598 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.585+0000 7f0299d9b700 1 --2- 172.21.15.174:0/2169244365 >> [v2:172.21.15.196:6826/24408,v1:172.21.15.196:6827/24408] conn(0x7f0278054050 0x7f0278056470 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:47.598 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.585+0000 7f028b7fe700 1 -- 172.21.15.174:0/2169244365 <== osd.7 v2:172.21.15.196:6826/24408 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21407 (crc 0 0 0) 0x7f0278056a30 con 0x7f0278054050 2020-04-02T23:21:47.603 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.601+0000 7f02a0fad700 1 -- 172.21.15.174:0/2169244365 --> [v2:172.21.15.196:6826/24408,v1:172.21.15.196:6827/24408] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f029c056c50 con 0x7f0278054050 2020-04-02T23:21:47.604 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.602+0000 7f028b7fe700 1 -- 172.21.15.174:0/2169244365 <== osd.7 v2:172.21.15.196:6826/24408 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f029c056c50 con 0x7f0278054050 2020-04-02T23:21:47.605 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.602+0000 7f02a0fad700 1 -- 172.21.15.174:0/2169244365 >> [v2:172.21.15.196:6826/24408,v1:172.21.15.196:6827/24408] conn(0x7f0278054050 msgr2=0x7f0278056470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:47.605 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.602+0000 7f02a0fad700 1 --2- 172.21.15.174:0/2169244365 >> [v2:172.21.15.196:6826/24408,v1:172.21.15.196:6827/24408] conn(0x7f0278054050 0x7f0278056470 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:47.606 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.602+0000 7f02a0fad700 1 -- 172.21.15.174:0/2169244365 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f027804d470 msgr2=0x7f027804f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:47.606 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.602+0000 7f02a0fad700 1 --2- 172.21.15.174:0/2169244365 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f027804d470 0x7f027804f930 secure :-1 s=READY pgs=76 cs=0 l=1 rx=0x7f0290002f30 tx=0x7f0290007a40).stop 2020-04-02T23:21:47.606 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.602+0000 7f02a0fad700 1 -- 172.21.15.174:0/2169244365 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f029c138900 msgr2=0x7f029c1251d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:47.606 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.602+0000 7f02a0fad700 1 --2- 172.21.15.174:0/2169244365 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f029c138900 0x7f029c1251d0 secure :-1 s=READY pgs=131 cs=0 l=1 rx=0x7f02940032b0 tx=0x7f0294010d50).stop 2020-04-02T23:21:47.606 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.602+0000 7f029ad9d700 1 -- 172.21.15.174:0/2169244365 reap_dead start 2020-04-02T23:21:47.606 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.602+0000 7f02a0fad700 1 -- 172.21.15.174:0/2169244365 shutdown_connections 2020-04-02T23:21:47.606 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.602+0000 7f02a0fad700 1 --2- 172.21.15.174:0/2169244365 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f029c138900 0x7f029c1251d0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:47.607 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.602+0000 7f02a0fad700 1 -- 172.21.15.174:0/2169244365 >> 172.21.15.174:0/2169244365 conn(0x7f029c0aaf80 msgr2=0x7f029c0a8e40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:47.607 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.602+0000 7f02a0fad700 1 -- 172.21.15.174:0/2169244365 shutdown_connections 2020-04-02T23:21:47.607 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.602+0000 7f02a0fad700 1 -- 172.21.15.174:0/2169244365 wait complete. 2020-04-02T23:21:47.614 INFO:teuthology.orchestra.run.smithi174.stdout:60129542151 2020-04-02T23:21:47.614 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:47.628 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.0 2020-04-02T23:21:47.774 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.771+0000 7fa821c13700 1 Processor -- start 2020-04-02T23:21:47.774 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.771+0000 7fa821c13700 1 -- start start 2020-04-02T23:21:47.781 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.772+0000 7fa821c13700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa81c05bf90 0x7fa81c0a4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:47.781 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.772+0000 7fa821c13700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fa81c0a7440 0x7fa81c139c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:47.781 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.772+0000 7fa821c13700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa81c0a5a60 con 0x7fa81c0a6fe0 2020-04-02T23:21:47.781 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.772+0000 7fa821c13700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa81c0a4520 con 0x7fa81c0a7440 2020-04-02T23:21:47.782 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.772+0000 7fa821c13700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa81c0a5cc0 con 0x7fa81c05bf90 2020-04-02T23:21:47.782 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.772+0000 7fa81affd700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fa81c0a6fe0 0x7fa81c139560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:45000/0 (socket says 172.21.15.174:45000) 2020-04-02T23:21:47.782 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.772+0000 7fa81affd700 1 -- 172.21.15.174:0/844166005 learned_addr learned my addr 172.21.15.174:0/844166005 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:21:47.782 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.772+0000 7fa81b7fe700 1 --2- 172.21.15.174:0/844166005 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa81c05bf90 0x7fa81c0a4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:47.782 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.772+0000 7fa81bfff700 1 --2- 172.21.15.174:0/844166005 >> v2:172.21.15.196:3300/0 conn(0x7fa81c0a7440 0x7fa81c139c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:47.783 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.772+0000 7fa81a7fc700 1 -- 172.21.15.174:0/844166005 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4072826990 0 0) 0x7fa81c0a5a60 con 0x7fa81c0a6fe0 2020-04-02T23:21:47.783 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.772+0000 7fa81a7fc700 1 -- 172.21.15.174:0/844166005 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa808003230 con 0x7fa81c0a6fe0 2020-04-02T23:21:47.783 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.773+0000 7fa81a7fc700 1 -- 172.21.15.174:0/844166005 <== mon.0 v1:172.21.15.174:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1949530830 0 0) 0x7fa808003230 con 0x7fa81c0a6fe0 2020-04-02T23:21:47.783 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.773+0000 7fa81a7fc700 1 -- 172.21.15.174:0/844166005 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa81c05bf90 msgr2=0x7fa81c0a4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:47.783 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.773+0000 7fa81a7fc700 1 --2- 172.21.15.174:0/844166005 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa81c05bf90 0x7fa81c0a4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:47.783 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.773+0000 7fa81a7fc700 1 -- 172.21.15.174:0/844166005 >> v2:172.21.15.196:3300/0 conn(0x7fa81c0a7440 msgr2=0x7fa81c139c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:47.783 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.773+0000 7fa81a7fc700 1 --2- 172.21.15.174:0/844166005 >> v2:172.21.15.196:3300/0 conn(0x7fa81c0a7440 0x7fa81c139c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:47.784 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.773+0000 7fa81a7fc700 1 -- 172.21.15.174:0/844166005 --> v1:172.21.15.174:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa81c062b10 con 0x7fa81c0a6fe0 2020-04-02T23:21:47.784 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.773+0000 7fa81a7fc700 1 -- 172.21.15.174:0/844166005 <== mon.0 v1:172.21.15.174:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2811762909 0 0) 0x7fa8100016d0 con 0x7fa81c0a6fe0 2020-04-02T23:21:47.784 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.773+0000 7fa81a7fc700 1 -- 172.21.15.174:0/844166005 >> v1:172.21.15.174:6789/0 conn(0x7fa81c0a6fe0 legacy=0x7fa81c139560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:47.784 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.773+0000 7fa81a7fc700 1 --2- 172.21.15.174:0/844166005 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa808003720 0x7fa808003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:47.784 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.773+0000 7fa81a7fc700 1 --2- 172.21.15.174:0/844166005 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa808004060 0x7fa808004530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:47.784 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.773+0000 7fa81a7fc700 1 --2- 172.21.15.174:0/844166005 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa81c05bf90 0x7fa808004ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:47.784 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.773+0000 7fa81a7fc700 1 -- 172.21.15.174:0/844166005 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa81c0a4520 con 0x7fa808003720 2020-04-02T23:21:47.785 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.773+0000 7fa81a7fc700 1 -- 172.21.15.174:0/844166005 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa81c0a5cc0 con 0x7fa808004060 2020-04-02T23:21:47.785 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.773+0000 7fa81a7fc700 1 -- 172.21.15.174:0/844166005 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa808004ff0 con 0x7fa81c05bf90 2020-04-02T23:21:47.785 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.773+0000 7fa81b7fe700 1 --2- 172.21.15.174:0/844166005 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa808003720 0x7fa808003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:47.785 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.773+0000 7fa81bfff700 1 --2- 172.21.15.174:0/844166005 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa81c05bf90 0x7fa808004ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:47.785 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.773+0000 7fa81affd700 1 --2- 172.21.15.174:0/844166005 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa808004060 0x7fa808004530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:47.786 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.773+0000 7fa81b7fe700 1 -- 172.21.15.174:0/844166005 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa81c05bf90 msgr2=0x7fa808004ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:47.786 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.773+0000 7fa81b7fe700 1 --2- 172.21.15.174:0/844166005 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa81c05bf90 0x7fa808004ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:47.786 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.773+0000 7fa81b7fe700 1 -- 172.21.15.174:0/844166005 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa808004060 msgr2=0x7fa808004530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:47.786 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.773+0000 7fa81b7fe700 1 --2- 172.21.15.174:0/844166005 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa808004060 0x7fa808004530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:47.786 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.773+0000 7fa81b7fe700 1 -- 172.21.15.174:0/844166005 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa808003230 con 0x7fa808003720 2020-04-02T23:21:47.786 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.773+0000 7fa81affd700 1 --2- 172.21.15.174:0/844166005 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa808004060 0x7fa808004530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-02T23:21:47.787 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.773+0000 7fa81b7fe700 1 --2- 172.21.15.174:0/844166005 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa808003720 0x7fa808003b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa80c002f30 tx=0x7fa80c010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:47.787 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.773+0000 7fa81b7fe700 1 --2- 172.21.15.174:0/844166005 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa808003720 0x7fa808003b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa80c002f30 tx=0x7fa80c010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:47.787 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.773+0000 7fa81b7fe700 1 --2- 172.21.15.174:0/844166005 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa808003720 0x7fa808003b40 secure :-1 s=READY pgs=133 cs=0 l=1 rx=0x7fa80c002f30 tx=0x7fa80c010020).ready entity=mon.0 client_cookie=1abc56e91aeaf913 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:47.787 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.773+0000 7fa81b7fe700 1 --2- 172.21.15.174:0/844166005 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa808003720 0x7fa808003b40 secure :-1 s=THROTTLE_DONE pgs=133 cs=0 l=1 rx=0x7fa80c002f30 tx=0x7fa80c010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:47.787 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.773+0000 7fa81b7fe700 1 --2- 172.21.15.174:0/844166005 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa808003720 0x7fa808003b40 secure :-1 s=THROTTLE_DONE pgs=133 cs=0 l=1 rx=0x7fa80c002f30 tx=0x7fa80c010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:47.787 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.773+0000 7fa81a7fc700 1 -- 172.21.15.174:0/844166005 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa80c008d30 con 0x7fa808003720 2020-04-02T23:21:47.788 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.773+0000 7fa81b7fe700 1 --2- 172.21.15.174:0/844166005 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa808003720 0x7fa808003b40 secure :-1 s=THROTTLE_DONE pgs=133 cs=0 l=1 rx=0x7fa80c002f30 tx=0x7fa80c010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:47.788 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.773+0000 7fa81a7fc700 1 -- 172.21.15.174:0/844166005 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa80c008e90 con 0x7fa808003720 2020-04-02T23:21:47.788 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.773+0000 7fa81a7fc700 1 -- 172.21.15.174:0/844166005 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa80c010b40 con 0x7fa808003720 2020-04-02T23:21:47.788 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.773+0000 7fa821c13700 1 -- 172.21.15.174:0/844166005 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa808003720 msgr2=0x7fa808003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:47.788 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.773+0000 7fa821c13700 1 --2- 172.21.15.174:0/844166005 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa808003720 0x7fa808003b40 secure :-1 s=READY pgs=133 cs=0 l=1 rx=0x7fa80c002f30 tx=0x7fa80c010020).stop 2020-04-02T23:21:47.788 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.773+0000 7fa81bfff700 1 -- 172.21.15.174:0/844166005 reap_dead start 2020-04-02T23:21:47.788 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.774+0000 7fa821c13700 1 -- 172.21.15.174:0/844166005 shutdown_connections 2020-04-02T23:21:47.789 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.774+0000 7fa821c13700 1 -- 172.21.15.174:0/844166005 >> 172.21.15.174:0/844166005 conn(0x7fa81c0ad160 msgr2=0x7fa81c0a91b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:47.789 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.774+0000 7fa821c13700 1 -- 172.21.15.174:0/844166005 shutdown_connections 2020-04-02T23:21:47.789 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.774+0000 7fa821c13700 1 -- 172.21.15.174:0/844166005 wait complete. 2020-04-02T23:21:47.789 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.775+0000 7fa821c13700 1 Processor -- start 2020-04-02T23:21:47.789 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.775+0000 7fa821c13700 1 -- start start 2020-04-02T23:21:47.789 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.775+0000 7fa821c13700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fa81c064d40 0x7fa81c0a2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:47.790 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.776+0000 7fa821c13700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa81c09d620 0x7fa81c14dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:47.790 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.776+0000 7fa821c13700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa81c09e120 con 0x7fa81c09d1c0 2020-04-02T23:21:47.790 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.776+0000 7fa821c13700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa81c0a6e40 con 0x7fa81c064d40 2020-04-02T23:21:47.791 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.776+0000 7fa821c13700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa81c0a98c0 con 0x7fa81c09d620 2020-04-02T23:21:47.792 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.776+0000 7fa81affd700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fa81c09d1c0 0x7fa81c1349d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:45012/0 (socket says 172.21.15.174:45012) 2020-04-02T23:21:47.792 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.776+0000 7fa81affd700 1 -- 172.21.15.174:0/3041035328 learned_addr learned my addr 172.21.15.174:0/3041035328 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:21:47.792 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.776+0000 7fa81bfff700 1 --2- 172.21.15.174:0/3041035328 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa81c09d620 0x7fa81c14dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:47.792 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.776+0000 7fa81b7fe700 1 --2- 172.21.15.174:0/3041035328 >> v2:172.21.15.196:3300/0 conn(0x7fa81c064d40 0x7fa81c0a2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:47.792 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.776+0000 7fa818ff9700 1 -- 172.21.15.174:0/3041035328 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1189990632 0 0) 0x7fa81c09e120 con 0x7fa81c09d1c0 2020-04-02T23:21:47.792 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.776+0000 7fa818ff9700 1 -- 172.21.15.174:0/3041035328 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7fc002fe0 con 0x7fa81c09d1c0 2020-04-02T23:21:47.809 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.776+0000 7fa81bfff700 1 -- 172.21.15.174:0/3041035328 >> v2:172.21.15.196:3300/0 conn(0x7fa81c064d40 msgr2=0x7fa81c0a2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:47.809 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.776+0000 7fa81bfff700 1 --2- 172.21.15.174:0/3041035328 >> v2:172.21.15.196:3300/0 conn(0x7fa81c064d40 0x7fa81c0a2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:47.810 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.776+0000 7fa81bfff700 1 -- 172.21.15.174:0/3041035328 >> v1:172.21.15.174:6789/0 conn(0x7fa81c09d1c0 legacy=0x7fa81c1349d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:47.810 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.776+0000 7fa81bfff700 1 -- 172.21.15.174:0/3041035328 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa81c09e350 con 0x7fa81c09d620 2020-04-02T23:21:47.810 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.776+0000 7fa81bfff700 1 --2- 172.21.15.174:0/3041035328 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa81c09d620 0x7fa81c14dfa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa810001930 tx=0x7fa814010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:47.810 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.776+0000 7fa81bfff700 1 --2- 172.21.15.174:0/3041035328 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa81c09d620 0x7fa81c14dfa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa810001930 tx=0x7fa814010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:47.810 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.776+0000 7fa81bfff700 1 --2- 172.21.15.174:0/3041035328 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa81c09d620 0x7fa81c14dfa0 secure :-1 s=READY pgs=28 cs=0 l=1 rx=0x7fa810001930 tx=0x7fa814010e10).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:47.810 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.776+0000 7fa81bfff700 1 --2- 172.21.15.174:0/3041035328 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa81c09d620 0x7fa81c14dfa0 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7fa810001930 tx=0x7fa814010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:47.811 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.776+0000 7fa818ff9700 1 -- 172.21.15.174:0/3041035328 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa814005e20 con 0x7fa81c09d620 2020-04-02T23:21:47.811 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.776+0000 7fa81bfff700 1 --2- 172.21.15.174:0/3041035328 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa81c09d620 0x7fa81c14dfa0 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7fa810001930 tx=0x7fa814010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:47.811 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.776+0000 7fa818ff9700 1 -- 172.21.15.174:0/3041035328 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa814008700 con 0x7fa81c09d620 2020-04-02T23:21:47.811 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.776+0000 7fa81bfff700 1 --2- 172.21.15.174:0/3041035328 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa81c09d620 0x7fa81c14dfa0 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7fa810001930 tx=0x7fa814010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:47.811 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.776+0000 7fa821c13700 1 -- 172.21.15.174:0/3041035328 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa81c09e5f0 con 0x7fa81c09d620 2020-04-02T23:21:47.811 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.776+0000 7fa818ff9700 1 -- 172.21.15.174:0/3041035328 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa814008aa0 con 0x7fa81c09d620 2020-04-02T23:21:47.812 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.776+0000 7fa821c13700 1 -- 172.21.15.174:0/3041035328 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa81c0a04e0 con 0x7fa81c09d620 2020-04-02T23:21:47.812 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.777+0000 7fa81bfff700 1 --2- 172.21.15.174:0/3041035328 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa81c09d620 0x7fa81c14dfa0 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7fa810001930 tx=0x7fa814010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:47.812 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.777+0000 7fa821c13700 1 -- 172.21.15.174:0/3041035328 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa81c09e780 con 0x7fa81c09d620 2020-04-02T23:21:47.812 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.777+0000 7fa818ff9700 1 -- 172.21.15.174:0/3041035328 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fa814008c00 con 0x7fa81c09d620 2020-04-02T23:21:47.812 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.777+0000 7fa81bfff700 1 --2- 172.21.15.174:0/3041035328 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa81c09d620 0x7fa81c14dfa0 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7fa810001930 tx=0x7fa814010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:47.812 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.778+0000 7fa818ff9700 1 --2- 172.21.15.174:0/3041035328 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fa7fc04d8f0 0x7fa7fc04fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:47.812 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.778+0000 7fa818ff9700 1 -- 172.21.15.174:0/3041035328 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa814060f90 con 0x7fa81c09d620 2020-04-02T23:21:47.813 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.778+0000 7fa81b7fe700 1 --2- 172.21.15.174:0/3041035328 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fa7fc04d8f0 0x7fa7fc04fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:47.813 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.778+0000 7fa81b7fe700 1 --2- 172.21.15.174:0/3041035328 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fa7fc04d8f0 0x7fa7fc04fdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa80c002f30 tx=0x7fa80c010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:47.813 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.778+0000 7fa81b7fe700 1 --2- 172.21.15.174:0/3041035328 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fa7fc04d8f0 0x7fa7fc04fdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa80c002f30 tx=0x7fa80c010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:47.813 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.778+0000 7fa81b7fe700 1 --2- 172.21.15.174:0/3041035328 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fa7fc04d8f0 0x7fa7fc04fdb0 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7fa80c002f30 tx=0x7fa80c010020).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:47.814 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.781+0000 7fa81bfff700 1 --2- 172.21.15.174:0/3041035328 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa81c09d620 0x7fa81c14dfa0 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7fa810001930 tx=0x7fa814010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:47.814 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.781+0000 7fa818ff9700 1 -- 172.21.15.174:0/3041035328 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fa81403c670 con 0x7fa81c09d620 2020-04-02T23:21:47.921 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.918+0000 7fa821c13700 1 -- 172.21.15.174:0/3041035328 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa81c056c50 con 0x7fa81c09d620 2020-04-02T23:21:47.921 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.918+0000 7fa81bfff700 1 --2- 172.21.15.174:0/3041035328 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa81c09d620 0x7fa81c14dfa0 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7fa810001930 tx=0x7fa814010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:47.921 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.918+0000 7fa818ff9700 1 -- 172.21.15.174:0/3041035328 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa81403fc90 con 0x7fa81c09d620 2020-04-02T23:21:47.921 INFO:teuthology.orchestra.run.smithi174.stdout:60129542149 2020-04-02T23:21:47.923 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.920+0000 7fa821c13700 1 -- 172.21.15.174:0/3041035328 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fa7fc04d8f0 msgr2=0x7fa7fc04fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:47.923 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.920+0000 7fa821c13700 1 --2- 172.21.15.174:0/3041035328 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fa7fc04d8f0 0x7fa7fc04fdb0 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7fa80c002f30 tx=0x7fa80c010020).stop 2020-04-02T23:21:47.923 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.920+0000 7fa821c13700 1 -- 172.21.15.174:0/3041035328 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa81c09d620 msgr2=0x7fa81c14dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:47.923 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.920+0000 7fa821c13700 1 --2- 172.21.15.174:0/3041035328 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa81c09d620 0x7fa81c14dfa0 secure :-1 s=READY pgs=28 cs=0 l=1 rx=0x7fa810001930 tx=0x7fa814010e10).stop 2020-04-02T23:21:47.923 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.920+0000 7fa821c13700 1 -- 172.21.15.174:0/3041035328 shutdown_connections 2020-04-02T23:21:47.923 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.920+0000 7fa821c13700 1 --2- 172.21.15.174:0/3041035328 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fa7fc04d8f0 0x7fa7fc04fdb0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:47.924 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.920+0000 7fa821c13700 1 --2- 172.21.15.174:0/3041035328 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa81c09d620 0x7fa81c14dfa0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:47.924 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.920+0000 7fa821c13700 1 --2- 172.21.15.174:0/3041035328 >> v2:172.21.15.196:3300/0 conn(0x7fa81c064d40 0x7fa81c0a2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:47.924 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.920+0000 7fa821c13700 1 -- 172.21.15.174:0/3041035328 >> 172.21.15.174:0/3041035328 conn(0x7fa81c0ad160 msgr2=0x7fa81c0695c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:47.924 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.920+0000 7fa821c13700 1 -- 172.21.15.174:0/3041035328 shutdown_connections 2020-04-02T23:21:47.924 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:47.920+0000 7fa821c13700 1 -- 172.21.15.174:0/3041035328 wait complete. 2020-04-02T23:21:47.932 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.0 2020-04-02T23:21:48.933 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:48.950 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.0 2020-04-02T23:21:49.107 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.104+0000 7f3b0f51b700 1 Processor -- start 2020-04-02T23:21:49.107 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.105+0000 7f3b0f51b700 1 -- start start 2020-04-02T23:21:49.114 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.105+0000 7f3b0f51b700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3b0805b520 0x7f3b08138760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:49.114 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.105+0000 7f3b0f51b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b08132880 con 0x7f3b0805b090 2020-04-02T23:21:49.114 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.105+0000 7f3b0f51b700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b080a9230 con 0x7f3b0805f600 2020-04-02T23:21:49.114 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.105+0000 7f3b0f51b700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b080608b0 con 0x7f3b0805b520 2020-04-02T23:21:49.114 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.106+0000 7f3b0dd18700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f3b0805b090 0x7f3b08138050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:45018/0 (socket says 172.21.15.174:45018) 2020-04-02T23:21:49.114 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.106+0000 7f3b0dd18700 1 -- 172.21.15.174:0/3064399037 learned_addr learned my addr 172.21.15.174:0/3064399037 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:21:49.114 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.106+0000 7f3b0ed1a700 1 --2- 172.21.15.174:0/3064399037 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3b0805b520 0x7f3b08138760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:49.115 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.106+0000 7f3b0d517700 1 -- 172.21.15.174:0/3064399037 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 981332574 0 0) 0x7f3b08132880 con 0x7f3b0805b090 2020-04-02T23:21:49.115 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.106+0000 7f3b0d517700 1 -- 172.21.15.174:0/3064399037 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3af0003230 con 0x7f3b0805b090 2020-04-02T23:21:49.115 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.106+0000 7f3b0d517700 1 -- 172.21.15.174:0/3064399037 <== mon.0 v1:172.21.15.174:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1203799840 0 0) 0x7f3af0003230 con 0x7f3b0805b090 2020-04-02T23:21:49.115 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.106+0000 7f3b0d517700 1 -- 172.21.15.174:0/3064399037 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3b0805b520 msgr2=0x7f3b08138760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:49.115 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.106+0000 7f3b0d517700 1 --2- 172.21.15.174:0/3064399037 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3b0805b520 0x7f3b08138760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:49.115 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.106+0000 7f3b0d517700 1 -- 172.21.15.174:0/3064399037 >> v1:172.21.15.196:6789/0 conn(0x7f3b0805f600 legacy=0x7f3b080601a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:49.116 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.106+0000 7f3b0d517700 1 -- 172.21.15.174:0/3064399037 --> v1:172.21.15.174:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b080a9460 con 0x7f3b0805b090 2020-04-02T23:21:49.116 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.106+0000 7f3b0d517700 1 -- 172.21.15.174:0/3064399037 <== mon.0 v1:172.21.15.174:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2811762909 0 0) 0x7f3b040016d0 con 0x7f3b0805b090 2020-04-02T23:21:49.116 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.106+0000 7f3b0d517700 1 -- 172.21.15.174:0/3064399037 >> v1:172.21.15.174:6789/0 conn(0x7f3b0805b090 legacy=0x7f3b08138050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:49.116 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.106+0000 7f3b0d517700 1 --2- 172.21.15.174:0/3064399037 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3af0003750 0x7f3af0003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:49.116 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.106+0000 7f3b0d517700 1 --2- 172.21.15.174:0/3064399037 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3b0805b520 0x7f3af00044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:49.116 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.106+0000 7f3b0d517700 1 --2- 172.21.15.174:0/3064399037 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3af0004930 0x7f3af0004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:49.116 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.106+0000 7f3b0d517700 1 -- 172.21.15.174:0/3064399037 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b080608b0 con 0x7f3af0003750 2020-04-02T23:21:49.117 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.106+0000 7f3b0d517700 1 -- 172.21.15.174:0/3064399037 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3af0005330 con 0x7f3af0004930 2020-04-02T23:21:49.117 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.106+0000 7f3b0d517700 1 -- 172.21.15.174:0/3064399037 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3af0004150 con 0x7f3b0805b520 2020-04-02T23:21:49.117 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.106+0000 7f3b0e519700 1 --2- 172.21.15.174:0/3064399037 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3af0003750 0x7f3af0003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:49.117 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.106+0000 7f3b0dd18700 1 --2- 172.21.15.174:0/3064399037 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3b0805b520 0x7f3af00044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:49.117 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.106+0000 7f3b0ed1a700 1 --2- 172.21.15.174:0/3064399037 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3af0004930 0x7f3af0004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:49.117 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.107+0000 7f3b0e519700 1 -- 172.21.15.174:0/3064399037 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3b0805b520 msgr2=0x7f3af00044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:49.117 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.107+0000 7f3b0e519700 1 --2- 172.21.15.174:0/3064399037 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3b0805b520 0x7f3af00044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:49.118 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.107+0000 7f3b0e519700 1 -- 172.21.15.174:0/3064399037 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3af0004930 msgr2=0x7f3af0004db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:49.118 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.107+0000 7f3b0e519700 1 --2- 172.21.15.174:0/3064399037 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3af0004930 0x7f3af0004db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:49.118 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.107+0000 7f3b0e519700 1 -- 172.21.15.174:0/3064399037 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af0003230 con 0x7f3af0003750 2020-04-02T23:21:49.118 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.107+0000 7f3b0e519700 1 --2- 172.21.15.174:0/3064399037 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3af0003750 0x7f3af0003b70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3b0805af70 tx=0x7f3b0806a960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:49.118 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.107+0000 7f3b0e519700 1 --2- 172.21.15.174:0/3064399037 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3af0003750 0x7f3af0003b70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3b0805af70 tx=0x7f3b0806a960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:49.118 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.107+0000 7f3b0e519700 1 --2- 172.21.15.174:0/3064399037 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3af0003750 0x7f3af0003b70 secure :-1 s=READY pgs=136 cs=0 l=1 rx=0x7f3b0805af70 tx=0x7f3b0806a960).ready entity=mon.0 client_cookie=1c64059263c3f29f server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:49.118 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.107+0000 7f3b0e519700 1 --2- 172.21.15.174:0/3064399037 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3af0003750 0x7f3af0003b70 secure :-1 s=THROTTLE_DONE pgs=136 cs=0 l=1 rx=0x7f3b0805af70 tx=0x7f3b0806a960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:49.119 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.107+0000 7f3b0e519700 1 --2- 172.21.15.174:0/3064399037 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3af0003750 0x7f3af0003b70 secure :-1 s=THROTTLE_DONE pgs=136 cs=0 l=1 rx=0x7f3b0805af70 tx=0x7f3b0806a960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:49.119 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.107+0000 7f3b0d517700 1 -- 172.21.15.174:0/3064399037 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3afc003540 con 0x7f3af0003750 2020-04-02T23:21:49.119 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.107+0000 7f3b0e519700 1 --2- 172.21.15.174:0/3064399037 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3af0003750 0x7f3af0003b70 secure :-1 s=THROTTLE_DONE pgs=136 cs=0 l=1 rx=0x7f3b0805af70 tx=0x7f3b0806a960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:49.119 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.107+0000 7f3b0d517700 1 -- 172.21.15.174:0/3064399037 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3afc0036a0 con 0x7f3af0003750 2020-04-02T23:21:49.119 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.107+0000 7f3b0d517700 1 -- 172.21.15.174:0/3064399037 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3afc003ae0 con 0x7f3af0003750 2020-04-02T23:21:49.120 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.107+0000 7f3b0f51b700 1 -- 172.21.15.174:0/3064399037 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3af0003750 msgr2=0x7f3af0003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:49.120 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.107+0000 7f3b0f51b700 1 --2- 172.21.15.174:0/3064399037 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3af0003750 0x7f3af0003b70 secure :-1 s=READY pgs=136 cs=0 l=1 rx=0x7f3b0805af70 tx=0x7f3b0806a960).stop 2020-04-02T23:21:49.120 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.107+0000 7f3b0ed1a700 1 -- 172.21.15.174:0/3064399037 reap_dead start 2020-04-02T23:21:49.120 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.107+0000 7f3b0f51b700 1 -- 172.21.15.174:0/3064399037 shutdown_connections 2020-04-02T23:21:49.120 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.107+0000 7f3b0f51b700 1 -- 172.21.15.174:0/3064399037 >> 172.21.15.174:0/3064399037 conn(0x7f3b080ae840 msgr2=0x7f3b080aec20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:49.120 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.107+0000 7f3b0f51b700 1 -- 172.21.15.174:0/3064399037 shutdown_connections 2020-04-02T23:21:49.120 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.107+0000 7f3b0f51b700 1 -- 172.21.15.174:0/3064399037 wait complete. 2020-04-02T23:21:49.121 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.108+0000 7f3b0f51b700 1 Processor -- start 2020-04-02T23:21:49.121 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.108+0000 7f3b0f51b700 1 -- start start 2020-04-02T23:21:49.121 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.109+0000 7f3b0f51b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3b080a78e0 0x7f3b080a5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:49.121 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.109+0000 7f3b0f51b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b080a56b0 con 0x7f3b08135130 2020-04-02T23:21:49.121 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.109+0000 7f3b0f51b700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b080a7ff0 con 0x7f3b08134ca0 2020-04-02T23:21:49.121 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.109+0000 7f3b0f51b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b080a8290 con 0x7f3b080a78e0 2020-04-02T23:21:49.121 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.109+0000 7f3b0e519700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3b080a78e0 0x7f3b080a5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:49.121 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.109+0000 7f3b0e519700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3b080a78e0 0x7f3b080a5dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:39990/0 (socket says 172.21.15.174:39990) 2020-04-02T23:21:49.122 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.109+0000 7f3b0e519700 1 -- 172.21.15.174:0/2427690170 learned_addr learned my addr 172.21.15.174:0/2427690170 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:21:49.122 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.109+0000 7f3b0e519700 1 -- 172.21.15.174:0/2427690170 >> v1:172.21.15.196:6789/0 conn(0x7f3b08134ca0 legacy=0x7f3b081318e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:49.122 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.109+0000 7f3b0e519700 1 -- 172.21.15.174:0/2427690170 >> v1:172.21.15.174:6789/0 conn(0x7f3b08135130 legacy=0x7f3b08150110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:49.122 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.109+0000 7f3afb7fe700 1 -- 172.21.15.174:0/2427690170 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1017127039 0 0) 0x7f3b080a56b0 con 0x7f3b08135130 2020-04-02T23:21:49.122 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.109+0000 7f3b0e519700 1 -- 172.21.15.174:0/2427690170 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b080a8530 con 0x7f3b080a78e0 2020-04-02T23:21:49.122 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.109+0000 7f3b0e519700 1 --2- 172.21.15.174:0/2427690170 >> v2:172.21.15.174:3300/0 conn(0x7f3b080a78e0 0x7f3b080a5dc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3b0805af70 tx=0x7f3b0806a960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:49.122 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.109+0000 7f3b0e519700 1 --2- 172.21.15.174:0/2427690170 >> v2:172.21.15.174:3300/0 conn(0x7f3b080a78e0 0x7f3b080a5dc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3b0805af70 tx=0x7f3b0806a960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:49.123 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.109+0000 7f3b0e519700 1 --2- 172.21.15.174:0/2427690170 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3b080a78e0 0x7f3b080a5dc0 secure :-1 s=READY pgs=138 cs=0 l=1 rx=0x7f3b0805af70 tx=0x7f3b0806a960).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:49.123 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.109+0000 7f3b0e519700 1 --2- 172.21.15.174:0/2427690170 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3b080a78e0 0x7f3b080a5dc0 secure :-1 s=THROTTLE_DONE pgs=138 cs=0 l=1 rx=0x7f3b0805af70 tx=0x7f3b0806a960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:49.123 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.109+0000 7f3b0e519700 1 --2- 172.21.15.174:0/2427690170 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3b080a78e0 0x7f3b080a5dc0 secure :-1 s=THROTTLE_DONE pgs=138 cs=0 l=1 rx=0x7f3b0805af70 tx=0x7f3b0806a960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:49.123 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.109+0000 7f3afb7fe700 1 -- 172.21.15.174:0/2427690170 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3afc010870 con 0x7f3b080a78e0 2020-04-02T23:21:49.123 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.109+0000 7f3b0e519700 1 --2- 172.21.15.174:0/2427690170 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3b080a78e0 0x7f3b080a5dc0 secure :-1 s=THROTTLE_DONE pgs=138 cs=0 l=1 rx=0x7f3b0805af70 tx=0x7f3b0806a960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:49.123 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.109+0000 7f3afb7fe700 1 -- 172.21.15.174:0/2427690170 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3afc0109d0 con 0x7f3b080a78e0 2020-04-02T23:21:49.123 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.109+0000 7f3b0f51b700 1 -- 172.21.15.174:0/2427690170 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b080a89d0 con 0x7f3b080a78e0 2020-04-02T23:21:49.124 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.109+0000 7f3afb7fe700 1 -- 172.21.15.174:0/2427690170 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3afc010d70 con 0x7f3b080a78e0 2020-04-02T23:21:49.124 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.110+0000 7f3b0f51b700 1 -- 172.21.15.174:0/2427690170 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b08131ff0 con 0x7f3b080a78e0 2020-04-02T23:21:49.124 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.110+0000 7f3b0e519700 1 --2- 172.21.15.174:0/2427690170 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3b080a78e0 0x7f3b080a5dc0 secure :-1 s=THROTTLE_DONE pgs=138 cs=0 l=1 rx=0x7f3b0805af70 tx=0x7f3b0806a960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:49.124 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.110+0000 7f3afb7fe700 1 -- 172.21.15.174:0/2427690170 <== mon.0 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f3afc015490 con 0x7f3b080a78e0 2020-04-02T23:21:49.124 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.110+0000 7f3b0e519700 1 --2- 172.21.15.174:0/2427690170 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3b080a78e0 0x7f3b080a5dc0 secure :-1 s=THROTTLE_DONE pgs=138 cs=0 l=1 rx=0x7f3b0805af70 tx=0x7f3b0806a960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:49.124 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.111+0000 7f3b0f51b700 1 -- 172.21.15.174:0/2427690170 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b080a7d90 con 0x7f3b080a78e0 2020-04-02T23:21:49.124 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.111+0000 7f3afb7fe700 1 --2- 172.21.15.174:0/2427690170 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f3ae804d420 0x7f3ae804f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:49.125 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.111+0000 7f3afb7fe700 1 -- 172.21.15.174:0/2427690170 <== mon.0 v2:172.21.15.174:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3afc0619a0 con 0x7f3b080a78e0 2020-04-02T23:21:49.125 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.111+0000 7f3b0dd18700 1 --2- 172.21.15.174:0/2427690170 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f3ae804d420 0x7f3ae804f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:49.125 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.111+0000 7f3b0dd18700 1 --2- 172.21.15.174:0/2427690170 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f3ae804d420 0x7f3ae804f8e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3b080a6b40 tx=0x7f3b080a9700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:49.125 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.111+0000 7f3b0dd18700 1 --2- 172.21.15.174:0/2427690170 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f3ae804d420 0x7f3ae804f8e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3b080a6b40 tx=0x7f3b080a9700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:49.125 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.111+0000 7f3b0dd18700 1 --2- 172.21.15.174:0/2427690170 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f3ae804d420 0x7f3ae804f8e0 secure :-1 s=READY pgs=78 cs=0 l=1 rx=0x7f3b080a6b40 tx=0x7f3b080a9700).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:49.126 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.114+0000 7f3b0e519700 1 --2- 172.21.15.174:0/2427690170 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3b080a78e0 0x7f3b080a5dc0 secure :-1 s=THROTTLE_DONE pgs=138 cs=0 l=1 rx=0x7f3b0805af70 tx=0x7f3b0806a960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:49.126 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.114+0000 7f3afb7fe700 1 -- 172.21.15.174:0/2427690170 <== mon.0 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f3b080a7d90 con 0x7f3b080a78e0 2020-04-02T23:21:49.253 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.250+0000 7f3b0f51b700 1 -- 172.21.15.174:0/2427690170 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3b080a7d90 con 0x7f3b080a78e0 2020-04-02T23:21:49.253 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.251+0000 7f3b0e519700 1 --2- 172.21.15.174:0/2427690170 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3b080a78e0 0x7f3b080a5dc0 secure :-1 s=THROTTLE_DONE pgs=138 cs=0 l=1 rx=0x7f3b0805af70 tx=0x7f3b0806a960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:49.254 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.251+0000 7f3afb7fe700 1 -- 172.21.15.174:0/2427690170 <== mon.0 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3b080a7d90 con 0x7f3b080a78e0 2020-04-02T23:21:49.254 INFO:teuthology.orchestra.run.smithi174.stdout:60129542150 2020-04-02T23:21:49.255 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.252+0000 7f3b0f51b700 1 -- 172.21.15.174:0/2427690170 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f3ae804d420 msgr2=0x7f3ae804f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:49.255 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.252+0000 7f3b0f51b700 1 --2- 172.21.15.174:0/2427690170 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f3ae804d420 0x7f3ae804f8e0 secure :-1 s=READY pgs=78 cs=0 l=1 rx=0x7f3b080a6b40 tx=0x7f3b080a9700).stop 2020-04-02T23:21:49.255 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.252+0000 7f3b0f51b700 1 -- 172.21.15.174:0/2427690170 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3b080a78e0 msgr2=0x7f3b080a5dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:49.255 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.252+0000 7f3b0f51b700 1 --2- 172.21.15.174:0/2427690170 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3b080a78e0 0x7f3b080a5dc0 secure :-1 s=READY pgs=138 cs=0 l=1 rx=0x7f3b0805af70 tx=0x7f3b0806a960).stop 2020-04-02T23:21:49.255 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.252+0000 7f3b0f51b700 1 -- 172.21.15.174:0/2427690170 shutdown_connections 2020-04-02T23:21:49.256 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.252+0000 7f3b0f51b700 1 --2- 172.21.15.174:0/2427690170 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3b080a78e0 0x7f3b080a5dc0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:49.256 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.252+0000 7f3b0f51b700 1 --2- 172.21.15.174:0/2427690170 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f3ae804d420 0x7f3ae804f8e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:49.256 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.252+0000 7f3b0f51b700 1 -- 172.21.15.174:0/2427690170 >> 172.21.15.174:0/2427690170 conn(0x7f3b080ae840 msgr2=0x7f3b080695c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:49.256 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.252+0000 7f3b0f51b700 1 -- 172.21.15.174:0/2427690170 shutdown_connections 2020-04-02T23:21:49.256 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.252+0000 7f3b0f51b700 1 -- 172.21.15.174:0/2427690170 wait complete. 2020-04-02T23:21:49.271 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.0 2020-04-02T23:21:49.271 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:49.285 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.1 2020-04-02T23:21:49.442 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.439+0000 7faf75227700 1 Processor -- start 2020-04-02T23:21:49.442 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.440+0000 7faf75227700 1 -- start start 2020-04-02T23:21:49.443 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.440+0000 7faf75227700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7faf700a62e0 0x7faf7005ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:49.443 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.440+0000 7faf75227700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf7013b600 0x7faf7013ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:49.443 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.440+0000 7faf75227700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf700a9150 con 0x7faf700a5f00 2020-04-02T23:21:49.443 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.440+0000 7faf75227700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf700aa720 con 0x7faf700a62e0 2020-04-02T23:21:49.443 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.440+0000 7faf75227700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf700a6770 con 0x7faf7013b600 2020-04-02T23:21:49.448 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.441+0000 7faf6f59e700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf7013b600 0x7faf7013ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:49.448 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.441+0000 7faf6f59e700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf7013b600 0x7faf7013ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.174:34590/0 (socket says 172.21.15.174:34590) 2020-04-02T23:21:49.448 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.441+0000 7faf6f59e700 1 -- 172.21.15.174:0/489930778 learned_addr learned my addr 172.21.15.174:0/489930778 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:21:49.448 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.441+0000 7faf6ed9d700 1 --1- 172.21.15.174:0/489930778 >> v1:172.21.15.196:6789/0 conn(0x7faf700a5f00 0x7faf700a9a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.174:51130/0 (socket says 172.21.15.174:51130) 2020-04-02T23:21:49.449 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.441+0000 7faf6e59c700 1 --2- 172.21.15.174:0/489930778 >> v2:172.21.15.196:3300/0 conn(0x7faf700a62e0 0x7faf7005ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:49.449 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.441+0000 7faf6f59e700 1 -- 172.21.15.174:0/489930778 >> v2:172.21.15.196:3300/0 conn(0x7faf700a62e0 msgr2=0x7faf7005ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:49.449 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.441+0000 7faf6f59e700 1 --2- 172.21.15.174:0/489930778 >> v2:172.21.15.196:3300/0 conn(0x7faf700a62e0 0x7faf7005ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:49.449 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.441+0000 7faf6f59e700 1 -- 172.21.15.174:0/489930778 >> v1:172.21.15.196:6789/0 conn(0x7faf700a5f00 legacy=0x7faf700a9a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:49.449 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.441+0000 7faf6f59e700 1 -- 172.21.15.174:0/489930778 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf7005c3b0 con 0x7faf7013b600 2020-04-02T23:21:49.449 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.441+0000 7faf6f59e700 1 --2- 172.21.15.174:0/489930778 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf7013b600 0x7faf7013ba70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7faf680032b0 tx=0x7faf68007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:49.449 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.441+0000 7faf6f59e700 1 --2- 172.21.15.174:0/489930778 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf7013b600 0x7faf7013ba70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7faf680032b0 tx=0x7faf68007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:49.449 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.441+0000 7faf6f59e700 1 --2- 172.21.15.174:0/489930778 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf7013b600 0x7faf7013ba70 secure :-1 s=READY pgs=29 cs=0 l=1 rx=0x7faf680032b0 tx=0x7faf68007dc0).ready entity=mon.2 client_cookie=1254e5f23e35e40e server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:49.450 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.441+0000 7faf6f59e700 1 --2- 172.21.15.174:0/489930778 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf7013b600 0x7faf7013ba70 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7faf680032b0 tx=0x7faf68007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:49.450 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.441+0000 7faf6dd9b700 1 -- 172.21.15.174:0/489930778 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf6800a160 con 0x7faf7013b600 2020-04-02T23:21:49.450 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.441+0000 7faf6f59e700 1 --2- 172.21.15.174:0/489930778 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf7013b600 0x7faf7013ba70 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7faf680032b0 tx=0x7faf68007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:49.450 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.441+0000 7faf6f59e700 1 --2- 172.21.15.174:0/489930778 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf7013b600 0x7faf7013ba70 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7faf680032b0 tx=0x7faf68007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:49.450 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.441+0000 7faf6dd9b700 1 -- 172.21.15.174:0/489930778 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf6800a2c0 con 0x7faf7013b600 2020-04-02T23:21:49.450 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.441+0000 7faf6dd9b700 1 -- 172.21.15.174:0/489930778 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf6800a6e0 con 0x7faf7013b600 2020-04-02T23:21:49.450 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.441+0000 7faf75227700 1 -- 172.21.15.174:0/489930778 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf7013b600 msgr2=0x7faf7013ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:49.451 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.441+0000 7faf75227700 1 --2- 172.21.15.174:0/489930778 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf7013b600 0x7faf7013ba70 secure :-1 s=READY pgs=29 cs=0 l=1 rx=0x7faf680032b0 tx=0x7faf68007dc0).stop 2020-04-02T23:21:49.451 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.442+0000 7faf75227700 1 -- 172.21.15.174:0/489930778 shutdown_connections 2020-04-02T23:21:49.451 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.442+0000 7faf75227700 1 --2- 172.21.15.174:0/489930778 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf7013b600 0x7faf7013ba70 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:49.451 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.442+0000 7faf75227700 1 --2- 172.21.15.174:0/489930778 >> v2:172.21.15.196:3300/0 conn(0x7faf700a62e0 0x7faf7005ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:49.451 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.442+0000 7faf75227700 1 -- 172.21.15.174:0/489930778 >> 172.21.15.174:0/489930778 conn(0x7faf700ab320 msgr2=0x7faf700ab730 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:49.451 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.442+0000 7faf75227700 1 -- 172.21.15.174:0/489930778 shutdown_connections 2020-04-02T23:21:49.451 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.442+0000 7faf75227700 1 -- 172.21.15.174:0/489930778 wait complete. 2020-04-02T23:21:49.451 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.443+0000 7faf75227700 1 Processor -- start 2020-04-02T23:21:49.452 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.443+0000 7faf75227700 1 -- start start 2020-04-02T23:21:49.452 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.443+0000 7faf75227700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7faf700a5f00 0x7faf701454b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:49.452 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.443+0000 7faf75227700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf70136050 con 0x7faf7013b600 2020-04-02T23:21:49.452 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.443+0000 7faf75227700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf70145a30 con 0x7faf700a62e0 2020-04-02T23:21:49.452 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.443+0000 7faf75227700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf70146410 con 0x7faf700a5f00 2020-04-02T23:21:49.452 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.443+0000 7faf6ed9d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7faf700a5f00 0x7faf701454b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:49.452 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.443+0000 7faf6ed9d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7faf700a5f00 0x7faf701454b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:40004/0 (socket says 172.21.15.174:40004) 2020-04-02T23:21:49.453 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.443+0000 7faf6f59e700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7faf7013b600 0x7faf70134ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:45046/0 (socket says 172.21.15.174:45046) 2020-04-02T23:21:49.453 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.443+0000 7faf6ed9d700 1 -- 172.21.15.174:0/3357602276 learned_addr learned my addr 172.21.15.174:0/3357602276 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:21:49.453 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.444+0000 7faf6ed9d700 1 -- 172.21.15.174:0/3357602276 >> v1:172.21.15.196:6789/0 conn(0x7faf700a62e0 legacy=0x7faf701366c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:49.453 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.444+0000 7faf6ed9d700 1 -- 172.21.15.174:0/3357602276 >> v1:172.21.15.174:6789/0 conn(0x7faf7013b600 legacy=0x7faf70134ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:49.453 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.444+0000 7faf67fff700 1 -- 172.21.15.174:0/3357602276 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2162129607 0 0) 0x7faf70145a30 con 0x7faf700a62e0 2020-04-02T23:21:49.453 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.444+0000 7faf6ed9d700 1 -- 172.21.15.174:0/3357602276 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf70145cd0 con 0x7faf700a5f00 2020-04-02T23:21:49.453 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.444+0000 7faf6ed9d700 1 --2- 172.21.15.174:0/3357602276 >> v2:172.21.15.174:3300/0 conn(0x7faf700a5f00 0x7faf701454b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7faf68008250 tx=0x7faf700445b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:49.454 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.444+0000 7faf6ed9d700 1 --2- 172.21.15.174:0/3357602276 >> v2:172.21.15.174:3300/0 conn(0x7faf700a5f00 0x7faf701454b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7faf68008250 tx=0x7faf700445b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:49.454 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.444+0000 7faf6ed9d700 1 --2- 172.21.15.174:0/3357602276 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faf700a5f00 0x7faf701454b0 secure :-1 s=READY pgs=140 cs=0 l=1 rx=0x7faf68008250 tx=0x7faf700445b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:49.454 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.444+0000 7faf6ed9d700 1 --2- 172.21.15.174:0/3357602276 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faf700a5f00 0x7faf701454b0 secure :-1 s=THROTTLE_DONE pgs=140 cs=0 l=1 rx=0x7faf68008250 tx=0x7faf700445b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:49.454 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.444+0000 7faf67fff700 1 -- 172.21.15.174:0/3357602276 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf60011620 con 0x7faf700a5f00 2020-04-02T23:21:49.454 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.444+0000 7faf6ed9d700 1 --2- 172.21.15.174:0/3357602276 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faf700a5f00 0x7faf701454b0 secure :-1 s=THROTTLE_DONE pgs=140 cs=0 l=1 rx=0x7faf68008250 tx=0x7faf700445b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:49.454 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.444+0000 7faf67fff700 1 -- 172.21.15.174:0/3357602276 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf60011780 con 0x7faf700a5f00 2020-04-02T23:21:49.454 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.444+0000 7faf6ed9d700 1 --2- 172.21.15.174:0/3357602276 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faf700a5f00 0x7faf701454b0 secure :-1 s=THROTTLE_DONE pgs=140 cs=0 l=1 rx=0x7faf68008250 tx=0x7faf700445b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:49.454 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.444+0000 7faf75227700 1 -- 172.21.15.174:0/3357602276 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf70145f70 con 0x7faf700a5f00 2020-04-02T23:21:49.455 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.444+0000 7faf67fff700 1 -- 172.21.15.174:0/3357602276 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf60011b20 con 0x7faf700a5f00 2020-04-02T23:21:49.455 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.444+0000 7faf75227700 1 -- 172.21.15.174:0/3357602276 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf70137b00 con 0x7faf700a5f00 2020-04-02T23:21:49.455 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.445+0000 7faf6ed9d700 1 --2- 172.21.15.174:0/3357602276 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faf700a5f00 0x7faf701454b0 secure :-1 s=THROTTLE_DONE pgs=140 cs=0 l=1 rx=0x7faf68008250 tx=0x7faf700445b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:49.455 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.445+0000 7faf75227700 1 -- 172.21.15.174:0/3357602276 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf70135840 con 0x7faf700a5f00 2020-04-02T23:21:49.455 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.445+0000 7faf67fff700 1 -- 172.21.15.174:0/3357602276 <== mon.0 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7faf60007180 con 0x7faf700a5f00 2020-04-02T23:21:49.455 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.445+0000 7faf6ed9d700 1 --2- 172.21.15.174:0/3357602276 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faf700a5f00 0x7faf701454b0 secure :-1 s=THROTTLE_DONE pgs=140 cs=0 l=1 rx=0x7faf68008250 tx=0x7faf700445b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:49.455 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.446+0000 7faf67fff700 1 --2- 172.21.15.174:0/3357602276 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7faf5404d420 0x7faf5404f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:49.455 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.446+0000 7faf67fff700 1 -- 172.21.15.174:0/3357602276 <== mon.0 v2:172.21.15.174:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7faf60060b90 con 0x7faf700a5f00 2020-04-02T23:21:49.456 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.446+0000 7faf6e59c700 1 --2- 172.21.15.174:0/3357602276 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7faf5404d420 0x7faf5404f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:49.457 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.446+0000 7faf6e59c700 1 --2- 172.21.15.174:0/3357602276 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7faf5404d420 0x7faf5404f8e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7faf58007920 tx=0x7faf58009900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:49.457 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.446+0000 7faf6e59c700 1 --2- 172.21.15.174:0/3357602276 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7faf5404d420 0x7faf5404f8e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7faf58007920 tx=0x7faf58009900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:49.457 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.446+0000 7faf6e59c700 1 --2- 172.21.15.174:0/3357602276 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7faf5404d420 0x7faf5404f8e0 secure :-1 s=READY pgs=79 cs=0 l=1 rx=0x7faf58007920 tx=0x7faf58009900).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:49.457 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.449+0000 7faf6ed9d700 1 --2- 172.21.15.174:0/3357602276 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faf700a5f00 0x7faf701454b0 secure :-1 s=THROTTLE_DONE pgs=140 cs=0 l=1 rx=0x7faf68008250 tx=0x7faf700445b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:49.457 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.449+0000 7faf67fff700 1 -- 172.21.15.174:0/3357602276 <== mon.0 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7faf6003c210 con 0x7faf700a5f00 2020-04-02T23:21:49.590 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.587+0000 7faf75227700 1 -- 172.21.15.174:0/3357602276 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7faf70056c50 con 0x7faf700a5f00 2020-04-02T23:21:49.590 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.587+0000 7faf6ed9d700 1 --2- 172.21.15.174:0/3357602276 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faf700a5f00 0x7faf701454b0 secure :-1 s=THROTTLE_DONE pgs=140 cs=0 l=1 rx=0x7faf68008250 tx=0x7faf700445b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:49.590 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.587+0000 7faf67fff700 1 -- 172.21.15.174:0/3357602276 <== mon.0 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7faf6003f830 con 0x7faf700a5f00 2020-04-02T23:21:49.590 INFO:teuthology.orchestra.run.smithi174.stdout:60129542150 2020-04-02T23:21:49.592 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.589+0000 7faf75227700 1 -- 172.21.15.174:0/3357602276 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7faf5404d420 msgr2=0x7faf5404f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:49.592 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.589+0000 7faf75227700 1 --2- 172.21.15.174:0/3357602276 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7faf5404d420 0x7faf5404f8e0 secure :-1 s=READY pgs=79 cs=0 l=1 rx=0x7faf58007920 tx=0x7faf58009900).stop 2020-04-02T23:21:49.592 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.589+0000 7faf75227700 1 -- 172.21.15.174:0/3357602276 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faf700a5f00 msgr2=0x7faf701454b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:49.592 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.589+0000 7faf75227700 1 --2- 172.21.15.174:0/3357602276 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faf700a5f00 0x7faf701454b0 secure :-1 s=READY pgs=140 cs=0 l=1 rx=0x7faf68008250 tx=0x7faf700445b0).stop 2020-04-02T23:21:49.592 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.589+0000 7faf75227700 1 -- 172.21.15.174:0/3357602276 shutdown_connections 2020-04-02T23:21:49.592 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.589+0000 7faf75227700 1 --2- 172.21.15.174:0/3357602276 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faf700a5f00 0x7faf701454b0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:49.592 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.589+0000 7faf75227700 1 --2- 172.21.15.174:0/3357602276 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7faf5404d420 0x7faf5404f8e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:49.593 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.589+0000 7faf75227700 1 -- 172.21.15.174:0/3357602276 >> 172.21.15.174:0/3357602276 conn(0x7faf700ab320 msgr2=0x7faf700695c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:49.593 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.589+0000 7faf75227700 1 -- 172.21.15.174:0/3357602276 shutdown_connections 2020-04-02T23:21:49.593 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.589+0000 7faf75227700 1 -- 172.21.15.174:0/3357602276 wait complete. 2020-04-02T23:21:49.612 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.1 2020-04-02T23:21:49.613 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:49.627 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.2 2020-04-02T23:21:49.774 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.771+0000 7f739200b700 1 Processor -- start 2020-04-02T23:21:49.774 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.771+0000 7f739200b700 1 -- start start 2020-04-02T23:21:49.776 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.772+0000 7f739200b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f738c135030 0x7f738c05ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:49.777 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.772+0000 7f739200b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f738c134420 con 0x7f738c0a5900 2020-04-02T23:21:49.777 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.772+0000 7f739200b700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f738c0a49d0 con 0x7f738c12e970 2020-04-02T23:21:49.777 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.772+0000 7f739200b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f738c05b060 con 0x7f738c135030 2020-04-02T23:21:49.777 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.772+0000 7f738bfff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f738c135030 0x7f738c05ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:49.777 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.772+0000 7f738b7fe700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f738c0a5900 0x7f738c12e260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:45050/0 (socket says 172.21.15.174:45050) 2020-04-02T23:21:49.777 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.772+0000 7f738bfff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f738c135030 0x7f738c05ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:40016/0 (socket says 172.21.15.174:40016) 2020-04-02T23:21:49.778 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.772+0000 7f738b7fe700 1 -- 172.21.15.174:0/795168009 learned_addr learned my addr 172.21.15.174:0/795168009 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:21:49.778 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.772+0000 7f738bfff700 1 -- 172.21.15.174:0/795168009 >> v1:172.21.15.196:6789/0 conn(0x7f738c12e970 legacy=0x7f738c13cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:49.778 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.772+0000 7f738bfff700 1 -- 172.21.15.174:0/795168009 >> v1:172.21.15.174:6789/0 conn(0x7f738c0a5900 legacy=0x7f738c12e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:49.778 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.772+0000 7f738bfff700 1 -- 172.21.15.174:0/795168009 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f738c134650 con 0x7f738c135030 2020-04-02T23:21:49.778 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.772+0000 7f738a7fc700 1 -- 172.21.15.174:0/795168009 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1674801723 0 0) 0x7f738c134420 con 0x7f738c0a5900 2020-04-02T23:21:49.778 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.772+0000 7f738bfff700 1 --2- 172.21.15.174:0/795168009 >> v2:172.21.15.174:3300/0 conn(0x7f738c135030 0x7f738c05ac00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f73840032b0 tx=0x7f7384007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:49.778 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.772+0000 7f738bfff700 1 --2- 172.21.15.174:0/795168009 >> v2:172.21.15.174:3300/0 conn(0x7f738c135030 0x7f738c05ac00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f73840032b0 tx=0x7f7384007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:49.778 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.772+0000 7f738bfff700 1 --2- 172.21.15.174:0/795168009 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f738c135030 0x7f738c05ac00 secure :-1 s=READY pgs=142 cs=0 l=1 rx=0x7f73840032b0 tx=0x7f7384007dc0).ready entity=mon.0 client_cookie=763a66e00f881e44 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:49.779 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.773+0000 7f738bfff700 1 --2- 172.21.15.174:0/795168009 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f738c135030 0x7f738c05ac00 secure :-1 s=THROTTLE_DONE pgs=142 cs=0 l=1 rx=0x7f73840032b0 tx=0x7f7384007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:49.779 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.773+0000 7f738a7fc700 1 -- 172.21.15.174:0/795168009 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f738400a160 con 0x7f738c135030 2020-04-02T23:21:49.779 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.773+0000 7f738bfff700 1 --2- 172.21.15.174:0/795168009 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f738c135030 0x7f738c05ac00 secure :-1 s=THROTTLE_DONE pgs=142 cs=0 l=1 rx=0x7f73840032b0 tx=0x7f7384007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:49.779 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.773+0000 7f738a7fc700 1 -- 172.21.15.174:0/795168009 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f738400a2c0 con 0x7f738c135030 2020-04-02T23:21:49.779 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.773+0000 7f738bfff700 1 --2- 172.21.15.174:0/795168009 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f738c135030 0x7f738c05ac00 secure :-1 s=THROTTLE_DONE pgs=142 cs=0 l=1 rx=0x7f73840032b0 tx=0x7f7384007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:49.779 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.773+0000 7f738a7fc700 1 -- 172.21.15.174:0/795168009 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f738400a6a0 con 0x7f738c135030 2020-04-02T23:21:49.779 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.773+0000 7f739200b700 1 -- 172.21.15.174:0/795168009 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f738c135030 msgr2=0x7f738c05ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:49.779 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.773+0000 7f739200b700 1 --2- 172.21.15.174:0/795168009 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f738c135030 0x7f738c05ac00 secure :-1 s=READY pgs=142 cs=0 l=1 rx=0x7f73840032b0 tx=0x7f7384007dc0).stop 2020-04-02T23:21:49.780 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.773+0000 7f739200b700 1 -- 172.21.15.174:0/795168009 shutdown_connections 2020-04-02T23:21:49.780 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.773+0000 7f739200b700 1 --2- 172.21.15.174:0/795168009 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f738c135030 0x7f738c05ac00 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:49.780 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.773+0000 7f739200b700 1 -- 172.21.15.174:0/795168009 >> 172.21.15.174:0/795168009 conn(0x7f738c0aaf80 msgr2=0x7f738c0a6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:49.780 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.773+0000 7f739200b700 1 -- 172.21.15.174:0/795168009 shutdown_connections 2020-04-02T23:21:49.780 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.773+0000 7f739200b700 1 -- 172.21.15.174:0/795168009 wait complete. 2020-04-02T23:21:49.780 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.774+0000 7f739200b700 1 Processor -- start 2020-04-02T23:21:49.780 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.774+0000 7f739200b700 1 -- start start 2020-04-02T23:21:49.786 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.775+0000 7f739200b700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f738c0a5900 0x7f738c09ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:49.787 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.775+0000 7f739200b700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f738c135030 0x7f738c137800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:49.787 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.775+0000 7f739200b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f738c137c60 con 0x7f738c13b8b0 2020-04-02T23:21:49.787 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.775+0000 7f739200b700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f738c137ea0 con 0x7f738c135030 2020-04-02T23:21:49.787 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.775+0000 7f739200b700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f738c0a0650 con 0x7f738c0a5900 2020-04-02T23:21:49.787 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.775+0000 7f738bfff700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f738c13b8b0 0x7f738c12c750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:45060/0 (socket says 172.21.15.174:45060) 2020-04-02T23:21:49.787 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.775+0000 7f738bfff700 1 -- 172.21.15.174:0/227625008 learned_addr learned my addr 172.21.15.174:0/227625008 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:21:49.787 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.775+0000 7f738b7fe700 1 --2- 172.21.15.174:0/227625008 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f738c0a5900 0x7f738c09ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:49.788 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.775+0000 7f738affd700 1 --2- 172.21.15.174:0/227625008 >> v2:172.21.15.196:3300/0 conn(0x7f738c135030 0x7f738c137800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:49.788 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.775+0000 7f7388ff9700 1 -- 172.21.15.174:0/227625008 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2034480448 0 0) 0x7f738c134650 con 0x7f738c13b8b0 2020-04-02T23:21:49.788 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.775+0000 7f7388ff9700 1 -- 172.21.15.174:0/227625008 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f736c002fe0 con 0x7f738c13b8b0 2020-04-02T23:21:49.788 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.775+0000 7f7388ff9700 1 -- 172.21.15.174:0/227625008 <== mon.0 v1:172.21.15.174:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3218665686 0 0) 0x7f736c002fe0 con 0x7f738c13b8b0 2020-04-02T23:21:49.788 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.775+0000 7f7388ff9700 1 -- 172.21.15.174:0/227625008 --> v1:172.21.15.174:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f738c134650 con 0x7f738c13b8b0 2020-04-02T23:21:49.788 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.775+0000 7f7388ff9700 1 -- 172.21.15.174:0/227625008 <== mon.0 v1:172.21.15.174:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2811762909 0 0) 0x7f73840089e0 con 0x7f738c13b8b0 2020-04-02T23:21:49.788 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.775+0000 7f7388ff9700 1 -- 172.21.15.174:0/227625008 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f738c0a5900 msgr2=0x7f738c09ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:49.789 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.775+0000 7f7388ff9700 1 --2- 172.21.15.174:0/227625008 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f738c0a5900 0x7f738c09ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:49.789 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.775+0000 7f7388ff9700 1 -- 172.21.15.174:0/227625008 >> v2:172.21.15.196:3300/0 conn(0x7f738c135030 msgr2=0x7f738c137800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:49.789 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.775+0000 7f7388ff9700 1 --2- 172.21.15.174:0/227625008 >> v2:172.21.15.196:3300/0 conn(0x7f738c135030 0x7f738c137800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:49.789 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.775+0000 7f7388ff9700 1 -- 172.21.15.174:0/227625008 >> v1:172.21.15.174:6789/0 conn(0x7f738c13b8b0 legacy=0x7f738c12c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:49.789 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.775+0000 7f7388ff9700 1 --2- 172.21.15.174:0/227625008 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f736c0049b0 0x7f736c004dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:49.790 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.775+0000 7f7388ff9700 1 --2- 172.21.15.174:0/227625008 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f738c0a5900 0x7f736c003920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:49.790 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.775+0000 7f7388ff9700 1 --2- 172.21.15.174:0/227625008 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f736c003d80 0x7f736c004200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:49.790 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.775+0000 7f7388ff9700 1 -- 172.21.15.174:0/227625008 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f738c137ea0 con 0x7f736c003d80 2020-04-02T23:21:49.790 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.775+0000 7f7388ff9700 1 -- 172.21.15.174:0/227625008 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f738c0a0650 con 0x7f736c0049b0 2020-04-02T23:21:49.790 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.775+0000 7f7388ff9700 1 -- 172.21.15.174:0/227625008 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f736c0047a0 con 0x7f738c0a5900 2020-04-02T23:21:49.790 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.775+0000 7f738affd700 1 --2- 172.21.15.174:0/227625008 >> v2:172.21.15.196:3300/0 conn(0x7f738c135030 0x7f738c137800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:21:49.790 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.775+0000 7f738bfff700 1 --2- 172.21.15.174:0/227625008 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f736c003d80 0x7f736c004200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:49.791 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.775+0000 7f738b7fe700 1 --2- 172.21.15.174:0/227625008 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f736c0049b0 0x7f736c004dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:49.791 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.776+0000 7f738affd700 1 --2- 172.21.15.174:0/227625008 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f738c0a5900 0x7f736c003920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:49.791 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.776+0000 7f738bfff700 1 -- 172.21.15.174:0/227625008 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f738c0a5900 msgr2=0x7f736c003920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:49.791 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.776+0000 7f738bfff700 1 --2- 172.21.15.174:0/227625008 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f738c0a5900 0x7f736c003920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:49.791 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.776+0000 7f738bfff700 1 -- 172.21.15.174:0/227625008 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f736c0049b0 msgr2=0x7f736c004dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:49.792 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.776+0000 7f738bfff700 1 --2- 172.21.15.174:0/227625008 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f736c0049b0 0x7f736c004dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:49.792 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.776+0000 7f738bfff700 1 -- 172.21.15.174:0/227625008 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f738c09e890 con 0x7f736c003d80 2020-04-02T23:21:49.792 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.776+0000 7f739200b700 1 -- 172.21.15.174:0/227625008 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f738c131fa0 con 0x7f736c003d80 2020-04-02T23:21:49.792 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.776+0000 7f738bfff700 1 --2- 172.21.15.174:0/227625008 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f736c003d80 0x7f736c004200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7384008660 tx=0x7f7384007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:49.792 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.776+0000 7f739200b700 1 -- 172.21.15.174:0/227625008 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f738c12d0a0 con 0x7f736c003d80 2020-04-02T23:21:49.792 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.776+0000 7f738bfff700 1 --2- 172.21.15.174:0/227625008 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f736c003d80 0x7f736c004200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7384008660 tx=0x7f7384007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:49.792 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.776+0000 7f738bfff700 1 --2- 172.21.15.174:0/227625008 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f736c003d80 0x7f736c004200 secure :-1 s=READY pgs=144 cs=0 l=1 rx=0x7f7384008660 tx=0x7f7384007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:49.793 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.776+0000 7f738bfff700 1 --2- 172.21.15.174:0/227625008 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f736c003d80 0x7f736c004200 secure :-1 s=THROTTLE_DONE pgs=144 cs=0 l=1 rx=0x7f7384008660 tx=0x7f7384007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:49.793 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.776+0000 7f7388ff9700 1 -- 172.21.15.174:0/227625008 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f738400a570 con 0x7f736c003d80 2020-04-02T23:21:49.793 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.776+0000 7f738bfff700 1 --2- 172.21.15.174:0/227625008 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f736c003d80 0x7f736c004200 secure :-1 s=THROTTLE_DONE pgs=144 cs=0 l=1 rx=0x7f7384008660 tx=0x7f7384007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:49.793 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.776+0000 7f738bfff700 1 --2- 172.21.15.174:0/227625008 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f736c003d80 0x7f736c004200 secure :-1 s=THROTTLE_DONE pgs=144 cs=0 l=1 rx=0x7f7384008660 tx=0x7f7384007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:49.793 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.776+0000 7f7388ff9700 1 -- 172.21.15.174:0/227625008 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7384005e20 con 0x7f736c003d80 2020-04-02T23:21:49.793 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.776+0000 7f7388ff9700 1 -- 172.21.15.174:0/227625008 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7384007340 con 0x7f736c003d80 2020-04-02T23:21:49.793 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.777+0000 7f738bfff700 1 --2- 172.21.15.174:0/227625008 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f736c003d80 0x7f736c004200 secure :-1 s=THROTTLE_DONE pgs=144 cs=0 l=1 rx=0x7f7384008660 tx=0x7f7384007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:49.793 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.777+0000 7f739200b700 1 -- 172.21.15.174:0/227625008 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7368003340 con 0x7f736c003d80 2020-04-02T23:21:49.794 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.777+0000 7f7388ff9700 1 -- 172.21.15.174:0/227625008 <== mon.0 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f73840074a0 con 0x7f736c003d80 2020-04-02T23:21:49.794 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.777+0000 7f738bfff700 1 --2- 172.21.15.174:0/227625008 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f736c003d80 0x7f736c004200 secure :-1 s=THROTTLE_DONE pgs=144 cs=0 l=1 rx=0x7f7384008660 tx=0x7f7384007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:49.794 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.777+0000 7f7388ff9700 1 --2- 172.21.15.174:0/227625008 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f736c055590 0x7f736c057a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:49.794 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.777+0000 7f7388ff9700 1 -- 172.21.15.174:0/227625008 <== mon.0 v2:172.21.15.174:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7384062480 con 0x7f736c003d80 2020-04-02T23:21:49.794 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.778+0000 7f738b7fe700 1 --2- 172.21.15.174:0/227625008 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f736c055590 0x7f736c057a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:49.794 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.778+0000 7f738b7fe700 1 --2- 172.21.15.174:0/227625008 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f736c055590 0x7f736c057a50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f737c000b80 tx=0x7f737c00ca90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:49.794 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.778+0000 7f738b7fe700 1 --2- 172.21.15.174:0/227625008 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f736c055590 0x7f736c057a50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f737c000b80 tx=0x7f737c00ca90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:49.795 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.778+0000 7f738b7fe700 1 --2- 172.21.15.174:0/227625008 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f736c055590 0x7f736c057a50 secure :-1 s=READY pgs=80 cs=0 l=1 rx=0x7f737c000b80 tx=0x7f737c00ca90).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:49.795 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.781+0000 7f738bfff700 1 --2- 172.21.15.174:0/227625008 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f736c003d80 0x7f736c004200 secure :-1 s=THROTTLE_DONE pgs=144 cs=0 l=1 rx=0x7f7384008660 tx=0x7f7384007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:49.795 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.781+0000 7f7388ff9700 1 -- 172.21.15.174:0/227625008 <== mon.0 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f738403dc80 con 0x7f736c003d80 2020-04-02T23:21:49.921 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.918+0000 7f739200b700 1 -- 172.21.15.174:0/227625008 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f73680021d0 con 0x7f736c003d80 2020-04-02T23:21:49.921 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.919+0000 7f738bfff700 1 --2- 172.21.15.174:0/227625008 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f736c003d80 0x7f736c004200 secure :-1 s=THROTTLE_DONE pgs=144 cs=0 l=1 rx=0x7f7384008660 tx=0x7f7384007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:49.922 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.919+0000 7f7388ff9700 1 -- 172.21.15.174:0/227625008 <== mon.0 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f73840412a0 con 0x7f736c003d80 2020-04-02T23:21:49.922 INFO:teuthology.orchestra.run.smithi174.stdout:60129542150 2020-04-02T23:21:49.923 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.920+0000 7f739200b700 1 -- 172.21.15.174:0/227625008 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f736c055590 msgr2=0x7f736c057a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:49.923 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.920+0000 7f739200b700 1 --2- 172.21.15.174:0/227625008 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f736c055590 0x7f736c057a50 secure :-1 s=READY pgs=80 cs=0 l=1 rx=0x7f737c000b80 tx=0x7f737c00ca90).stop 2020-04-02T23:21:49.923 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.920+0000 7f739200b700 1 -- 172.21.15.174:0/227625008 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f736c003d80 msgr2=0x7f736c004200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:49.923 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.920+0000 7f739200b700 1 --2- 172.21.15.174:0/227625008 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f736c003d80 0x7f736c004200 secure :-1 s=READY pgs=144 cs=0 l=1 rx=0x7f7384008660 tx=0x7f7384007dc0).stop 2020-04-02T23:21:49.924 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.920+0000 7f738bfff700 1 -- 172.21.15.174:0/227625008 reap_dead start 2020-04-02T23:21:49.924 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.920+0000 7f738bfff700 1 -- 172.21.15.174:0/227625008 reap_dead start 2020-04-02T23:21:49.924 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.920+0000 7f739200b700 1 -- 172.21.15.174:0/227625008 shutdown_connections 2020-04-02T23:21:49.924 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.920+0000 7f739200b700 1 -- 172.21.15.174:0/227625008 >> 172.21.15.174:0/227625008 conn(0x7f738c0aaf80 msgr2=0x7f738c0a7540 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:49.924 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.920+0000 7f739200b700 1 -- 172.21.15.174:0/227625008 shutdown_connections 2020-04-02T23:21:49.924 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:49.920+0000 7f739200b700 1 -- 172.21.15.174:0/227625008 wait complete. 2020-04-02T23:21:49.933 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.2 2020-04-02T23:21:49.933 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:49.947 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.3 2020-04-02T23:21:50.092 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.090+0000 7fbf669f5700 1 Processor -- start 2020-04-02T23:21:50.093 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.090+0000 7fbf669f5700 1 -- start start 2020-04-02T23:21:50.095 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.091+0000 7fbf669f5700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbf600a7a60 0x7fbf600a38f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:50.096 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.091+0000 7fbf669f5700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fbf60138b90 0x7fbf60134d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:50.096 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.091+0000 7fbf669f5700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf600a40d0 con 0x7fbf600a1fe0 2020-04-02T23:21:50.096 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.091+0000 7fbf669f5700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf600a3ef0 con 0x7fbf60138b90 2020-04-02T23:21:50.096 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.091+0000 7fbf669f5700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf600a4370 con 0x7fbf600a7a60 2020-04-02T23:21:50.096 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.091+0000 7fbf5ffff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbf600a7a60 0x7fbf600a38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:50.096 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.091+0000 7fbf5ffff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbf600a7a60 0x7fbf600a38f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.174:34620/0 (socket says 172.21.15.174:34620) 2020-04-02T23:21:50.096 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.091+0000 7fbf5ffff700 1 -- 172.21.15.174:0/3949800658 learned_addr learned my addr 172.21.15.174:0/3949800658 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:21:50.097 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.091+0000 7fbf64f92700 1 --2- 172.21.15.174:0/3949800658 >> v2:172.21.15.196:3300/0 conn(0x7fbf60138b90 0x7fbf60134d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:50.097 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.091+0000 7fbf5f7fe700 1 --1- 172.21.15.174:0/3949800658 >> v1:172.21.15.196:6789/0 conn(0x7fbf600a1fe0 0x7fbf60138480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.174:51166/0 (socket says 172.21.15.174:51166) 2020-04-02T23:21:50.097 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.091+0000 7fbf5ffff700 1 -- 172.21.15.174:0/3949800658 >> v2:172.21.15.196:3300/0 conn(0x7fbf60138b90 msgr2=0x7fbf60134d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:50.097 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.091+0000 7fbf5ffff700 1 --2- 172.21.15.174:0/3949800658 >> v2:172.21.15.196:3300/0 conn(0x7fbf60138b90 0x7fbf60134d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:50.097 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.091+0000 7fbf5ffff700 1 -- 172.21.15.174:0/3949800658 >> v1:172.21.15.196:6789/0 conn(0x7fbf600a1fe0 legacy=0x7fbf60138480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:50.097 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.091+0000 7fbf5ffff700 1 -- 172.21.15.174:0/3949800658 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf600a2440 con 0x7fbf600a7a60 2020-04-02T23:21:50.097 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.091+0000 7fbf5ffff700 1 --2- 172.21.15.174:0/3949800658 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbf600a7a60 0x7fbf600a38f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbf50002f30 tx=0x7fbf50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:50.097 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.091+0000 7fbf5ffff700 1 --2- 172.21.15.174:0/3949800658 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbf600a7a60 0x7fbf600a38f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbf50002f30 tx=0x7fbf50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:50.098 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.091+0000 7fbf5ffff700 1 --2- 172.21.15.174:0/3949800658 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbf600a7a60 0x7fbf600a38f0 secure :-1 s=READY pgs=30 cs=0 l=1 rx=0x7fbf50002f30 tx=0x7fbf50007a40).ready entity=mon.2 client_cookie=8158990339eb1416 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:50.098 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.091+0000 7fbf5ffff700 1 --2- 172.21.15.174:0/3949800658 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbf600a7a60 0x7fbf600a38f0 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7fbf50002f30 tx=0x7fbf50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:50.098 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.092+0000 7fbf5ffff700 1 --2- 172.21.15.174:0/3949800658 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbf600a7a60 0x7fbf600a38f0 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7fbf50002f30 tx=0x7fbf50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:50.098 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.092+0000 7fbf5ffff700 1 --2- 172.21.15.174:0/3949800658 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbf600a7a60 0x7fbf600a38f0 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7fbf50002f30 tx=0x7fbf50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:50.098 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.092+0000 7fbf5effd700 1 -- 172.21.15.174:0/3949800658 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf50011670 con 0x7fbf600a7a60 2020-04-02T23:21:50.099 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.092+0000 7fbf5effd700 1 -- 172.21.15.174:0/3949800658 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf500117d0 con 0x7fbf600a7a60 2020-04-02T23:21:50.099 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.092+0000 7fbf5effd700 1 -- 172.21.15.174:0/3949800658 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf50011bf0 con 0x7fbf600a7a60 2020-04-02T23:21:50.099 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.092+0000 7fbf669f5700 1 -- 172.21.15.174:0/3949800658 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbf600a7a60 msgr2=0x7fbf600a38f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:50.099 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.092+0000 7fbf669f5700 1 --2- 172.21.15.174:0/3949800658 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbf600a7a60 0x7fbf600a38f0 secure :-1 s=READY pgs=30 cs=0 l=1 rx=0x7fbf50002f30 tx=0x7fbf50007a40).stop 2020-04-02T23:21:50.100 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.092+0000 7fbf669f5700 1 -- 172.21.15.174:0/3949800658 shutdown_connections 2020-04-02T23:21:50.100 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.092+0000 7fbf669f5700 1 --2- 172.21.15.174:0/3949800658 >> v2:172.21.15.196:3300/0 conn(0x7fbf60138b90 0x7fbf60134d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:50.100 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.092+0000 7fbf669f5700 1 --2- 172.21.15.174:0/3949800658 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbf600a7a60 0x7fbf600a38f0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:50.100 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.092+0000 7fbf669f5700 1 -- 172.21.15.174:0/3949800658 >> 172.21.15.174:0/3949800658 conn(0x7fbf600aaf80 msgr2=0x7fbf600a6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:50.100 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.092+0000 7fbf669f5700 1 -- 172.21.15.174:0/3949800658 shutdown_connections 2020-04-02T23:21:50.100 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.092+0000 7fbf669f5700 1 -- 172.21.15.174:0/3949800658 wait complete. 2020-04-02T23:21:50.101 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.093+0000 7fbf669f5700 1 Processor -- start 2020-04-02T23:21:50.101 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.093+0000 7fbf669f5700 1 -- start start 2020-04-02T23:21:50.104 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.094+0000 7fbf669f5700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbf600a1fe0 0x7fbf600670c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:50.105 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.094+0000 7fbf669f5700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fbf600a7a60 0x7fbf600a00c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:50.106 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.094+0000 7fbf669f5700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf600a0520 con 0x7fbf60138b90 2020-04-02T23:21:50.106 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.094+0000 7fbf669f5700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf6009ed50 con 0x7fbf600a7a60 2020-04-02T23:21:50.106 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.094+0000 7fbf669f5700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf600a08b0 con 0x7fbf600a1fe0 2020-04-02T23:21:50.106 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.094+0000 7fbf5ffff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbf600a1fe0 0x7fbf600670c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:50.106 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.094+0000 7fbf5f7fe700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fbf600a7a60 0x7fbf600a00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:50.106 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.094+0000 7fbf64f92700 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7fbf60138b90 0x7fbf60065b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.174:51174/0 (socket says 172.21.15.174:51174) 2020-04-02T23:21:50.106 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.094+0000 7fbf5ffff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbf600a1fe0 0x7fbf600670c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.174:34626/0 (socket says 172.21.15.174:34626) 2020-04-02T23:21:50.107 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.094+0000 7fbf64f92700 1 -- 172.21.15.174:0/2935937438 learned_addr learned my addr 172.21.15.174:0/2935937438 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:21:50.107 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.094+0000 7fbf5ffff700 1 -- 172.21.15.174:0/2935937438 >> v2:172.21.15.196:3300/0 conn(0x7fbf600a7a60 msgr2=0x7fbf600a00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:50.107 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.094+0000 7fbf5ffff700 1 --2- 172.21.15.174:0/2935937438 >> v2:172.21.15.196:3300/0 conn(0x7fbf600a7a60 0x7fbf600a00c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:50.107 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.094+0000 7fbf5ffff700 1 -- 172.21.15.174:0/2935937438 >> v1:172.21.15.196:6789/0 conn(0x7fbf60138b90 legacy=0x7fbf60065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:50.107 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.094+0000 7fbf5d7fa700 1 -- 172.21.15.174:0/2935937438 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1307888159 0 0) 0x7fbf600a0520 con 0x7fbf60138b90 2020-04-02T23:21:50.107 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.094+0000 7fbf5ffff700 1 -- 172.21.15.174:0/2935937438 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf600a0b50 con 0x7fbf600a1fe0 2020-04-02T23:21:50.107 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.094+0000 7fbf5f7fe700 1 --2- 172.21.15.174:0/2935937438 >> v2:172.21.15.196:3300/0 conn(0x7fbf600a7a60 0x7fbf600a00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:21:50.107 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.094+0000 7fbf5ffff700 1 --2- 172.21.15.174:0/2935937438 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbf600a1fe0 0x7fbf600670c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbf50002f30 tx=0x7fbf50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:50.108 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.094+0000 7fbf5ffff700 1 --2- 172.21.15.174:0/2935937438 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbf600a1fe0 0x7fbf600670c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbf50002f30 tx=0x7fbf50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:50.108 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.094+0000 7fbf5ffff700 1 --2- 172.21.15.174:0/2935937438 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbf600a1fe0 0x7fbf600670c0 secure :-1 s=READY pgs=31 cs=0 l=1 rx=0x7fbf50002f30 tx=0x7fbf50007a40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:50.108 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.095+0000 7fbf5ffff700 1 --2- 172.21.15.174:0/2935937438 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbf600a1fe0 0x7fbf600670c0 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7fbf50002f30 tx=0x7fbf50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:50.108 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.095+0000 7fbf5d7fa700 1 -- 172.21.15.174:0/2935937438 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf50011e60 con 0x7fbf600a1fe0 2020-04-02T23:21:50.108 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.095+0000 7fbf5ffff700 1 --2- 172.21.15.174:0/2935937438 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbf600a1fe0 0x7fbf600670c0 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7fbf50002f30 tx=0x7fbf50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:50.109 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.095+0000 7fbf5d7fa700 1 -- 172.21.15.174:0/2935937438 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf50011c70 con 0x7fbf600a1fe0 2020-04-02T23:21:50.109 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.095+0000 7fbf5ffff700 1 --2- 172.21.15.174:0/2935937438 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbf600a1fe0 0x7fbf600670c0 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7fbf50002f30 tx=0x7fbf50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:50.109 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.095+0000 7fbf669f5700 1 -- 172.21.15.174:0/2935937438 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf600a8590 con 0x7fbf600a1fe0 2020-04-02T23:21:50.109 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.095+0000 7fbf5d7fa700 1 -- 172.21.15.174:0/2935937438 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf50007530 con 0x7fbf600a1fe0 2020-04-02T23:21:50.109 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.095+0000 7fbf669f5700 1 -- 172.21.15.174:0/2935937438 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf60066450 con 0x7fbf600a1fe0 2020-04-02T23:21:50.109 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.095+0000 7fbf5ffff700 1 --2- 172.21.15.174:0/2935937438 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbf600a1fe0 0x7fbf600670c0 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7fbf50002f30 tx=0x7fbf50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:50.109 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.095+0000 7fbf669f5700 1 -- 172.21.15.174:0/2935937438 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf6009f980 con 0x7fbf600a1fe0 2020-04-02T23:21:50.110 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.096+0000 7fbf5d7fa700 1 -- 172.21.15.174:0/2935937438 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fbf500056c0 con 0x7fbf600a1fe0 2020-04-02T23:21:50.110 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.096+0000 7fbf5ffff700 1 --2- 172.21.15.174:0/2935937438 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbf600a1fe0 0x7fbf600670c0 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7fbf50002f30 tx=0x7fbf50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:50.110 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.096+0000 7fbf5d7fa700 1 --2- 172.21.15.174:0/2935937438 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fbf4004d3e0 0x7fbf4004f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:50.110 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.096+0000 7fbf5d7fa700 1 -- 172.21.15.174:0/2935937438 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fbf50061330 con 0x7fbf600a1fe0 2020-04-02T23:21:50.110 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.096+0000 7fbf5f7fe700 1 --2- 172.21.15.174:0/2935937438 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fbf4004d3e0 0x7fbf4004f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:50.110 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.096+0000 7fbf5f7fe700 1 --2- 172.21.15.174:0/2935937438 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fbf4004d3e0 0x7fbf4004f8a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbf600a3d50 tx=0x7fbf54001950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:50.110 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.096+0000 7fbf5f7fe700 1 --2- 172.21.15.174:0/2935937438 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fbf4004d3e0 0x7fbf4004f8a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbf600a3d50 tx=0x7fbf54001950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:50.111 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.096+0000 7fbf5f7fe700 1 --2- 172.21.15.174:0/2935937438 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fbf4004d3e0 0x7fbf4004f8a0 secure :-1 s=READY pgs=81 cs=0 l=1 rx=0x7fbf600a3d50 tx=0x7fbf54001950).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:50.111 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.099+0000 7fbf5ffff700 1 --2- 172.21.15.174:0/2935937438 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbf600a1fe0 0x7fbf600670c0 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7fbf50002f30 tx=0x7fbf50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:50.111 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.099+0000 7fbf5d7fa700 1 -- 172.21.15.174:0/2935937438 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fbf5003cad0 con 0x7fbf600a1fe0 2020-04-02T23:21:50.239 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.236+0000 7fbf669f5700 1 -- 172.21.15.174:0/2935937438 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbf60056c50 con 0x7fbf600a1fe0 2020-04-02T23:21:50.239 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.237+0000 7fbf5ffff700 1 --2- 172.21.15.174:0/2935937438 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbf600a1fe0 0x7fbf600670c0 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7fbf50002f30 tx=0x7fbf50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:50.240 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.237+0000 7fbf5d7fa700 1 -- 172.21.15.174:0/2935937438 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbf500400f0 con 0x7fbf600a1fe0 2020-04-02T23:21:50.240 INFO:teuthology.orchestra.run.smithi174.stdout:60129542149 2020-04-02T23:21:50.241 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.238+0000 7fbf669f5700 1 -- 172.21.15.174:0/2935937438 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fbf4004d3e0 msgr2=0x7fbf4004f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:50.241 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.238+0000 7fbf669f5700 1 --2- 172.21.15.174:0/2935937438 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fbf4004d3e0 0x7fbf4004f8a0 secure :-1 s=READY pgs=81 cs=0 l=1 rx=0x7fbf600a3d50 tx=0x7fbf54001950).stop 2020-04-02T23:21:50.241 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.238+0000 7fbf669f5700 1 -- 172.21.15.174:0/2935937438 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbf600a1fe0 msgr2=0x7fbf600670c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:50.241 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.238+0000 7fbf669f5700 1 --2- 172.21.15.174:0/2935937438 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbf600a1fe0 0x7fbf600670c0 secure :-1 s=READY pgs=31 cs=0 l=1 rx=0x7fbf50002f30 tx=0x7fbf50007a40).stop 2020-04-02T23:21:50.242 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.238+0000 7fbf669f5700 1 -- 172.21.15.174:0/2935937438 shutdown_connections 2020-04-02T23:21:50.242 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.238+0000 7fbf669f5700 1 --2- 172.21.15.174:0/2935937438 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fbf4004d3e0 0x7fbf4004f8a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:50.242 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.238+0000 7fbf669f5700 1 --2- 172.21.15.174:0/2935937438 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbf600a1fe0 0x7fbf600670c0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:50.242 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.238+0000 7fbf669f5700 1 --2- 172.21.15.174:0/2935937438 >> v2:172.21.15.196:3300/0 conn(0x7fbf600a7a60 0x7fbf600a00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:50.242 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.238+0000 7fbf669f5700 1 -- 172.21.15.174:0/2935937438 >> 172.21.15.174:0/2935937438 conn(0x7fbf600aaf80 msgr2=0x7fbf60137900 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:50.242 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.238+0000 7fbf669f5700 1 -- 172.21.15.174:0/2935937438 shutdown_connections 2020-04-02T23:21:50.242 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.238+0000 7fbf669f5700 1 -- 172.21.15.174:0/2935937438 wait complete. 2020-04-02T23:21:50.251 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.3 2020-04-02T23:21:50.251 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:50.264 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.4 2020-04-02T23:21:50.410 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.407+0000 7f2927b3d700 1 Processor -- start 2020-04-02T23:21:50.410 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.408+0000 7f2927b3d700 1 -- start start 2020-04-02T23:21:50.416 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.408+0000 7f2927b3d700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f29200a5900 0x7f2920135030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:50.416 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.408+0000 7f2927b3d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f292012e970 0x7f292013ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:50.417 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.408+0000 7f2927b3d700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2920134420 con 0x7f292005ac00 2020-04-02T23:21:50.417 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.408+0000 7f2927b3d700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29200a49d0 con 0x7f292012e970 2020-04-02T23:21:50.417 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.408+0000 7f2927b3d700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f292005b080 con 0x7f29200a5900 2020-04-02T23:21:50.417 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.408+0000 7f29260da700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f292012e970 0x7f292013ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:50.417 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.409+0000 7f29260da700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f292012e970 0x7f292013ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:40048/0 (socket says 172.21.15.174:40048) 2020-04-02T23:21:50.418 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.409+0000 7f29260da700 1 -- 172.21.15.174:0/3114341091 learned_addr learned my addr 172.21.15.174:0/3114341091 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:21:50.418 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.409+0000 7f29258d9700 1 --2- 172.21.15.174:0/3114341091 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f29200a5900 0x7f2920135030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:50.418 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.409+0000 7f29260da700 1 -- 172.21.15.174:0/3114341091 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f29200a5900 msgr2=0x7f2920135030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:50.418 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.409+0000 7f29260da700 1 --2- 172.21.15.174:0/3114341091 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f29200a5900 0x7f2920135030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:50.418 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.409+0000 7f29260da700 1 -- 172.21.15.174:0/3114341091 >> v1:172.21.15.196:6789/0 conn(0x7f292005ac00 legacy=0x7f292012e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:50.418 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.409+0000 7f29260da700 1 -- 172.21.15.174:0/3114341091 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2920134650 con 0x7f292012e970 2020-04-02T23:21:50.418 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.409+0000 7f29258d9700 1 --2- 172.21.15.174:0/3114341091 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f29200a5900 0x7f2920135030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-02T23:21:50.419 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.409+0000 7f29260da700 1 --2- 172.21.15.174:0/3114341091 >> v2:172.21.15.174:3300/0 conn(0x7f292012e970 0x7f292013ed90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f292005ed20 tx=0x7f2918007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:50.419 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.409+0000 7f29260da700 1 --2- 172.21.15.174:0/3114341091 >> v2:172.21.15.174:3300/0 conn(0x7f292012e970 0x7f292013ed90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f292005ed20 tx=0x7f2918007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:50.419 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.409+0000 7f29260da700 1 --2- 172.21.15.174:0/3114341091 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f292012e970 0x7f292013ed90 secure :-1 s=READY pgs=145 cs=0 l=1 rx=0x7f292005ed20 tx=0x7f2918007dc0).ready entity=mon.0 client_cookie=f3f492972bb97105 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:50.419 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.409+0000 7f29260da700 1 --2- 172.21.15.174:0/3114341091 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f292012e970 0x7f292013ed90 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7f292005ed20 tx=0x7f2918007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:50.419 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.409+0000 7f29248d7700 1 -- 172.21.15.174:0/3114341091 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f291800a160 con 0x7f292012e970 2020-04-02T23:21:50.419 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.409+0000 7f29260da700 1 --2- 172.21.15.174:0/3114341091 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f292012e970 0x7f292013ed90 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7f292005ed20 tx=0x7f2918007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:50.419 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.409+0000 7f29260da700 1 --2- 172.21.15.174:0/3114341091 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f292012e970 0x7f292013ed90 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7f292005ed20 tx=0x7f2918007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:50.420 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.409+0000 7f29248d7700 1 -- 172.21.15.174:0/3114341091 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f291800a2c0 con 0x7f292012e970 2020-04-02T23:21:50.420 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.409+0000 7f29248d7700 1 -- 172.21.15.174:0/3114341091 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f291800a6e0 con 0x7f292012e970 2020-04-02T23:21:50.420 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.409+0000 7f2927b3d700 1 -- 172.21.15.174:0/3114341091 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f292012e970 msgr2=0x7f292013ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:50.420 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.409+0000 7f2927b3d700 1 --2- 172.21.15.174:0/3114341091 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f292012e970 0x7f292013ed90 secure :-1 s=READY pgs=145 cs=0 l=1 rx=0x7f292005ed20 tx=0x7f2918007dc0).stop 2020-04-02T23:21:50.420 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.410+0000 7f2927b3d700 1 -- 172.21.15.174:0/3114341091 shutdown_connections 2020-04-02T23:21:50.420 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.410+0000 7f2927b3d700 1 --2- 172.21.15.174:0/3114341091 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f292012e970 0x7f292013ed90 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:50.421 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.410+0000 7f2927b3d700 1 --2- 172.21.15.174:0/3114341091 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f29200a5900 0x7f2920135030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:50.421 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.410+0000 7f2927b3d700 1 -- 172.21.15.174:0/3114341091 >> 172.21.15.174:0/3114341091 conn(0x7f29200aaf80 msgr2=0x7f29200a6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:50.421 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.410+0000 7f2927b3d700 1 -- 172.21.15.174:0/3114341091 shutdown_connections 2020-04-02T23:21:50.421 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.410+0000 7f2927b3d700 1 -- 172.21.15.174:0/3114341091 wait complete. 2020-04-02T23:21:50.421 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.410+0000 7f2927b3d700 1 Processor -- start 2020-04-02T23:21:50.421 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.410+0000 7f2927b3d700 1 -- start start 2020-04-02T23:21:50.421 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.411+0000 7f2927b3d700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f29200a5900 0x7f29201277f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:50.422 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.411+0000 7f2927b3d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f292009fc80 0x7f2920127c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:50.422 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.411+0000 7f2927b3d700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2920137910 con 0x7f292005ac00 2020-04-02T23:21:50.422 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.411+0000 7f2927b3d700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f292012f030 con 0x7f292009fc80 2020-04-02T23:21:50.422 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.411+0000 7f2927b3d700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29201280b0 con 0x7f29200a5900 2020-04-02T23:21:50.422 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.411+0000 7f29260da700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f292009fc80 0x7f2920127c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:50.422 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.411+0000 7f29260da700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f292009fc80 0x7f2920127c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:40056/0 (socket says 172.21.15.174:40056) 2020-04-02T23:21:50.422 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.411+0000 7f29260da700 1 -- 172.21.15.174:0/2482934482 learned_addr learned my addr 172.21.15.174:0/2482934482 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:21:50.423 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.411+0000 7f29250d8700 1 --2- 172.21.15.174:0/2482934482 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f29200a5900 0x7f29201277f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:50.423 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.411+0000 7f29260da700 1 -- 172.21.15.174:0/2482934482 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f29200a5900 msgr2=0x7f29201277f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:50.423 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.411+0000 7f29260da700 1 --2- 172.21.15.174:0/2482934482 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f29200a5900 0x7f29201277f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:50.423 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.411+0000 7f29260da700 1 -- 172.21.15.174:0/2482934482 >> v1:172.21.15.196:6789/0 conn(0x7f292005ac00 legacy=0x7f292012fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:50.423 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.411+0000 7f29260da700 1 -- 172.21.15.174:0/2482934482 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2920130430 con 0x7f292009fc80 2020-04-02T23:21:50.423 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.411+0000 7f29260da700 1 --2- 172.21.15.174:0/2482934482 >> v2:172.21.15.174:3300/0 conn(0x7f292009fc80 0x7f2920127c50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f292005ed20 tx=0x7f2918007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:50.423 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.411+0000 7f29260da700 1 --2- 172.21.15.174:0/2482934482 >> v2:172.21.15.174:3300/0 conn(0x7f292009fc80 0x7f2920127c50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f292005ed20 tx=0x7f2918007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:50.423 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.411+0000 7f29260da700 1 --2- 172.21.15.174:0/2482934482 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f292009fc80 0x7f2920127c50 secure :-1 s=READY pgs=146 cs=0 l=1 rx=0x7f292005ed20 tx=0x7f2918007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:50.424 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.412+0000 7f29260da700 1 --2- 172.21.15.174:0/2482934482 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f292009fc80 0x7f2920127c50 secure :-1 s=THROTTLE_DONE pgs=146 cs=0 l=1 rx=0x7f292005ed20 tx=0x7f2918007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:50.424 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.412+0000 7f290effd700 1 -- 172.21.15.174:0/2482934482 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2918005c30 con 0x7f292009fc80 2020-04-02T23:21:50.424 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.412+0000 7f29260da700 1 --2- 172.21.15.174:0/2482934482 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f292009fc80 0x7f2920127c50 secure :-1 s=THROTTLE_DONE pgs=146 cs=0 l=1 rx=0x7f292005ed20 tx=0x7f2918007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:50.424 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.412+0000 7f29260da700 1 --2- 172.21.15.174:0/2482934482 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f292009fc80 0x7f2920127c50 secure :-1 s=THROTTLE_DONE pgs=146 cs=0 l=1 rx=0x7f292005ed20 tx=0x7f2918007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:50.424 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.412+0000 7f290effd700 1 -- 172.21.15.174:0/2482934482 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2918005d90 con 0x7f292009fc80 2020-04-02T23:21:50.424 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.412+0000 7f2927b3d700 1 -- 172.21.15.174:0/2482934482 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29200a0260 con 0x7f292009fc80 2020-04-02T23:21:50.424 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.412+0000 7f290effd700 1 -- 172.21.15.174:0/2482934482 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f291800f760 con 0x7f292009fc80 2020-04-02T23:21:50.425 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.412+0000 7f2927b3d700 1 -- 172.21.15.174:0/2482934482 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2920137de0 con 0x7f292009fc80 2020-04-02T23:21:50.425 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.412+0000 7f29260da700 1 --2- 172.21.15.174:0/2482934482 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f292009fc80 0x7f2920127c50 secure :-1 s=THROTTLE_DONE pgs=146 cs=0 l=1 rx=0x7f292005ed20 tx=0x7f2918007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:50.425 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.413+0000 7f290effd700 1 -- 172.21.15.174:0/2482934482 <== mon.0 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f291800f990 con 0x7f292009fc80 2020-04-02T23:21:50.425 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.413+0000 7f29260da700 1 --2- 172.21.15.174:0/2482934482 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f292009fc80 0x7f2920127c50 secure :-1 s=THROTTLE_DONE pgs=146 cs=0 l=1 rx=0x7f292005ed20 tx=0x7f2918007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:50.425 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.413+0000 7f2927b3d700 1 -- 172.21.15.174:0/2482934482 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2920137fa0 con 0x7f292009fc80 2020-04-02T23:21:50.425 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.413+0000 7f290effd700 1 --2- 172.21.15.174:0/2482934482 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f290004d570 0x7f290004fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:50.425 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.413+0000 7f290effd700 1 -- 172.21.15.174:0/2482934482 <== mon.0 v2:172.21.15.174:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2918061dd0 con 0x7f292009fc80 2020-04-02T23:21:50.426 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.413+0000 7f29258d9700 1 --2- 172.21.15.174:0/2482934482 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f290004d570 0x7f290004fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:50.426 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.413+0000 7f29258d9700 1 --2- 172.21.15.174:0/2482934482 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f290004d570 0x7f290004fa30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2920133760 tx=0x7f29100011f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:50.426 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.413+0000 7f29258d9700 1 --2- 172.21.15.174:0/2482934482 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f290004d570 0x7f290004fa30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2920133760 tx=0x7f29100011f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:50.426 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.413+0000 7f29258d9700 1 --2- 172.21.15.174:0/2482934482 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f290004d570 0x7f290004fa30 secure :-1 s=READY pgs=82 cs=0 l=1 rx=0x7f2920133760 tx=0x7f29100011f0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:50.427 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.416+0000 7f29260da700 1 --2- 172.21.15.174:0/2482934482 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f292009fc80 0x7f2920127c50 secure :-1 s=THROTTLE_DONE pgs=146 cs=0 l=1 rx=0x7f292005ed20 tx=0x7f2918007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:50.427 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.416+0000 7f290effd700 1 -- 172.21.15.174:0/2482934482 <== mon.0 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f291803d5f0 con 0x7f292009fc80 2020-04-02T23:21:50.554 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.552+0000 7f2927b3d700 1 -- 172.21.15.174:0/2482934482 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f2920056c50 con 0x7f292009fc80 2020-04-02T23:21:50.555 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.552+0000 7f29260da700 1 --2- 172.21.15.174:0/2482934482 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f292009fc80 0x7f2920127c50 secure :-1 s=THROTTLE_DONE pgs=146 cs=0 l=1 rx=0x7f292005ed20 tx=0x7f2918007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:50.555 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.552+0000 7f290effd700 1 -- 172.21.15.174:0/2482934482 <== mon.0 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2918040c10 con 0x7f292009fc80 2020-04-02T23:21:50.555 INFO:teuthology.orchestra.run.smithi174.stdout:60129542150 2020-04-02T23:21:50.556 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.553+0000 7f2927b3d700 1 -- 172.21.15.174:0/2482934482 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f290004d570 msgr2=0x7f290004fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:50.556 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.553+0000 7f2927b3d700 1 --2- 172.21.15.174:0/2482934482 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f290004d570 0x7f290004fa30 secure :-1 s=READY pgs=82 cs=0 l=1 rx=0x7f2920133760 tx=0x7f29100011f0).stop 2020-04-02T23:21:50.556 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.553+0000 7f2927b3d700 1 -- 172.21.15.174:0/2482934482 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f292009fc80 msgr2=0x7f2920127c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:50.556 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.553+0000 7f2927b3d700 1 --2- 172.21.15.174:0/2482934482 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f292009fc80 0x7f2920127c50 secure :-1 s=READY pgs=146 cs=0 l=1 rx=0x7f292005ed20 tx=0x7f2918007dc0).stop 2020-04-02T23:21:50.557 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.553+0000 7f2927b3d700 1 -- 172.21.15.174:0/2482934482 shutdown_connections 2020-04-02T23:21:50.557 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.553+0000 7f2927b3d700 1 --2- 172.21.15.174:0/2482934482 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f290004d570 0x7f290004fa30 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:50.557 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.553+0000 7f2927b3d700 1 --2- 172.21.15.174:0/2482934482 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f292009fc80 0x7f2920127c50 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:50.557 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.553+0000 7f2927b3d700 1 --2- 172.21.15.174:0/2482934482 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f29200a5900 0x7f29201277f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:50.557 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.553+0000 7f2927b3d700 1 -- 172.21.15.174:0/2482934482 >> 172.21.15.174:0/2482934482 conn(0x7f29200aaf80 msgr2=0x7f29200a79c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:50.557 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.553+0000 7f2927b3d700 1 -- 172.21.15.174:0/2482934482 shutdown_connections 2020-04-02T23:21:50.557 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.553+0000 7f2927b3d700 1 -- 172.21.15.174:0/2482934482 wait complete. 2020-04-02T23:21:50.566 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.4 2020-04-02T23:21:50.566 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:50.580 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.5 2020-04-02T23:21:50.726 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.723+0000 7fd444014700 1 Processor -- start 2020-04-02T23:21:50.726 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.723+0000 7fd444014700 1 -- start start 2020-04-02T23:21:50.736 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.724+0000 7fd444014700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd43c0a7a60 0x7fd43c0a38f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:50.736 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.724+0000 7fd444014700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd43c138b90 0x7fd43c134d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:50.737 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.724+0000 7fd444014700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd43c0a40d0 con 0x7fd43c0a1fe0 2020-04-02T23:21:50.737 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.724+0000 7fd444014700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd43c0a3ef0 con 0x7fd43c138b90 2020-04-02T23:21:50.737 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.724+0000 7fd444014700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd43c0a4370 con 0x7fd43c0a7a60 2020-04-02T23:21:50.737 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.724+0000 7fd4425b1700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd43c138b90 0x7fd43c134d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:50.737 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.724+0000 7fd4415af700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fd43c0a1fe0 0x7fd43c138480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:45098/0 (socket says 172.21.15.174:45098) 2020-04-02T23:21:50.737 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.724+0000 7fd4425b1700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd43c138b90 0x7fd43c134d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:40062/0 (socket says 172.21.15.174:40062) 2020-04-02T23:21:50.738 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.724+0000 7fd4415af700 1 -- 172.21.15.174:0/959721061 learned_addr learned my addr 172.21.15.174:0/959721061 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:21:50.738 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.724+0000 7fd441db0700 1 --2- 172.21.15.174:0/959721061 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd43c0a7a60 0x7fd43c0a38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:50.738 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.725+0000 7fd4425b1700 1 -- 172.21.15.174:0/959721061 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd43c0a7a60 msgr2=0x7fd43c0a38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:50.738 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.725+0000 7fd4425b1700 1 --2- 172.21.15.174:0/959721061 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd43c0a7a60 0x7fd43c0a38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:50.738 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.725+0000 7fd4425b1700 1 -- 172.21.15.174:0/959721061 >> v1:172.21.15.174:6789/0 conn(0x7fd43c0a1fe0 legacy=0x7fd43c138480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:50.738 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.725+0000 7fd4425b1700 1 -- 172.21.15.174:0/959721061 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd43c0a2440 con 0x7fd43c138b90 2020-04-02T23:21:50.738 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.725+0000 7fd440dae700 1 -- 172.21.15.174:0/959721061 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2713938220 0 0) 0x7fd43c0a40d0 con 0x7fd43c0a1fe0 2020-04-02T23:21:50.738 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.725+0000 7fd4425b1700 1 --2- 172.21.15.174:0/959721061 >> v2:172.21.15.174:3300/0 conn(0x7fd43c138b90 0x7fd43c134d60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd4340032b0 tx=0x7fd434007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:50.739 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.725+0000 7fd4425b1700 1 --2- 172.21.15.174:0/959721061 >> v2:172.21.15.174:3300/0 conn(0x7fd43c138b90 0x7fd43c134d60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd4340032b0 tx=0x7fd434007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:50.739 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.725+0000 7fd4425b1700 1 --2- 172.21.15.174:0/959721061 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd43c138b90 0x7fd43c134d60 secure :-1 s=READY pgs=148 cs=0 l=1 rx=0x7fd4340032b0 tx=0x7fd434007dc0).ready entity=mon.0 client_cookie=e6f46a4cd50f9ea6 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:50.739 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.725+0000 7fd4425b1700 1 --2- 172.21.15.174:0/959721061 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd43c138b90 0x7fd43c134d60 secure :-1 s=THROTTLE_DONE pgs=148 cs=0 l=1 rx=0x7fd4340032b0 tx=0x7fd434007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:50.739 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.725+0000 7fd440dae700 1 -- 172.21.15.174:0/959721061 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd43400a160 con 0x7fd43c138b90 2020-04-02T23:21:50.739 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.725+0000 7fd4425b1700 1 --2- 172.21.15.174:0/959721061 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd43c138b90 0x7fd43c134d60 secure :-1 s=THROTTLE_DONE pgs=148 cs=0 l=1 rx=0x7fd4340032b0 tx=0x7fd434007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:50.740 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.725+0000 7fd4425b1700 1 --2- 172.21.15.174:0/959721061 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd43c138b90 0x7fd43c134d60 secure :-1 s=THROTTLE_DONE pgs=148 cs=0 l=1 rx=0x7fd4340032b0 tx=0x7fd434007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:50.740 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.725+0000 7fd440dae700 1 -- 172.21.15.174:0/959721061 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd43400a2c0 con 0x7fd43c138b90 2020-04-02T23:21:50.740 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.725+0000 7fd440dae700 1 -- 172.21.15.174:0/959721061 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd43400a6a0 con 0x7fd43c138b90 2020-04-02T23:21:50.740 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.725+0000 7fd444014700 1 -- 172.21.15.174:0/959721061 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd43c138b90 msgr2=0x7fd43c134d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:50.740 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.725+0000 7fd444014700 1 --2- 172.21.15.174:0/959721061 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd43c138b90 0x7fd43c134d60 secure :-1 s=READY pgs=148 cs=0 l=1 rx=0x7fd4340032b0 tx=0x7fd434007dc0).stop 2020-04-02T23:21:50.740 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.725+0000 7fd444014700 1 -- 172.21.15.174:0/959721061 shutdown_connections 2020-04-02T23:21:50.741 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.725+0000 7fd444014700 1 --2- 172.21.15.174:0/959721061 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd43c138b90 0x7fd43c134d60 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:50.741 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.725+0000 7fd444014700 1 --2- 172.21.15.174:0/959721061 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd43c0a7a60 0x7fd43c0a38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:50.741 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.725+0000 7fd444014700 1 -- 172.21.15.174:0/959721061 >> 172.21.15.174:0/959721061 conn(0x7fd43c0aaf80 msgr2=0x7fd43c0a6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:50.741 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.725+0000 7fd444014700 1 -- 172.21.15.174:0/959721061 shutdown_connections 2020-04-02T23:21:50.741 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.725+0000 7fd444014700 1 -- 172.21.15.174:0/959721061 wait complete. 2020-04-02T23:21:50.741 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.726+0000 7fd444014700 1 Processor -- start 2020-04-02T23:21:50.741 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.726+0000 7fd444014700 1 -- start start 2020-04-02T23:21:50.742 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.727+0000 7fd444014700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd43c0a7a60 0x7fd43c12b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:50.742 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.727+0000 7fd444014700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd43c138b90 0x7fd43c12bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:50.742 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.727+0000 7fd444014700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd43c135ef0 con 0x7fd43c0a1fe0 2020-04-02T23:21:50.742 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.727+0000 7fd444014700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd43c134200 con 0x7fd43c138b90 2020-04-02T23:21:50.742 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.727+0000 7fd444014700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd43c1359d0 con 0x7fd43c0a7a60 2020-04-02T23:21:50.742 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.727+0000 7fd441db0700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fd43c0a1fe0 0x7fd43c132df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:45102/0 (socket says 172.21.15.174:45102) 2020-04-02T23:21:50.743 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.727+0000 7fd441db0700 1 -- 172.21.15.174:0/4205225922 learned_addr learned my addr 172.21.15.174:0/4205225922 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:21:50.743 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.727+0000 7fd4425b1700 1 --2- 172.21.15.174:0/4205225922 >> v2:172.21.15.174:3300/0 conn(0x7fd43c138b90 0x7fd43c12bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:50.743 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.727+0000 7fd4415af700 1 --2- 172.21.15.174:0/4205225922 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd43c0a7a60 0x7fd43c12b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:50.743 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.727+0000 7fd4425b1700 1 -- 172.21.15.174:0/4205225922 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd43c0a7a60 msgr2=0x7fd43c12b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:50.744 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.727+0000 7fd4425b1700 1 --2- 172.21.15.174:0/4205225922 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd43c0a7a60 0x7fd43c12b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:50.744 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.727+0000 7fd4425b1700 1 -- 172.21.15.174:0/4205225922 >> v1:172.21.15.174:6789/0 conn(0x7fd43c0a1fe0 legacy=0x7fd43c132df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:50.744 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.727+0000 7fd42affd700 1 -- 172.21.15.174:0/4205225922 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4230651999 0 0) 0x7fd43c135ef0 con 0x7fd43c0a1fe0 2020-04-02T23:21:50.744 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.727+0000 7fd4425b1700 1 -- 172.21.15.174:0/4205225922 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd43c133b30 con 0x7fd43c138b90 2020-04-02T23:21:50.744 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.727+0000 7fd4425b1700 1 --2- 172.21.15.174:0/4205225922 >> v2:172.21.15.174:3300/0 conn(0x7fd43c138b90 0x7fd43c12bbe0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd4340032b0 tx=0x7fd434007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:50.745 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.727+0000 7fd4425b1700 1 --2- 172.21.15.174:0/4205225922 >> v2:172.21.15.174:3300/0 conn(0x7fd43c138b90 0x7fd43c12bbe0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd4340032b0 tx=0x7fd434007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:50.745 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.727+0000 7fd4425b1700 1 --2- 172.21.15.174:0/4205225922 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd43c138b90 0x7fd43c12bbe0 secure :-1 s=READY pgs=150 cs=0 l=1 rx=0x7fd4340032b0 tx=0x7fd434007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:50.745 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.727+0000 7fd4425b1700 1 --2- 172.21.15.174:0/4205225922 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd43c138b90 0x7fd43c12bbe0 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7fd4340032b0 tx=0x7fd434007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:50.745 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.727+0000 7fd42affd700 1 -- 172.21.15.174:0/4205225922 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd434008a90 con 0x7fd43c138b90 2020-04-02T23:21:50.746 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.727+0000 7fd4425b1700 1 --2- 172.21.15.174:0/4205225922 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd43c138b90 0x7fd43c12bbe0 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7fd4340032b0 tx=0x7fd434007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:50.746 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.728+0000 7fd4425b1700 1 --2- 172.21.15.174:0/4205225922 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd43c138b90 0x7fd43c12bbe0 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7fd4340032b0 tx=0x7fd434007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:50.746 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.728+0000 7fd42affd700 1 -- 172.21.15.174:0/4205225922 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd434005c30 con 0x7fd43c138b90 2020-04-02T23:21:50.746 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.728+0000 7fd444014700 1 -- 172.21.15.174:0/4205225922 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd43c133d60 con 0x7fd43c138b90 2020-04-02T23:21:50.746 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.728+0000 7fd42affd700 1 -- 172.21.15.174:0/4205225922 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd43400f570 con 0x7fd43c138b90 2020-04-02T23:21:50.747 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.728+0000 7fd444014700 1 -- 172.21.15.174:0/4205225922 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd43c12c0a0 con 0x7fd43c138b90 2020-04-02T23:21:50.747 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.728+0000 7fd4425b1700 1 --2- 172.21.15.174:0/4205225922 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd43c138b90 0x7fd43c12bbe0 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7fd4340032b0 tx=0x7fd434007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:50.747 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.729+0000 7fd42affd700 1 -- 172.21.15.174:0/4205225922 <== mon.0 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fd43400f7a0 con 0x7fd43c138b90 2020-04-02T23:21:50.747 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.729+0000 7fd4425b1700 1 --2- 172.21.15.174:0/4205225922 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd43c138b90 0x7fd43c12bbe0 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7fd4340032b0 tx=0x7fd434007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:50.747 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.729+0000 7fd444014700 1 -- 172.21.15.174:0/4205225922 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd43c056c50 con 0x7fd43c138b90 2020-04-02T23:21:50.748 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.729+0000 7fd42affd700 1 --2- 172.21.15.174:0/4205225922 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fd41c04d3e0 0x7fd41c04f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:50.748 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.729+0000 7fd42affd700 1 -- 172.21.15.174:0/4205225922 <== mon.0 v2:172.21.15.174:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd434061b70 con 0x7fd43c138b90 2020-04-02T23:21:50.748 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.729+0000 7fd441db0700 1 --2- 172.21.15.174:0/4205225922 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fd41c04d3e0 0x7fd41c04f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:50.748 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.729+0000 7fd441db0700 1 --2- 172.21.15.174:0/4205225922 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fd41c04d3e0 0x7fd41c04f8a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd42c007a40 tx=0x7fd42c002360).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:50.748 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.729+0000 7fd441db0700 1 --2- 172.21.15.174:0/4205225922 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fd41c04d3e0 0x7fd41c04f8a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd42c007a40 tx=0x7fd42c002360).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:50.748 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.729+0000 7fd441db0700 1 --2- 172.21.15.174:0/4205225922 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fd41c04d3e0 0x7fd41c04f8a0 secure :-1 s=READY pgs=83 cs=0 l=1 rx=0x7fd42c007a40 tx=0x7fd42c002360).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:50.748 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.732+0000 7fd4425b1700 1 --2- 172.21.15.174:0/4205225922 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd43c138b90 0x7fd43c12bbe0 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7fd4340032b0 tx=0x7fd434007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:50.749 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.732+0000 7fd42affd700 1 -- 172.21.15.174:0/4205225922 <== mon.0 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fd43403d390 con 0x7fd43c138b90 2020-04-02T23:21:50.877 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.870+0000 7fd444014700 1 -- 172.21.15.174:0/4205225922 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fd43c12c040 con 0x7fd43c138b90 2020-04-02T23:21:50.877 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.871+0000 7fd4425b1700 1 --2- 172.21.15.174:0/4205225922 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd43c138b90 0x7fd43c12bbe0 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7fd4340032b0 tx=0x7fd434007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:50.878 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.871+0000 7fd42affd700 1 -- 172.21.15.174:0/4205225922 <== mon.0 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd4340409b0 con 0x7fd43c138b90 2020-04-02T23:21:50.878 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.872+0000 7fd444014700 1 -- 172.21.15.174:0/4205225922 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fd41c04d3e0 msgr2=0x7fd41c04f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:50.878 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.872+0000 7fd444014700 1 --2- 172.21.15.174:0/4205225922 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fd41c04d3e0 0x7fd41c04f8a0 secure :-1 s=READY pgs=83 cs=0 l=1 rx=0x7fd42c007a40 tx=0x7fd42c002360).stop 2020-04-02T23:21:50.878 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.872+0000 7fd444014700 1 -- 172.21.15.174:0/4205225922 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd43c138b90 msgr2=0x7fd43c12bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:50.878 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.872+0000 7fd444014700 1 --2- 172.21.15.174:0/4205225922 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd43c138b90 0x7fd43c12bbe0 secure :-1 s=READY pgs=150 cs=0 l=1 rx=0x7fd4340032b0 tx=0x7fd434007dc0).stop 2020-04-02T23:21:50.879 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.872+0000 7fd444014700 1 -- 172.21.15.174:0/4205225922 shutdown_connections 2020-04-02T23:21:50.879 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.872+0000 7fd444014700 1 --2- 172.21.15.174:0/4205225922 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fd41c04d3e0 0x7fd41c04f8a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:50.879 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.872+0000 7fd444014700 1 --2- 172.21.15.174:0/4205225922 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd43c138b90 0x7fd43c12bbe0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:50.879 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.872+0000 7fd444014700 1 --2- 172.21.15.174:0/4205225922 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd43c0a7a60 0x7fd43c12b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:50.879 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.872+0000 7fd444014700 1 -- 172.21.15.174:0/4205225922 >> 172.21.15.174:0/4205225922 conn(0x7fd43c0aaf80 msgr2=0x7fd43c0a8350 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:50.880 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.872+0000 7fd444014700 1 -- 172.21.15.174:0/4205225922 shutdown_connections 2020-04-02T23:21:50.880 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:50.872+0000 7fd444014700 1 -- 172.21.15.174:0/4205225922 wait complete. 2020-04-02T23:21:50.880 INFO:teuthology.orchestra.run.smithi174.stdout:60129542150 2020-04-02T23:21:50.885 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.5 2020-04-02T23:21:50.885 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:50.900 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.6 2020-04-02T23:21:51.047 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.045+0000 7fe98a1b4700 1 Processor -- start 2020-04-02T23:21:51.048 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.045+0000 7fe98a1b4700 1 -- start start 2020-04-02T23:21:51.056 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.046+0000 7fe98a1b4700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe98405bf90 0x7fe9840a4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:51.056 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.046+0000 7fe98a1b4700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fe9840a6fe0 0x7fe984139560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:51.056 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.046+0000 7fe98a1b4700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9840a5a60 con 0x7fe9840a7440 2020-04-02T23:21:51.057 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.046+0000 7fe98a1b4700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9840a47c0 con 0x7fe98405bf90 2020-04-02T23:21:51.057 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.046+0000 7fe98a1b4700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9840a4520 con 0x7fe9840a6fe0 2020-04-02T23:21:51.057 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.046+0000 7fe9837fe700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe98405bf90 0x7fe9840a4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:51.057 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.046+0000 7fe9837fe700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe98405bf90 0x7fe9840a4010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:40072/0 (socket says 172.21.15.174:40072) 2020-04-02T23:21:51.057 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.046+0000 7fe9837fe700 1 -- 172.21.15.174:0/3548454131 learned_addr learned my addr 172.21.15.174:0/3548454131 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:21:51.057 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.046+0000 7fe982ffd700 1 --2- 172.21.15.174:0/3548454131 >> v2:172.21.15.196:3300/0 conn(0x7fe9840a6fe0 0x7fe984139560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:51.057 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.046+0000 7fe9837fe700 1 -- 172.21.15.174:0/3548454131 >> v2:172.21.15.196:3300/0 conn(0x7fe9840a6fe0 msgr2=0x7fe984139560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:51.058 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.046+0000 7fe9837fe700 1 --2- 172.21.15.174:0/3548454131 >> v2:172.21.15.196:3300/0 conn(0x7fe9840a6fe0 0x7fe984139560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:51.058 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.046+0000 7fe9837fe700 1 -- 172.21.15.174:0/3548454131 >> v1:172.21.15.196:6789/0 conn(0x7fe9840a7440 legacy=0x7fe9841399c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:51.058 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.046+0000 7fe9837fe700 1 -- 172.21.15.174:0/3548454131 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9840a5cc0 con 0x7fe98405bf90 2020-04-02T23:21:51.058 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.046+0000 7fe982ffd700 1 --2- 172.21.15.174:0/3548454131 >> v2:172.21.15.196:3300/0 conn(0x7fe9840a6fe0 0x7fe984139560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-02T23:21:51.058 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.046+0000 7fe9837fe700 1 --2- 172.21.15.174:0/3548454131 >> v2:172.21.15.174:3300/0 conn(0x7fe98405bf90 0x7fe9840a4010 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe974002f30 tx=0x7fe974007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:51.058 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.046+0000 7fe9837fe700 1 --2- 172.21.15.174:0/3548454131 >> v2:172.21.15.174:3300/0 conn(0x7fe98405bf90 0x7fe9840a4010 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe974002f30 tx=0x7fe974007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:51.058 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.046+0000 7fe9837fe700 1 --2- 172.21.15.174:0/3548454131 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe98405bf90 0x7fe9840a4010 secure :-1 s=READY pgs=151 cs=0 l=1 rx=0x7fe974002f30 tx=0x7fe974007a40).ready entity=mon.0 client_cookie=677bfef5dd5105db server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:51.058 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.046+0000 7fe9837fe700 1 --2- 172.21.15.174:0/3548454131 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe98405bf90 0x7fe9840a4010 secure :-1 s=THROTTLE_DONE pgs=151 cs=0 l=1 rx=0x7fe974002f30 tx=0x7fe974007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:51.059 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.046+0000 7fe9837fe700 1 --2- 172.21.15.174:0/3548454131 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe98405bf90 0x7fe9840a4010 secure :-1 s=THROTTLE_DONE pgs=151 cs=0 l=1 rx=0x7fe974002f30 tx=0x7fe974007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:51.059 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.046+0000 7fe9827fc700 1 -- 172.21.15.174:0/3548454131 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe974011720 con 0x7fe98405bf90 2020-04-02T23:21:51.059 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.046+0000 7fe9837fe700 1 --2- 172.21.15.174:0/3548454131 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe98405bf90 0x7fe9840a4010 secure :-1 s=THROTTLE_DONE pgs=151 cs=0 l=1 rx=0x7fe974002f30 tx=0x7fe974007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:51.059 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.046+0000 7fe9827fc700 1 -- 172.21.15.174:0/3548454131 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe974011880 con 0x7fe98405bf90 2020-04-02T23:21:51.059 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.046+0000 7fe9827fc700 1 -- 172.21.15.174:0/3548454131 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe974011c60 con 0x7fe98405bf90 2020-04-02T23:21:51.059 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.046+0000 7fe98a1b4700 1 -- 172.21.15.174:0/3548454131 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe98405bf90 msgr2=0x7fe9840a4010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:51.059 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.047+0000 7fe98a1b4700 1 --2- 172.21.15.174:0/3548454131 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe98405bf90 0x7fe9840a4010 secure :-1 s=READY pgs=151 cs=0 l=1 rx=0x7fe974002f30 tx=0x7fe974007a40).stop 2020-04-02T23:21:51.060 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.047+0000 7fe98a1b4700 1 -- 172.21.15.174:0/3548454131 shutdown_connections 2020-04-02T23:21:51.060 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.047+0000 7fe98a1b4700 1 --2- 172.21.15.174:0/3548454131 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe98405bf90 0x7fe9840a4010 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:51.060 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.047+0000 7fe98a1b4700 1 --2- 172.21.15.174:0/3548454131 >> v2:172.21.15.196:3300/0 conn(0x7fe9840a6fe0 0x7fe984139560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:51.060 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.047+0000 7fe98a1b4700 1 -- 172.21.15.174:0/3548454131 >> 172.21.15.174:0/3548454131 conn(0x7fe9840ad160 msgr2=0x7fe9840a91b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:51.060 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.047+0000 7fe98a1b4700 1 -- 172.21.15.174:0/3548454131 shutdown_connections 2020-04-02T23:21:51.060 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.047+0000 7fe98a1b4700 1 -- 172.21.15.174:0/3548454131 wait complete. 2020-04-02T23:21:51.060 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.048+0000 7fe98a1b4700 1 Processor -- start 2020-04-02T23:21:51.060 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.048+0000 7fe98a1b4700 1 -- start start 2020-04-02T23:21:51.061 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.049+0000 7fe98a1b4700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe9840a6fe0 0x7fe984137e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:51.061 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.049+0000 7fe98a1b4700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fe98413b9b0 0x7fe98412c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:51.061 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.049+0000 7fe98a1b4700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe984130c00 con 0x7fe98405bf90 2020-04-02T23:21:51.061 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.049+0000 7fe98a1b4700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe984136940 con 0x7fe98413b9b0 2020-04-02T23:21:51.061 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.049+0000 7fe98a1b4700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe984131cf0 con 0x7fe9840a6fe0 2020-04-02T23:21:51.062 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.049+0000 7fe9837fe700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fe98405bf90 0x7fe9841315e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:45116/0 (socket says 172.21.15.174:45116) 2020-04-02T23:21:51.062 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.049+0000 7fe9837fe700 1 -- 172.21.15.174:0/3611499879 learned_addr learned my addr 172.21.15.174:0/3611499879 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:21:51.062 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.049+0000 7fe982ffd700 1 --2- 172.21.15.174:0/3611499879 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe9840a6fe0 0x7fe984137e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:51.062 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.049+0000 7fe983fff700 1 --2- 172.21.15.174:0/3611499879 >> v2:172.21.15.196:3300/0 conn(0x7fe98413b9b0 0x7fe98412c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:51.062 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.049+0000 7fe980ff9700 1 -- 172.21.15.174:0/3611499879 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3488252076 0 0) 0x7fe984130c00 con 0x7fe98405bf90 2020-04-02T23:21:51.062 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.049+0000 7fe980ff9700 1 -- 172.21.15.174:0/3611499879 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe964002fe0 con 0x7fe98405bf90 2020-04-02T23:21:51.062 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.049+0000 7fe980ff9700 1 -- 172.21.15.174:0/3611499879 <== mon.0 v1:172.21.15.174:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 283814606 0 0) 0x7fe964002fe0 con 0x7fe98405bf90 2020-04-02T23:21:51.063 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.049+0000 7fe980ff9700 1 -- 172.21.15.174:0/3611499879 --> v1:172.21.15.174:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe984130c00 con 0x7fe98405bf90 2020-04-02T23:21:51.063 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.049+0000 7fe980ff9700 1 -- 172.21.15.174:0/3611499879 <== mon.0 v1:172.21.15.174:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2811762909 0 0) 0x7fe9740085c0 con 0x7fe98405bf90 2020-04-02T23:21:51.063 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.049+0000 7fe980ff9700 1 -- 172.21.15.174:0/3611499879 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe9840a6fe0 msgr2=0x7fe984137e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:51.063 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.049+0000 7fe980ff9700 1 --2- 172.21.15.174:0/3611499879 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe9840a6fe0 0x7fe984137e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:51.063 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.049+0000 7fe980ff9700 1 -- 172.21.15.174:0/3611499879 >> v2:172.21.15.196:3300/0 conn(0x7fe98413b9b0 msgr2=0x7fe98412c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:51.063 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.049+0000 7fe980ff9700 1 --2- 172.21.15.174:0/3611499879 >> v2:172.21.15.196:3300/0 conn(0x7fe98413b9b0 0x7fe98412c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:51.063 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.049+0000 7fe980ff9700 1 -- 172.21.15.174:0/3611499879 >> v1:172.21.15.174:6789/0 conn(0x7fe98405bf90 legacy=0x7fe9841315e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:51.063 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.049+0000 7fe980ff9700 1 --2- 172.21.15.174:0/3611499879 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe9840a6fe0 0x7fe9640049b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:51.064 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.049+0000 7fe980ff9700 1 --2- 172.21.15.174:0/3611499879 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe964004e10 0x7fe964003920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:51.064 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.049+0000 7fe980ff9700 1 --2- 172.21.15.174:0/3611499879 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe964003d80 0x7fe964004200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:51.064 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.049+0000 7fe980ff9700 1 -- 172.21.15.174:0/3611499879 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe984136940 con 0x7fe964003d80 2020-04-02T23:21:51.064 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.049+0000 7fe980ff9700 1 -- 172.21.15.174:0/3611499879 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe984131cf0 con 0x7fe964004e10 2020-04-02T23:21:51.064 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.049+0000 7fe980ff9700 1 -- 172.21.15.174:0/3611499879 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe964005330 con 0x7fe9840a6fe0 2020-04-02T23:21:51.064 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.049+0000 7fe982ffd700 1 --2- 172.21.15.174:0/3611499879 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe964004e10 0x7fe964003920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:51.064 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.049+0000 7fe9837fe700 1 --2- 172.21.15.174:0/3611499879 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe9840a6fe0 0x7fe9640049b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:51.065 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.049+0000 7fe983fff700 1 --2- 172.21.15.174:0/3611499879 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe964003d80 0x7fe964004200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:51.065 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.050+0000 7fe983fff700 1 -- 172.21.15.174:0/3611499879 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe9840a6fe0 msgr2=0x7fe9640049b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:51.065 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.050+0000 7fe983fff700 1 --2- 172.21.15.174:0/3611499879 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe9840a6fe0 0x7fe9640049b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:51.065 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.050+0000 7fe983fff700 1 -- 172.21.15.174:0/3611499879 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe964004e10 msgr2=0x7fe964003920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:51.065 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.050+0000 7fe983fff700 1 --2- 172.21.15.174:0/3611499879 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe964004e10 0x7fe964003920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:51.065 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.050+0000 7fe983fff700 1 -- 172.21.15.174:0/3611499879 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe984130ea0 con 0x7fe964003d80 2020-04-02T23:21:51.065 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.050+0000 7fe98a1b4700 1 -- 172.21.15.174:0/3611499879 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe984131140 con 0x7fe964003d80 2020-04-02T23:21:51.066 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.050+0000 7fe983fff700 1 --2- 172.21.15.174:0/3611499879 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe964003d80 0x7fe964004200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe9840ad690 tx=0x7fe97c00c850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:51.066 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.050+0000 7fe98a1b4700 1 -- 172.21.15.174:0/3611499879 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe984066890 con 0x7fe964003d80 2020-04-02T23:21:51.066 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.050+0000 7fe983fff700 1 --2- 172.21.15.174:0/3611499879 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe964003d80 0x7fe964004200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe9840ad690 tx=0x7fe97c00c850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:51.066 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.050+0000 7fe983fff700 1 --2- 172.21.15.174:0/3611499879 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe964003d80 0x7fe964004200 secure :-1 s=READY pgs=153 cs=0 l=1 rx=0x7fe9840ad690 tx=0x7fe97c00c850).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:51.066 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.050+0000 7fe983fff700 1 --2- 172.21.15.174:0/3611499879 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe964003d80 0x7fe964004200 secure :-1 s=THROTTLE_DONE pgs=153 cs=0 l=1 rx=0x7fe9840ad690 tx=0x7fe97c00c850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:51.066 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.050+0000 7fe983fff700 1 --2- 172.21.15.174:0/3611499879 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe964003d80 0x7fe964004200 secure :-1 s=THROTTLE_DONE pgs=153 cs=0 l=1 rx=0x7fe9840ad690 tx=0x7fe97c00c850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:51.066 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.050+0000 7fe980ff9700 1 -- 172.21.15.174:0/3611499879 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe97c006c40 con 0x7fe964003d80 2020-04-02T23:21:51.066 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.050+0000 7fe983fff700 1 --2- 172.21.15.174:0/3611499879 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe964003d80 0x7fe964004200 secure :-1 s=THROTTLE_DONE pgs=153 cs=0 l=1 rx=0x7fe9840ad690 tx=0x7fe97c00c850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:51.067 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.050+0000 7fe980ff9700 1 -- 172.21.15.174:0/3611499879 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe97c006da0 con 0x7fe964003d80 2020-04-02T23:21:51.067 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.050+0000 7fe980ff9700 1 -- 172.21.15.174:0/3611499879 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe97c003350 con 0x7fe964003d80 2020-04-02T23:21:51.067 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.050+0000 7fe983fff700 1 --2- 172.21.15.174:0/3611499879 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe964003d80 0x7fe964004200 secure :-1 s=THROTTLE_DONE pgs=153 cs=0 l=1 rx=0x7fe9840ad690 tx=0x7fe97c00c850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:51.068 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.051+0000 7fe980ff9700 1 -- 172.21.15.174:0/3611499879 <== mon.0 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fe97c0034b0 con 0x7fe964003d80 2020-04-02T23:21:51.070 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.051+0000 7fe983fff700 1 --2- 172.21.15.174:0/3611499879 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe964003d80 0x7fe964004200 secure :-1 s=THROTTLE_DONE pgs=153 cs=0 l=1 rx=0x7fe9840ad690 tx=0x7fe97c00c850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:51.071 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.051+0000 7fe98a1b4700 1 -- 172.21.15.174:0/3611499879 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe960003340 con 0x7fe964003d80 2020-04-02T23:21:51.071 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.051+0000 7fe980ff9700 1 --2- 172.21.15.174:0/3611499879 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fe964055720 0x7fe964057be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:51.071 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.051+0000 7fe980ff9700 1 -- 172.21.15.174:0/3611499879 <== mon.0 v2:172.21.15.174:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe97c060e80 con 0x7fe964003d80 2020-04-02T23:21:51.071 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.051+0000 7fe9837fe700 1 --2- 172.21.15.174:0/3611499879 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fe964055720 0x7fe964057be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:51.071 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.051+0000 7fe9837fe700 1 --2- 172.21.15.174:0/3611499879 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fe964055720 0x7fe964057be0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe9740102c0 tx=0x7fe974007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:51.071 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.051+0000 7fe9837fe700 1 --2- 172.21.15.174:0/3611499879 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fe964055720 0x7fe964057be0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe9740102c0 tx=0x7fe974007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:51.072 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.051+0000 7fe9837fe700 1 --2- 172.21.15.174:0/3611499879 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fe964055720 0x7fe964057be0 secure :-1 s=READY pgs=84 cs=0 l=1 rx=0x7fe9740102c0 tx=0x7fe974007a40).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:51.073 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.054+0000 7fe983fff700 1 --2- 172.21.15.174:0/3611499879 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe964003d80 0x7fe964004200 secure :-1 s=THROTTLE_DONE pgs=153 cs=0 l=1 rx=0x7fe9840ad690 tx=0x7fe97c00c850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:51.074 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.054+0000 7fe980ff9700 1 -- 172.21.15.174:0/3611499879 <== mon.0 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fe97c03c600 con 0x7fe964003d80 2020-04-02T23:21:51.194 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.192+0000 7fe98a1b4700 1 -- 172.21.15.174:0/3611499879 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fe9600021d0 con 0x7fe964003d80 2020-04-02T23:21:51.195 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.192+0000 7fe983fff700 1 --2- 172.21.15.174:0/3611499879 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe964003d80 0x7fe964004200 secure :-1 s=THROTTLE_DONE pgs=153 cs=0 l=1 rx=0x7fe9840ad690 tx=0x7fe97c00c850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:51.195 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.192+0000 7fe980ff9700 1 -- 172.21.15.174:0/3611499879 <== mon.0 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe97c03fc20 con 0x7fe964003d80 2020-04-02T23:21:51.195 INFO:teuthology.orchestra.run.smithi174.stdout:60129542151 2020-04-02T23:21:51.196 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.193+0000 7fe98a1b4700 1 -- 172.21.15.174:0/3611499879 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fe964055720 msgr2=0x7fe964057be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:51.196 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.193+0000 7fe98a1b4700 1 --2- 172.21.15.174:0/3611499879 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fe964055720 0x7fe964057be0 secure :-1 s=READY pgs=84 cs=0 l=1 rx=0x7fe9740102c0 tx=0x7fe974007a40).stop 2020-04-02T23:21:51.196 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.193+0000 7fe98a1b4700 1 -- 172.21.15.174:0/3611499879 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe964003d80 msgr2=0x7fe964004200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:51.196 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.193+0000 7fe98a1b4700 1 --2- 172.21.15.174:0/3611499879 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe964003d80 0x7fe964004200 secure :-1 s=READY pgs=153 cs=0 l=1 rx=0x7fe9840ad690 tx=0x7fe97c00c850).stop 2020-04-02T23:21:51.197 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.193+0000 7fe983fff700 1 -- 172.21.15.174:0/3611499879 reap_dead start 2020-04-02T23:21:51.197 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.193+0000 7fe983fff700 1 -- 172.21.15.174:0/3611499879 reap_dead start 2020-04-02T23:21:51.197 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.193+0000 7fe98a1b4700 1 -- 172.21.15.174:0/3611499879 shutdown_connections 2020-04-02T23:21:51.197 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.193+0000 7fe98a1b4700 1 -- 172.21.15.174:0/3611499879 >> 172.21.15.174:0/3611499879 conn(0x7fe9840ad160 msgr2=0x7fe9840695c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:51.197 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.193+0000 7fe98a1b4700 1 -- 172.21.15.174:0/3611499879 shutdown_connections 2020-04-02T23:21:51.197 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.193+0000 7fe98a1b4700 1 -- 172.21.15.174:0/3611499879 wait complete. 2020-04-02T23:21:51.206 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.6 2020-04-02T23:21:51.207 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:51.220 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.7 2020-04-02T23:21:51.382 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.372+0000 7f51d900f700 1 Processor -- start 2020-04-02T23:21:51.382 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.372+0000 7f51d900f700 1 -- start start 2020-04-02T23:21:51.382 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.372+0000 7f51d900f700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f51d405bf90 0x7f51d40a8330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:51.382 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.372+0000 7f51d900f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f51d40a8790 0x7f51d413b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:51.382 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.372+0000 7f51d900f700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f51d413bd40 0x7f51d413c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:51.382 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.372+0000 7f51d900f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51d40a6930 con 0x7f51d40a8790 2020-04-02T23:21:51.383 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.372+0000 7f51d900f700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51d405f5b0 con 0x7f51d413bd40 2020-04-02T23:21:51.383 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.372+0000 7f51d900f700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51d405f850 con 0x7f51d405bf90 2020-04-02T23:21:51.383 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.373+0000 7f51cbfff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f51d40a8790 0x7f51d413b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:51.383 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.373+0000 7f51cbfff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f51d40a8790 0x7f51d413b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:40092/0 (socket says 172.21.15.174:40092) 2020-04-02T23:21:51.383 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.373+0000 7f51cbfff700 1 -- 172.21.15.174:0/787374739 learned_addr learned my addr 172.21.15.174:0/787374739 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:21:51.383 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.373+0000 7f51d359e700 1 --2- 172.21.15.174:0/787374739 >> v2:172.21.15.196:3300/0 conn(0x7f51d413bd40 0x7f51d413c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:51.383 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.373+0000 7f51d2d9d700 1 --2- 172.21.15.174:0/787374739 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f51d405bf90 0x7f51d40a8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:51.383 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.373+0000 7f51cbfff700 1 -- 172.21.15.174:0/787374739 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f51d405bf90 msgr2=0x7f51d40a8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:51.384 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.373+0000 7f51cbfff700 1 --2- 172.21.15.174:0/787374739 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f51d405bf90 0x7f51d40a8330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:51.384 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.373+0000 7f51cbfff700 1 -- 172.21.15.174:0/787374739 >> v2:172.21.15.196:3300/0 conn(0x7f51d413bd40 msgr2=0x7f51d413c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:51.384 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.373+0000 7f51cbfff700 1 --2- 172.21.15.174:0/787374739 >> v2:172.21.15.196:3300/0 conn(0x7f51d413bd40 0x7f51d413c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:51.384 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.373+0000 7f51cbfff700 1 -- 172.21.15.174:0/787374739 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51d405faf0 con 0x7f51d40a8790 2020-04-02T23:21:51.384 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.373+0000 7f51d359e700 1 --2- 172.21.15.174:0/787374739 >> v2:172.21.15.196:3300/0 conn(0x7f51d413bd40 0x7f51d413c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-02T23:21:51.384 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.373+0000 7f51d2d9d700 1 --2- 172.21.15.174:0/787374739 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f51d405bf90 0x7f51d40a8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-02T23:21:51.384 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.373+0000 7f51cbfff700 1 --2- 172.21.15.174:0/787374739 >> v2:172.21.15.174:3300/0 conn(0x7f51d40a8790 0x7f51d413b8e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f51bc002f30 tx=0x7f51bc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:51.385 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.373+0000 7f51cbfff700 1 --2- 172.21.15.174:0/787374739 >> v2:172.21.15.174:3300/0 conn(0x7f51d40a8790 0x7f51d413b8e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f51bc002f30 tx=0x7f51bc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:51.385 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.373+0000 7f51cbfff700 1 --2- 172.21.15.174:0/787374739 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f51d40a8790 0x7f51d413b8e0 secure :-1 s=READY pgs=154 cs=0 l=1 rx=0x7f51bc002f30 tx=0x7f51bc007a40).ready entity=mon.0 client_cookie=afa3d23b99f1f90d server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:51.385 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.373+0000 7f51cbfff700 1 --2- 172.21.15.174:0/787374739 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f51d40a8790 0x7f51d413b8e0 secure :-1 s=THROTTLE_DONE pgs=154 cs=0 l=1 rx=0x7f51bc002f30 tx=0x7f51bc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:51.385 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.373+0000 7f51d259c700 1 -- 172.21.15.174:0/787374739 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51bc011720 con 0x7f51d40a8790 2020-04-02T23:21:51.385 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.373+0000 7f51cbfff700 1 --2- 172.21.15.174:0/787374739 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f51d40a8790 0x7f51d413b8e0 secure :-1 s=THROTTLE_DONE pgs=154 cs=0 l=1 rx=0x7f51bc002f30 tx=0x7f51bc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:51.385 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.373+0000 7f51cbfff700 1 --2- 172.21.15.174:0/787374739 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f51d40a8790 0x7f51d413b8e0 secure :-1 s=THROTTLE_DONE pgs=154 cs=0 l=1 rx=0x7f51bc002f30 tx=0x7f51bc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:51.385 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.373+0000 7f51d259c700 1 -- 172.21.15.174:0/787374739 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51bc011880 con 0x7f51d40a8790 2020-04-02T23:21:51.385 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.373+0000 7f51d259c700 1 -- 172.21.15.174:0/787374739 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51bc011c20 con 0x7f51d40a8790 2020-04-02T23:21:51.386 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.373+0000 7f51d900f700 1 -- 172.21.15.174:0/787374739 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f51d40a8790 msgr2=0x7f51d413b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:51.386 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.373+0000 7f51d900f700 1 --2- 172.21.15.174:0/787374739 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f51d40a8790 0x7f51d413b8e0 secure :-1 s=READY pgs=154 cs=0 l=1 rx=0x7f51bc002f30 tx=0x7f51bc007a40).stop 2020-04-02T23:21:51.386 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.374+0000 7f51d900f700 1 -- 172.21.15.174:0/787374739 shutdown_connections 2020-04-02T23:21:51.386 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.374+0000 7f51d900f700 1 --2- 172.21.15.174:0/787374739 >> v2:172.21.15.196:3300/0 conn(0x7f51d413bd40 0x7f51d413c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:51.386 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.374+0000 7f51d900f700 1 --2- 172.21.15.174:0/787374739 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f51d405bf90 0x7f51d40a8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:51.386 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.374+0000 7f51d900f700 1 --2- 172.21.15.174:0/787374739 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f51d40a8790 0x7f51d413b8e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:51.387 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.374+0000 7f51d900f700 1 -- 172.21.15.174:0/787374739 >> 172.21.15.174:0/787374739 conn(0x7f51d40ad160 msgr2=0x7f51d40a91b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:51.387 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.374+0000 7f51d900f700 1 -- 172.21.15.174:0/787374739 shutdown_connections 2020-04-02T23:21:51.387 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.374+0000 7f51d900f700 1 -- 172.21.15.174:0/787374739 wait complete. 2020-04-02T23:21:51.387 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.375+0000 7f51d900f700 1 Processor -- start 2020-04-02T23:21:51.387 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.375+0000 7f51d900f700 1 -- start start 2020-04-02T23:21:51.388 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.375+0000 7f51d900f700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f51d405bf90 0x7f51d4134400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:51.388 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.375+0000 7f51d900f700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f51d40a8790 0x7f51d4134860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:51.388 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.375+0000 7f51d900f700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51d4064100 con 0x7f51d413bd40 2020-04-02T23:21:51.388 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.375+0000 7f51d900f700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51d40643a0 con 0x7f51d40a8790 2020-04-02T23:21:51.388 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.375+0000 7f51d900f700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51d4063df0 con 0x7f51d405bf90 2020-04-02T23:21:51.388 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.375+0000 7f51d2d9d700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f51d405bf90 0x7f51d4134400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:51.388 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.375+0000 7f51cbfff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f51d40a8790 0x7f51d4134860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:51.389 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.375+0000 7f51d2d9d700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f51d405bf90 0x7f51d4134400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.174:34686/0 (socket says 172.21.15.174:34686) 2020-04-02T23:21:51.389 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.375+0000 7f51cbfff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f51d40a8790 0x7f51d4134860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.174:48192/0 (socket says 172.21.15.174:48192) 2020-04-02T23:21:51.389 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.375+0000 7f51d359e700 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f51d413bd40 0x7f51d4132570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.174:51234/0 (socket says 172.21.15.174:51234) 2020-04-02T23:21:51.389 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.375+0000 7f51d2d9d700 1 -- 172.21.15.174:0/1705686075 learned_addr learned my addr 172.21.15.174:0/1705686075 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:21:51.389 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.376+0000 7f51d2d9d700 1 -- 172.21.15.174:0/1705686075 >> v2:172.21.15.196:3300/0 conn(0x7f51d40a8790 msgr2=0x7f51d4134860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:51.389 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.376+0000 7f51d2d9d700 1 --2- 172.21.15.174:0/1705686075 >> v2:172.21.15.196:3300/0 conn(0x7f51d40a8790 0x7f51d4134860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:51.389 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.376+0000 7f51d2d9d700 1 -- 172.21.15.174:0/1705686075 >> v1:172.21.15.196:6789/0 conn(0x7f51d413bd40 legacy=0x7f51d4132570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:51.390 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.376+0000 7f51d2d9d700 1 -- 172.21.15.174:0/1705686075 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51d4134cc0 con 0x7f51d405bf90 2020-04-02T23:21:51.390 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.376+0000 7f51cbfff700 1 --2- 172.21.15.174:0/1705686075 >> v2:172.21.15.196:3300/0 conn(0x7f51d40a8790 0x7f51d4134860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:21:51.390 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.376+0000 7f51d2d9d700 1 --2- 172.21.15.174:0/1705686075 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f51d405bf90 0x7f51d4134400 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f51c4007920 tx=0x7f51c4010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:51.390 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.376+0000 7f51d2d9d700 1 --2- 172.21.15.174:0/1705686075 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f51d405bf90 0x7f51d4134400 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f51c4007920 tx=0x7f51c4010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:51.390 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.376+0000 7f51d2d9d700 1 --2- 172.21.15.174:0/1705686075 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f51d405bf90 0x7f51d4134400 secure :-1 s=READY pgs=32 cs=0 l=1 rx=0x7f51c4007920 tx=0x7f51c4010b50).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:51.391 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.376+0000 7f51d2d9d700 1 --2- 172.21.15.174:0/1705686075 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f51d405bf90 0x7f51d4134400 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7f51c4007920 tx=0x7f51c4010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:51.391 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.376+0000 7f51d0d99700 1 -- 172.21.15.174:0/1705686075 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51c4005e90 con 0x7f51d405bf90 2020-04-02T23:21:51.391 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.376+0000 7f51d2d9d700 1 --2- 172.21.15.174:0/1705686075 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f51d405bf90 0x7f51d4134400 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7f51c4007920 tx=0x7f51c4010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:51.391 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.376+0000 7f51d2d9d700 1 --2- 172.21.15.174:0/1705686075 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f51d405bf90 0x7f51d4134400 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7f51c4007920 tx=0x7f51c4010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:51.391 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.376+0000 7f51d0d99700 1 -- 172.21.15.174:0/1705686075 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51c4007160 con 0x7f51d405bf90 2020-04-02T23:21:51.392 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.376+0000 7f51d0d99700 1 -- 172.21.15.174:0/1705686075 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51c4007580 con 0x7f51d405bf90 2020-04-02T23:21:51.392 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.376+0000 7f51d900f700 1 -- 172.21.15.174:0/1705686075 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51d413af10 con 0x7f51d405bf90 2020-04-02T23:21:51.392 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.376+0000 7f51d900f700 1 -- 172.21.15.174:0/1705686075 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51d413a770 con 0x7f51d405bf90 2020-04-02T23:21:51.392 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.377+0000 7f51d2d9d700 1 --2- 172.21.15.174:0/1705686075 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f51d405bf90 0x7f51d4134400 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7f51c4007920 tx=0x7f51c4010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:51.392 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.377+0000 7f51d900f700 1 -- 172.21.15.174:0/1705686075 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51d4063f60 con 0x7f51d405bf90 2020-04-02T23:21:51.393 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.377+0000 7f51d0d99700 1 -- 172.21.15.174:0/1705686075 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f51c400e280 con 0x7f51d405bf90 2020-04-02T23:21:51.393 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.377+0000 7f51d2d9d700 1 --2- 172.21.15.174:0/1705686075 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f51d405bf90 0x7f51d4134400 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7f51c4007920 tx=0x7f51c4010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:51.393 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.377+0000 7f51d0d99700 1 --2- 172.21.15.174:0/1705686075 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f51b804d560 0x7f51b804fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:51.393 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.377+0000 7f51d0d99700 1 -- 172.21.15.174:0/1705686075 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f51c4007e40 con 0x7f51d405bf90 2020-04-02T23:21:51.393 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.377+0000 7f51cbfff700 1 --2- 172.21.15.174:0/1705686075 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f51b804d560 0x7f51b804fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:51.393 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.378+0000 7f51cbfff700 1 --2- 172.21.15.174:0/1705686075 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f51b804d560 0x7f51b804fa20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f51bc002f30 tx=0x7f51bc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:51.394 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.378+0000 7f51cbfff700 1 --2- 172.21.15.174:0/1705686075 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f51b804d560 0x7f51b804fa20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f51bc002f30 tx=0x7f51bc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:51.394 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.378+0000 7f51cbfff700 1 --2- 172.21.15.174:0/1705686075 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f51b804d560 0x7f51b804fa20 secure :-1 s=READY pgs=85 cs=0 l=1 rx=0x7f51bc002f30 tx=0x7f51bc007a40).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:51.395 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.381+0000 7f51d2d9d700 1 --2- 172.21.15.174:0/1705686075 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f51d405bf90 0x7f51d4134400 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7f51c4007920 tx=0x7f51c4010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:51.395 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.381+0000 7f51d0d99700 1 -- 172.21.15.174:0/1705686075 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f51d4063f60 con 0x7f51d405bf90 2020-04-02T23:21:51.521 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.518+0000 7f51d900f700 1 -- 172.21.15.174:0/1705686075 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f51d4063f30 con 0x7f51d405bf90 2020-04-02T23:21:51.522 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.519+0000 7f51d2d9d700 1 --2- 172.21.15.174:0/1705686075 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f51d405bf90 0x7f51d4134400 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7f51c4007920 tx=0x7f51c4010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:51.522 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.519+0000 7f51d0d99700 1 -- 172.21.15.174:0/1705686075 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f51c400a0d0 con 0x7f51d405bf90 2020-04-02T23:21:51.522 INFO:teuthology.orchestra.run.smithi174.stdout:60129542151 2020-04-02T23:21:51.523 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.521+0000 7f51d900f700 1 -- 172.21.15.174:0/1705686075 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f51b804d560 msgr2=0x7f51b804fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:51.524 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.521+0000 7f51d900f700 1 --2- 172.21.15.174:0/1705686075 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f51b804d560 0x7f51b804fa20 secure :-1 s=READY pgs=85 cs=0 l=1 rx=0x7f51bc002f30 tx=0x7f51bc007a40).stop 2020-04-02T23:21:51.524 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.521+0000 7f51d900f700 1 -- 172.21.15.174:0/1705686075 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f51d405bf90 msgr2=0x7f51d4134400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:51.524 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.521+0000 7f51d900f700 1 --2- 172.21.15.174:0/1705686075 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f51d405bf90 0x7f51d4134400 secure :-1 s=READY pgs=32 cs=0 l=1 rx=0x7f51c4007920 tx=0x7f51c4010b50).stop 2020-04-02T23:21:51.524 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.521+0000 7f51d900f700 1 -- 172.21.15.174:0/1705686075 shutdown_connections 2020-04-02T23:21:51.524 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.521+0000 7f51d900f700 1 --2- 172.21.15.174:0/1705686075 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f51b804d560 0x7f51b804fa20 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:51.524 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.521+0000 7f51d900f700 1 --2- 172.21.15.174:0/1705686075 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f51d405bf90 0x7f51d4134400 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:51.524 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.521+0000 7f51d900f700 1 --2- 172.21.15.174:0/1705686075 >> v2:172.21.15.196:3300/0 conn(0x7f51d40a8790 0x7f51d4134860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:51.525 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.521+0000 7f51d900f700 1 -- 172.21.15.174:0/1705686075 >> 172.21.15.174:0/1705686075 conn(0x7f51d40ad160 msgr2=0x7f51d40695c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:51.525 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.521+0000 7f51d900f700 1 -- 172.21.15.174:0/1705686075 shutdown_connections 2020-04-02T23:21:51.525 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.521+0000 7f51d900f700 1 -- 172.21.15.174:0/1705686075 wait complete. 2020-04-02T23:21:51.533 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.7 2020-04-02T23:21:51.533 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2020-04-02T23:21:51.534 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:51.547 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-04-02T23:21:51.713 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.710+0000 7f9f6590c700 1 Processor -- start 2020-04-02T23:21:51.713 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.710+0000 7f9f6590c700 1 -- start start 2020-04-02T23:21:51.719 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.711+0000 7f9f6590c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9f6005b340 0x7f9f60065a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:51.719 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.711+0000 7f9f6590c700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9f60065ed0 0x7f9f6009a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:51.719 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.711+0000 7f9f6590c700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f6005c3c0 con 0x7f9f6009ac70 2020-04-02T23:21:51.719 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.711+0000 7f9f6590c700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f6005c660 con 0x7f9f6005b340 2020-04-02T23:21:51.720 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.711+0000 7f9f6590c700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f600a2520 con 0x7f9f60065ed0 2020-04-02T23:21:51.720 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.711+0000 7f9f5effd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9f6005b340 0x7f9f60065a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:51.720 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.711+0000 7f9f5effd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9f6005b340 0x7f9f60065a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:40106/0 (socket says 172.21.15.174:40106) 2020-04-02T23:21:51.720 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.711+0000 7f9f5effd700 1 -- 172.21.15.174:0/3817378541 learned_addr learned my addr 172.21.15.174:0/3817378541 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:21:51.720 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.711+0000 7f9f5e7fc700 1 --2- 172.21.15.174:0/3817378541 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9f60065ed0 0x7f9f6009a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:51.720 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.711+0000 7f9f5effd700 1 -- 172.21.15.174:0/3817378541 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9f60065ed0 msgr2=0x7f9f6009a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:51.721 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.711+0000 7f9f5effd700 1 --2- 172.21.15.174:0/3817378541 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9f60065ed0 0x7f9f6009a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:51.721 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.711+0000 7f9f5effd700 1 -- 172.21.15.174:0/3817378541 >> v1:172.21.15.196:6789/0 conn(0x7f9f6009ac70 legacy=0x7f9f6013b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:51.721 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.711+0000 7f9f5effd700 1 -- 172.21.15.174:0/3817378541 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f600a4fa0 con 0x7f9f6005b340 2020-04-02T23:21:51.721 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.711+0000 7f9f5effd700 1 --2- 172.21.15.174:0/3817378541 >> v2:172.21.15.174:3300/0 conn(0x7f9f6005b340 0x7f9f60065a70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9f600a5640 tx=0x7f9f54007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:51.721 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.711+0000 7f9f5effd700 1 --2- 172.21.15.174:0/3817378541 >> v2:172.21.15.174:3300/0 conn(0x7f9f6005b340 0x7f9f60065a70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9f600a5640 tx=0x7f9f54007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:51.721 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.712+0000 7f9f5effd700 1 --2- 172.21.15.174:0/3817378541 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f6005b340 0x7f9f60065a70 secure :-1 s=READY pgs=155 cs=0 l=1 rx=0x7f9f600a5640 tx=0x7f9f54007a40).ready entity=mon.0 client_cookie=eeef74eb1a0fd427 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:51.722 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.712+0000 7f9f5effd700 1 --2- 172.21.15.174:0/3817378541 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f6005b340 0x7f9f60065a70 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7f9f600a5640 tx=0x7f9f54007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:51.722 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.712+0000 7f9f5dffb700 1 -- 172.21.15.174:0/3817378541 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f540116e0 con 0x7f9f6005b340 2020-04-02T23:21:51.722 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.712+0000 7f9f5effd700 1 --2- 172.21.15.174:0/3817378541 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f6005b340 0x7f9f60065a70 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7f9f600a5640 tx=0x7f9f54007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:51.722 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.712+0000 7f9f5effd700 1 --2- 172.21.15.174:0/3817378541 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f6005b340 0x7f9f60065a70 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7f9f600a5640 tx=0x7f9f54007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:51.722 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.712+0000 7f9f5dffb700 1 -- 172.21.15.174:0/3817378541 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f54011840 con 0x7f9f6005b340 2020-04-02T23:21:51.722 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.712+0000 7f9f5dffb700 1 -- 172.21.15.174:0/3817378541 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f54011c60 con 0x7f9f6005b340 2020-04-02T23:21:51.722 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.712+0000 7f9f6590c700 1 -- 172.21.15.174:0/3817378541 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f6005b340 msgr2=0x7f9f60065a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:51.722 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.712+0000 7f9f6590c700 1 --2- 172.21.15.174:0/3817378541 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f6005b340 0x7f9f60065a70 secure :-1 s=READY pgs=155 cs=0 l=1 rx=0x7f9f600a5640 tx=0x7f9f54007a40).stop 2020-04-02T23:21:51.723 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.712+0000 7f9f6590c700 1 -- 172.21.15.174:0/3817378541 shutdown_connections 2020-04-02T23:21:51.723 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.712+0000 7f9f6590c700 1 --2- 172.21.15.174:0/3817378541 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f6005b340 0x7f9f60065a70 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:51.723 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.712+0000 7f9f6590c700 1 --2- 172.21.15.174:0/3817378541 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9f60065ed0 0x7f9f6009a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:51.723 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.712+0000 7f9f6590c700 1 -- 172.21.15.174:0/3817378541 >> 172.21.15.174:0/3817378541 conn(0x7f9f600aaca0 msgr2=0x7f9f600ab0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:51.723 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.712+0000 7f9f6590c700 1 -- 172.21.15.174:0/3817378541 shutdown_connections 2020-04-02T23:21:51.723 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.712+0000 7f9f6590c700 1 -- 172.21.15.174:0/3817378541 wait complete. 2020-04-02T23:21:51.723 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.713+0000 7f9f6590c700 1 Processor -- start 2020-04-02T23:21:51.724 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.713+0000 7f9f6590c700 1 -- start start 2020-04-02T23:21:51.724 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.714+0000 7f9f6590c700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9f6005b340 0x7f9f6008ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:51.724 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.714+0000 7f9f6590c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9f60065ed0 0x7f9f600922c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:51.724 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.714+0000 7f9f6590c700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f600909e0 con 0x7f9f6009ac70 2020-04-02T23:21:51.724 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.714+0000 7f9f6590c700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f60065af0 con 0x7f9f60065ed0 2020-04-02T23:21:51.724 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.714+0000 7f9f6590c700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f600904a0 con 0x7f9f6005b340 2020-04-02T23:21:51.724 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.714+0000 7f9f5e7fc700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9f60065ed0 0x7f9f600922c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:51.725 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.714+0000 7f9f5e7fc700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9f60065ed0 0x7f9f600922c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:40112/0 (socket says 172.21.15.174:40112) 2020-04-02T23:21:51.725 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.714+0000 7f9f5e7fc700 1 -- 172.21.15.174:0/2937474766 learned_addr learned my addr 172.21.15.174:0/2937474766 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:21:51.725 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.714+0000 7f9f5effd700 1 --2- 172.21.15.174:0/2937474766 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9f6005b340 0x7f9f6008ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:51.725 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.714+0000 7f9f5e7fc700 1 -- 172.21.15.174:0/2937474766 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9f6005b340 msgr2=0x7f9f6008ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:51.725 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.714+0000 7f9f5e7fc700 1 --2- 172.21.15.174:0/2937474766 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9f6005b340 0x7f9f6008ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:51.725 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.714+0000 7f9f5e7fc700 1 -- 172.21.15.174:0/2937474766 >> v1:172.21.15.174:6789/0 conn(0x7f9f6009ac70 legacy=0x7f9f6008f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:51.725 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.714+0000 7f9f4ffff700 1 -- 172.21.15.174:0/2937474766 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4260536502 0 0) 0x7f9f600909e0 con 0x7f9f6009ac70 2020-04-02T23:21:51.726 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.714+0000 7f9f5e7fc700 1 -- 172.21.15.174:0/2937474766 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f60090740 con 0x7f9f60065ed0 2020-04-02T23:21:51.726 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.714+0000 7f9f5e7fc700 1 --2- 172.21.15.174:0/2937474766 >> v2:172.21.15.174:3300/0 conn(0x7f9f60065ed0 0x7f9f600922c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9f6008ee30 tx=0x7f9f50010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:51.726 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.714+0000 7f9f5e7fc700 1 --2- 172.21.15.174:0/2937474766 >> v2:172.21.15.174:3300/0 conn(0x7f9f60065ed0 0x7f9f600922c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9f6008ee30 tx=0x7f9f50010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:51.726 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.714+0000 7f9f5e7fc700 1 --2- 172.21.15.174:0/2937474766 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f60065ed0 0x7f9f600922c0 secure :-1 s=READY pgs=157 cs=0 l=1 rx=0x7f9f6008ee30 tx=0x7f9f50010c60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:51.726 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.714+0000 7f9f5e7fc700 1 --2- 172.21.15.174:0/2937474766 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f60065ed0 0x7f9f600922c0 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7f9f6008ee30 tx=0x7f9f50010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:51.726 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.714+0000 7f9f4ffff700 1 -- 172.21.15.174:0/2937474766 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f50012a90 con 0x7f9f60065ed0 2020-04-02T23:21:51.726 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.714+0000 7f9f5e7fc700 1 --2- 172.21.15.174:0/2937474766 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f60065ed0 0x7f9f600922c0 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7f9f6008ee30 tx=0x7f9f50010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:51.727 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.714+0000 7f9f5e7fc700 1 --2- 172.21.15.174:0/2937474766 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f60065ed0 0x7f9f600922c0 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7f9f6008ee30 tx=0x7f9f50010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:51.727 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.714+0000 7f9f4ffff700 1 -- 172.21.15.174:0/2937474766 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f50012bf0 con 0x7f9f60065ed0 2020-04-02T23:21:51.727 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.714+0000 7f9f4ffff700 1 -- 172.21.15.174:0/2937474766 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f500091a0 con 0x7f9f60065ed0 2020-04-02T23:21:51.727 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.714+0000 7f9f6590c700 1 -- 172.21.15.174:0/2937474766 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f6009dbf0 con 0x7f9f60065ed0 2020-04-02T23:21:51.727 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.714+0000 7f9f6590c700 1 -- 172.21.15.174:0/2937474766 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f6008fa60 con 0x7f9f60065ed0 2020-04-02T23:21:51.727 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.715+0000 7f9f5e7fc700 1 --2- 172.21.15.174:0/2937474766 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f60065ed0 0x7f9f600922c0 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7f9f6008ee30 tx=0x7f9f50010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:51.727 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.715+0000 7f9f4ffff700 1 -- 172.21.15.174:0/2937474766 <== mon.0 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f9f50007170 con 0x7f9f60065ed0 2020-04-02T23:21:51.727 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.715+0000 7f9f6590c700 1 -- 172.21.15.174:0/2937474766 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f60056c50 con 0x7f9f60065ed0 2020-04-02T23:21:51.728 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.715+0000 7f9f5e7fc700 1 --2- 172.21.15.174:0/2937474766 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f60065ed0 0x7f9f600922c0 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7f9f6008ee30 tx=0x7f9f50010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:51.728 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.716+0000 7f9f4ffff700 1 --2- 172.21.15.174:0/2937474766 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f9f3c04d430 0x7f9f3c04f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:51.728 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.716+0000 7f9f4ffff700 1 -- 172.21.15.174:0/2937474766 <== mon.0 v2:172.21.15.174:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9f50061490 con 0x7f9f60065ed0 2020-04-02T23:21:51.728 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.716+0000 7f9f5effd700 1 --2- 172.21.15.174:0/2937474766 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f9f3c04d430 0x7f9f3c04f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:51.728 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.716+0000 7f9f5effd700 1 --2- 172.21.15.174:0/2937474766 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f9f3c04d430 0x7f9f3c04f8f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9f600a5640 tx=0x7f9f54007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:51.728 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.716+0000 7f9f5effd700 1 --2- 172.21.15.174:0/2937474766 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f9f3c04d430 0x7f9f3c04f8f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9f600a5640 tx=0x7f9f54007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:51.728 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.716+0000 7f9f5effd700 1 --2- 172.21.15.174:0/2937474766 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f9f3c04d430 0x7f9f3c04f8f0 secure :-1 s=READY pgs=86 cs=0 l=1 rx=0x7f9f600a5640 tx=0x7f9f54007a40).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:51.736 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.719+0000 7f9f5e7fc700 1 --2- 172.21.15.174:0/2937474766 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f60065ed0 0x7f9f600922c0 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7f9f6008ee30 tx=0x7f9f50010c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:51.736 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.719+0000 7f9f4ffff700 1 -- 172.21.15.174:0/2937474766 <== mon.0 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f9f5003cb90 con 0x7f9f60065ed0 2020-04-02T23:21:51.854 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.851+0000 7f9f6590c700 1 -- 172.21.15.174:0/2937474766 --> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9f6008ee70 con 0x7f9f3c04d430 2020-04-02T23:21:51.860 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.855+0000 7f9f5effd700 1 --2- 172.21.15.174:0/2937474766 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f9f3c04d430 0x7f9f3c04f8f0 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7f9f600a5640 tx=0x7f9f54007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:51.861 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.855+0000 7f9f4ffff700 1 -- 172.21.15.174:0/2937474766 <== mgr.4102 v2:172.21.15.196:6800/23210 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+82344 (secure 0 0 0) 0x7f9f54008660 con 0x7f9f3c04d430 2020-04-02T23:21:51.861 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.856+0000 7f9f6590c700 1 -- 172.21.15.174:0/2937474766 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f9f3c04d430 msgr2=0x7f9f3c04f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:51.861 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.856+0000 7f9f6590c700 1 --2- 172.21.15.174:0/2937474766 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f9f3c04d430 0x7f9f3c04f8f0 secure :-1 s=READY pgs=86 cs=0 l=1 rx=0x7f9f600a5640 tx=0x7f9f54007a40).stop 2020-04-02T23:21:51.861 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.856+0000 7f9f6590c700 1 -- 172.21.15.174:0/2937474766 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f60065ed0 msgr2=0x7f9f600922c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:51.861 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.856+0000 7f9f6590c700 1 --2- 172.21.15.174:0/2937474766 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f60065ed0 0x7f9f600922c0 secure :-1 s=READY pgs=157 cs=0 l=1 rx=0x7f9f6008ee30 tx=0x7f9f50010c60).stop 2020-04-02T23:21:51.861 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.856+0000 7f9f6590c700 1 -- 172.21.15.174:0/2937474766 shutdown_connections 2020-04-02T23:21:51.862 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.856+0000 7f9f6590c700 1 --2- 172.21.15.174:0/2937474766 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f9f3c04d430 0x7f9f3c04f8f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:51.862 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.856+0000 7f9f6590c700 1 --2- 172.21.15.174:0/2937474766 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9f6005b340 0x7f9f6008ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:51.862 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.856+0000 7f9f6590c700 1 --2- 172.21.15.174:0/2937474766 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f60065ed0 0x7f9f600922c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:51.862 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.856+0000 7f9f6590c700 1 -- 172.21.15.174:0/2937474766 >> 172.21.15.174:0/2937474766 conn(0x7f9f600aaca0 msgr2=0x7f9f600a3140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:51.862 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.857+0000 7f9f6590c700 1 -- 172.21.15.174:0/2937474766 shutdown_connections 2020-04-02T23:21:51.862 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:51.857+0000 7f9f6590c700 1 -- 172.21.15.174:0/2937474766 wait complete. 2020-04-02T23:21:51.862 INFO:teuthology.orchestra.run.smithi174.stderr:dumped all 2020-04-02T23:21:51.863 INFO:teuthology.orchestra.run.smithi174.stdout: 2020-04-02T23:21:51.870 INFO:teuthology.orchestra.run.smithi174.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2020-04-02T23:21:50.186052+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2286,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":40,"ondisk_log_size":40,"up":50,"acting":50,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":749595040,"kb_used":6369844,"kb_used_data":743225460,"kb_used_omap":580,"kb_used_meta":0,"kb_avail":743225196,"statfs":{"total":767585320960,"available":761062600704,"internally_reserved":270336,"allocated":761062871040,"data_stored":761062871040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":594427,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2286,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.649696"},"pg_stats":[{"pgid":"4.2","version":"0'0","reported_seq":"9","reported_epoch":"22","state":"active+clean","last_fresh":"2020-04-02T23:21:40.542177+0000","last_change":"2020-04-02T23:21:40.541967+0000","last_active":"2020-04-02T23:21:40.542177+0000","last_peered":"2020-04-02T23:21:40.542177+0000","last_clean":"2020-04-02T23:21:40.542177+0000","last_became_active":"2020-04-02T23:21:40.541485+0000","last_became_peered":"2020-04-02T23:21:40.541485+0000","last_unstale":"2020-04-02T23:21:40.542177+0000","last_undegraded":"2020-04-02T23:21:40.542177+0000","last_fullsized":"2020-04-02T23:21:40.542177+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:40.142809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:40.142809+0000","last_clean_scrub_stamp":"2020-04-02T23:21:40.142809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"12","reported_epoch":"22","state":"active+clean","last_fresh":"2020-04-02T23:21:40.539398+0000","last_change":"2020-04-02T23:21:37.552581+0000","last_active":"2020-04-02T23:21:40.539398+0000","last_peered":"2020-04-02T23:21:40.539398+0000","last_clean":"2020-04-02T23:21:40.539398+0000","last_became_active":"2020-04-02T23:21:37.552244+0000","last_became_peered":"2020-04-02T23:21:37.552244+0000","last_unstale":"2020-04-02T23:21:40.539398+0000","last_undegraded":"2020-04-02T23:21:40.539398+0000","last_fullsized":"2020-04-02T23:21:40.539398+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:36.120823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:36.120823+0000","last_clean_scrub_stamp":"2020-04-02T23:21:36.120823+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"23'6","reported_seq":"16","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:21:44.137875+0000","last_change":"2020-04-02T23:21:40.162228+0000","last_active":"2020-04-02T23:21:44.137875+0000","last_peered":"2020-04-02T23:21:44.137875+0000","last_clean":"2020-04-02T23:21:44.137875+0000","last_became_active":"2020-04-02T23:21:40.161797+0000","last_became_peered":"2020-04-02T23:21:40.161797+0000","last_unstale":"2020-04-02T23:21:44.137875+0000","last_undegraded":"2020-04-02T23:21:44.137875+0000","last_fullsized":"2020-04-02T23:21:44.137875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:39.137888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:39.137888+0000","last_clean_scrub_stamp":"2020-04-02T23:21:39.137888+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":"9","reported_epoch":"22","state":"active+clean","last_fresh":"2020-04-02T23:21:40.542907+0000","last_change":"2020-04-02T23:21:40.542743+0000","last_active":"2020-04-02T23:21:40.542907+0000","last_peered":"2020-04-02T23:21:40.542907+0000","last_clean":"2020-04-02T23:21:40.542907+0000","last_became_active":"2020-04-02T23:21:40.542398+0000","last_became_peered":"2020-04-02T23:21:40.542398+0000","last_unstale":"2020-04-02T23:21:40.542907+0000","last_undegraded":"2020-04-02T23:21:40.542907+0000","last_fullsized":"2020-04-02T23:21:40.542907+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:40.142809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:40.142809+0000","last_clean_scrub_stamp":"2020-04-02T23:21:40.142809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"12","reported_epoch":"22","state":"active+clean","last_fresh":"2020-04-02T23:21:40.536883+0000","last_change":"2020-04-02T23:21:37.552581+0000","last_active":"2020-04-02T23:21:40.536883+0000","last_peered":"2020-04-02T23:21:40.536883+0000","last_clean":"2020-04-02T23:21:40.536883+0000","last_became_active":"2020-04-02T23:21:37.552288+0000","last_became_peered":"2020-04-02T23:21:37.552288+0000","last_unstale":"2020-04-02T23:21:40.536883+0000","last_undegraded":"2020-04-02T23:21:40.536883+0000","last_fullsized":"2020-04-02T23:21:40.536883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:36.120823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:36.120823+0000","last_clean_scrub_stamp":"2020-04-02T23:21:36.120823+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"23'5","reported_seq":"15","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:21:44.125744+0000","last_change":"2020-04-02T23:21:40.158169+0000","last_active":"2020-04-02T23:21:44.125744+0000","last_peered":"2020-04-02T23:21:44.125744+0000","last_clean":"2020-04-02T23:21:44.125744+0000","last_became_active":"2020-04-02T23:21:40.157809+0000","last_became_peered":"2020-04-02T23:21:40.157809+0000","last_unstale":"2020-04-02T23:21:44.125744+0000","last_undegraded":"2020-04-02T23:21:44.125744+0000","last_fullsized":"2020-04-02T23:21:44.125744+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:39.137888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:39.137888+0000","last_clean_scrub_stamp":"2020-04-02T23:21:39.137888+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":"9","reported_epoch":"22","state":"active+clean","last_fresh":"2020-04-02T23:21:40.552097+0000","last_change":"2020-04-02T23:21:40.551966+0000","last_active":"2020-04-02T23:21:40.552097+0000","last_peered":"2020-04-02T23:21:40.552097+0000","last_clean":"2020-04-02T23:21:40.552097+0000","last_became_active":"2020-04-02T23:21:40.551607+0000","last_became_peered":"2020-04-02T23:21:40.551607+0000","last_unstale":"2020-04-02T23:21:40.552097+0000","last_undegraded":"2020-04-02T23:21:40.552097+0000","last_fullsized":"2020-04-02T23:21:40.552097+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:40.142809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:40.142809+0000","last_clean_scrub_stamp":"2020-04-02T23:21:40.142809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"12","reported_epoch":"22","state":"active+clean","last_fresh":"2020-04-02T23:21:40.537856+0000","last_change":"2020-04-02T23:21:37.135095+0000","last_active":"2020-04-02T23:21:40.537856+0000","last_peered":"2020-04-02T23:21:40.537856+0000","last_clean":"2020-04-02T23:21:40.537856+0000","last_became_active":"2020-04-02T23:21:37.134712+0000","last_became_peered":"2020-04-02T23:21:37.134712+0000","last_unstale":"2020-04-02T23:21:40.537856+0000","last_undegraded":"2020-04-02T23:21:40.537856+0000","last_fullsized":"2020-04-02T23:21:40.537856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:36.120823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:36.120823+0000","last_clean_scrub_stamp":"2020-04-02T23:21:36.120823+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"23'8","reported_seq":"18","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:21:44.129789+0000","last_change":"2020-04-02T23:21:40.162349+0000","last_active":"2020-04-02T23:21:44.129789+0000","last_peered":"2020-04-02T23:21:44.129789+0000","last_clean":"2020-04-02T23:21:44.129789+0000","last_became_active":"2020-04-02T23:21:40.161970+0000","last_became_peered":"2020-04-02T23:21:40.161970+0000","last_unstale":"2020-04-02T23:21:44.129789+0000","last_undegraded":"2020-04-02T23:21:44.129789+0000","last_fullsized":"2020-04-02T23:21:44.129789+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:39.137888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:39.137888+0000","last_clean_scrub_stamp":"2020-04-02T23:21:39.137888+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":"9","reported_epoch":"22","state":"active+clean","last_fresh":"2020-04-02T23:21:40.550172+0000","last_change":"2020-04-02T23:21:40.550015+0000","last_active":"2020-04-02T23:21:40.550172+0000","last_peered":"2020-04-02T23:21:40.550172+0000","last_clean":"2020-04-02T23:21:40.550172+0000","last_became_active":"2020-04-02T23:21:40.549758+0000","last_became_peered":"2020-04-02T23:21:40.549758+0000","last_unstale":"2020-04-02T23:21:40.550172+0000","last_undegraded":"2020-04-02T23:21:40.550172+0000","last_fullsized":"2020-04-02T23:21:40.550172+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:40.142809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:40.142809+0000","last_clean_scrub_stamp":"2020-04-02T23:21:40.142809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"12","reported_epoch":"22","state":"active+clean","last_fresh":"2020-04-02T23:21:40.536894+0000","last_change":"2020-04-02T23:21:37.691403+0000","last_active":"2020-04-02T23:21:40.536894+0000","last_peered":"2020-04-02T23:21:40.536894+0000","last_clean":"2020-04-02T23:21:40.536894+0000","last_became_active":"2020-04-02T23:21:37.691080+0000","last_became_peered":"2020-04-02T23:21:37.691080+0000","last_unstale":"2020-04-02T23:21:40.536894+0000","last_undegraded":"2020-04-02T23:21:40.536894+0000","last_fullsized":"2020-04-02T23:21:40.536894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:36.120823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:36.120823+0000","last_clean_scrub_stamp":"2020-04-02T23:21:36.120823+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'2","reported_seq":"16","reported_epoch":"22","state":"active+clean","last_fresh":"2020-04-02T23:21:40.549160+0000","last_change":"2020-04-02T23:21:30.497862+0000","last_active":"2020-04-02T23:21:40.549160+0000","last_peered":"2020-04-02T23:21:40.549160+0000","last_clean":"2020-04-02T23:21:40.549160+0000","last_became_active":"2020-04-02T23:21:30.497574+0000","last_became_peered":"2020-04-02T23:21:30.497574+0000","last_unstale":"2020-04-02T23:21:40.549160+0000","last_undegraded":"2020-04-02T23:21:40.549160+0000","last_fullsized":"2020-04-02T23:21:40.549160+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":3,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:23.179251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:23.179251+0000","last_clean_scrub_stamp":"2020-04-02T23:21:23.179251+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"23'1","reported_seq":"11","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:21:41.538197+0000","last_change":"2020-04-02T23:21:40.158129+0000","last_active":"2020-04-02T23:21:41.538197+0000","last_peered":"2020-04-02T23:21:41.538197+0000","last_clean":"2020-04-02T23:21:41.538197+0000","last_became_active":"2020-04-02T23:21:40.157383+0000","last_became_peered":"2020-04-02T23:21:40.157383+0000","last_unstale":"2020-04-02T23:21:41.538197+0000","last_undegraded":"2020-04-02T23:21:41.538197+0000","last_fullsized":"2020-04-02T23:21:41.538197+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:39.137888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:39.137888+0000","last_clean_scrub_stamp":"2020-04-02T23:21:39.137888+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":"9","reported_epoch":"22","state":"active+clean","last_fresh":"2020-04-02T23:21:40.542052+0000","last_change":"2020-04-02T23:21:40.541839+0000","last_active":"2020-04-02T23:21:40.542052+0000","last_peered":"2020-04-02T23:21:40.542052+0000","last_clean":"2020-04-02T23:21:40.542052+0000","last_became_active":"2020-04-02T23:21:40.541400+0000","last_became_peered":"2020-04-02T23:21:40.541400+0000","last_unstale":"2020-04-02T23:21:40.542052+0000","last_undegraded":"2020-04-02T23:21:40.542052+0000","last_fullsized":"2020-04-02T23:21:40.542052+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:40.142809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:40.142809+0000","last_clean_scrub_stamp":"2020-04-02T23:21:40.142809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"12","reported_epoch":"22","state":"active+clean","last_fresh":"2020-04-02T23:21:40.536882+0000","last_change":"2020-04-02T23:21:37.134760+0000","last_active":"2020-04-02T23:21:40.536882+0000","last_peered":"2020-04-02T23:21:40.536882+0000","last_clean":"2020-04-02T23:21:40.536882+0000","last_became_active":"2020-04-02T23:21:37.134489+0000","last_became_peered":"2020-04-02T23:21:37.134489+0000","last_unstale":"2020-04-02T23:21:40.536882+0000","last_undegraded":"2020-04-02T23:21:40.536882+0000","last_fullsized":"2020-04-02T23:21:40.536882+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:36.120823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:36.120823+0000","last_clean_scrub_stamp":"2020-04-02T23:21:36.120823+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"10","reported_epoch":"22","state":"active+clean","last_fresh":"2020-04-02T23:21:40.539305+0000","last_change":"2020-04-02T23:21:40.160984+0000","last_active":"2020-04-02T23:21:40.539305+0000","last_peered":"2020-04-02T23:21:40.539305+0000","last_clean":"2020-04-02T23:21:40.539305+0000","last_became_active":"2020-04-02T23:21:40.160398+0000","last_became_peered":"2020-04-02T23:21:40.160398+0000","last_unstale":"2020-04-02T23:21:40.539305+0000","last_undegraded":"2020-04-02T23:21:40.539305+0000","last_fullsized":"2020-04-02T23:21:40.539305+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:39.137888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:39.137888+0000","last_clean_scrub_stamp":"2020-04-02T23:21:39.137888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":"9","reported_epoch":"22","state":"active+clean","last_fresh":"2020-04-02T23:21:40.550538+0000","last_change":"2020-04-02T23:21:40.550387+0000","last_active":"2020-04-02T23:21:40.550538+0000","last_peered":"2020-04-02T23:21:40.550538+0000","last_clean":"2020-04-02T23:21:40.550538+0000","last_became_active":"2020-04-02T23:21:40.550121+0000","last_became_peered":"2020-04-02T23:21:40.550121+0000","last_unstale":"2020-04-02T23:21:40.550538+0000","last_undegraded":"2020-04-02T23:21:40.550538+0000","last_fullsized":"2020-04-02T23:21:40.550538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:40.142809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:40.142809+0000","last_clean_scrub_stamp":"2020-04-02T23:21:40.142809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"12","reported_epoch":"22","state":"active+clean","last_fresh":"2020-04-02T23:21:40.537250+0000","last_change":"2020-04-02T23:21:37.134441+0000","last_active":"2020-04-02T23:21:40.537250+0000","last_peered":"2020-04-02T23:21:40.537250+0000","last_clean":"2020-04-02T23:21:40.537250+0000","last_became_active":"2020-04-02T23:21:37.134185+0000","last_became_peered":"2020-04-02T23:21:37.134185+0000","last_unstale":"2020-04-02T23:21:40.537250+0000","last_undegraded":"2020-04-02T23:21:40.537250+0000","last_fullsized":"2020-04-02T23:21:40.537250+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:36.120823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:36.120823+0000","last_clean_scrub_stamp":"2020-04-02T23:21:36.120823+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"23'8","reported_seq":"18","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:21:44.139810+0000","last_change":"2020-04-02T23:21:40.160705+0000","last_active":"2020-04-02T23:21:44.139810+0000","last_peered":"2020-04-02T23:21:44.139810+0000","last_clean":"2020-04-02T23:21:44.139810+0000","last_became_active":"2020-04-02T23:21:40.160330+0000","last_became_peered":"2020-04-02T23:21:40.160330+0000","last_unstale":"2020-04-02T23:21:44.139810+0000","last_undegraded":"2020-04-02T23:21:44.139810+0000","last_fullsized":"2020-04-02T23:21:44.139810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:39.137888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:39.137888+0000","last_clean_scrub_stamp":"2020-04-02T23:21:39.137888+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1526,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":"9","reported_epoch":"22","state":"active+clean","last_fresh":"2020-04-02T23:21:40.550154+0000","last_change":"2020-04-02T23:21:40.549980+0000","last_active":"2020-04-02T23:21:40.550154+0000","last_peered":"2020-04-02T23:21:40.550154+0000","last_clean":"2020-04-02T23:21:40.550154+0000","last_became_active":"2020-04-02T23:21:40.549674+0000","last_became_peered":"2020-04-02T23:21:40.549674+0000","last_unstale":"2020-04-02T23:21:40.550154+0000","last_undegraded":"2020-04-02T23:21:40.550154+0000","last_fullsized":"2020-04-02T23:21:40.550154+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:40.142809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:40.142809+0000","last_clean_scrub_stamp":"2020-04-02T23:21:40.142809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"23'7","reported_seq":"17","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:21:44.131674+0000","last_change":"2020-04-02T23:21:40.162904+0000","last_active":"2020-04-02T23:21:44.131674+0000","last_peered":"2020-04-02T23:21:44.131674+0000","last_clean":"2020-04-02T23:21:44.131674+0000","last_became_active":"2020-04-02T23:21:40.162580+0000","last_became_peered":"2020-04-02T23:21:40.162580+0000","last_unstale":"2020-04-02T23:21:44.131674+0000","last_undegraded":"2020-04-02T23:21:44.131674+0000","last_fullsized":"2020-04-02T23:21:44.131674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:39.137888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:39.137888+0000","last_clean_scrub_stamp":"2020-04-02T23:21:39.137888+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"13","reported_epoch":"22","state":"active+clean","last_fresh":"2020-04-02T23:21:40.540437+0000","last_change":"2020-04-02T23:21:37.743494+0000","last_active":"2020-04-02T23:21:40.540437+0000","last_peered":"2020-04-02T23:21:40.540437+0000","last_clean":"2020-04-02T23:21:40.540437+0000","last_became_active":"2020-04-02T23:21:37.743135+0000","last_became_peered":"2020-04-02T23:21:37.743135+0000","last_unstale":"2020-04-02T23:21:40.540437+0000","last_undegraded":"2020-04-02T23:21:40.540437+0000","last_fullsized":"2020-04-02T23:21:40.540437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:36.120823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:36.120823+0000","last_clean_scrub_stamp":"2020-04-02T23:21:36.120823+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"9","reported_epoch":"22","state":"active+clean","last_fresh":"2020-04-02T23:21:40.542356+0000","last_change":"2020-04-02T23:21:40.540076+0000","last_active":"2020-04-02T23:21:40.542356+0000","last_peered":"2020-04-02T23:21:40.542356+0000","last_clean":"2020-04-02T23:21:40.542356+0000","last_became_active":"2020-04-02T23:21:40.539853+0000","last_became_peered":"2020-04-02T23:21:40.539853+0000","last_unstale":"2020-04-02T23:21:40.542356+0000","last_undegraded":"2020-04-02T23:21:40.542356+0000","last_fullsized":"2020-04-02T23:21:40.542356+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:40.142809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:40.142809+0000","last_clean_scrub_stamp":"2020-04-02T23:21:40.142809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"12","reported_epoch":"22","state":"active+clean","last_fresh":"2020-04-02T23:21:40.536908+0000","last_change":"2020-04-02T23:21:37.743177+0000","last_active":"2020-04-02T23:21:40.536908+0000","last_peered":"2020-04-02T23:21:40.536908+0000","last_clean":"2020-04-02T23:21:40.536908+0000","last_became_active":"2020-04-02T23:21:37.742857+0000","last_became_peered":"2020-04-02T23:21:37.742857+0000","last_unstale":"2020-04-02T23:21:40.536908+0000","last_undegraded":"2020-04-02T23:21:40.536908+0000","last_fullsized":"2020-04-02T23:21:40.536908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:36.120823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:36.120823+0000","last_clean_scrub_stamp":"2020-04-02T23:21:36.120823+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'3","reported_seq":"13","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:21:44.128387+0000","last_change":"2020-04-02T23:21:40.162268+0000","last_active":"2020-04-02T23:21:44.128387+0000","last_peered":"2020-04-02T23:21:44.128387+0000","last_clean":"2020-04-02T23:21:44.128387+0000","last_became_active":"2020-04-02T23:21:40.161928+0000","last_became_peered":"2020-04-02T23:21:40.161928+0000","last_unstale":"2020-04-02T23:21:44.128387+0000","last_undegraded":"2020-04-02T23:21:44.128387+0000","last_fullsized":"2020-04-02T23:21:44.128387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:39.137888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:39.137888+0000","last_clean_scrub_stamp":"2020-04-02T23:21:39.137888+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":2286,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542151,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796132,"kb_used_data":92903248,"kb_used_omap":64,"kb_used_meta":0,"kb_avail":92903248,"statfs":{"total":95948165120,"available":95132925952,"internally_reserved":0,"allocated":95132925952,"data_stored":95132925952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":65723,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]}]},{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":10,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796436,"kb_used_data":92903040,"kb_used_omap":99,"kb_used_meta":0,"kb_avail":92902944,"statfs":{"total":95948165120,"available":95132614656,"internally_reserved":98304,"allocated":95132712960,"data_stored":95132712960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":102011,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]}]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796184,"kb_used_data":92903208,"kb_used_omap":53,"kb_used_meta":0,"kb_avail":92903196,"statfs":{"total":95948165120,"available":95132872704,"internally_reserved":12288,"allocated":95132884992,"data_stored":95132884992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":54827,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796232,"kb_used_data":92903184,"kb_used_omap":61,"kb_used_meta":0,"kb_avail":92903148,"statfs":{"total":95948165120,"available":95132823552,"internally_reserved":36864,"allocated":95132860416,"data_stored":95132860416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":63408,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]}]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796256,"kb_used_data":92903176,"kb_used_omap":73,"kb_used_meta":0,"kb_avail":92903124,"statfs":{"total":95948165120,"available":95132798976,"internally_reserved":53248,"allocated":95132852224,"data_stored":95132852224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":74803,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.217}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]}]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796184,"kb_used_data":92903208,"kb_used_omap":67,"kb_used_meta":0,"kb_avail":92903196,"statfs":{"total":95948165120,"available":95132872704,"internally_reserved":12288,"allocated":95132884992,"data_stored":95132884992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":68736,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796276,"kb_used_data":92903160,"kb_used_omap":71,"kb_used_meta":0,"kb_avail":92903104,"statfs":{"total":95948165120,"available":95132778496,"internally_reserved":57344,"allocated":95132835840,"data_stored":95132835840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":73545,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796144,"kb_used_data":92903236,"kb_used_omap":89,"kb_used_meta":0,"kb_avail":92903236,"statfs":{"total":95948165120,"available":95132913664,"internally_reserved":0,"allocated":95132913664,"data_stored":95132913664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":91374,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]}]}]}} 2020-04-02T23:21:51.891 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:51.916 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-04-02T23:21:52.063 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.051+0000 7fa73365b700 1 Processor -- start 2020-04-02T23:21:52.063 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.052+0000 7fa73365b700 1 -- start start 2020-04-02T23:21:52.063 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.052+0000 7fa73365b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa72c0a5f00 0x7fa72c0a9a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:52.063 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.052+0000 7fa73365b700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa72c13b600 0x7fa72c13ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:52.064 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.052+0000 7fa73365b700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa72c0a9150 con 0x7fa72c0a62e0 2020-04-02T23:21:52.064 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.052+0000 7fa73365b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa72c0aa720 con 0x7fa72c0a5f00 2020-04-02T23:21:52.064 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.052+0000 7fa73365b700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa72c0a6770 con 0x7fa72c13b600 2020-04-02T23:21:52.064 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.052+0000 7fa7313f7700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa72c0a5f00 0x7fa72c0a9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:52.064 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.052+0000 7fa7313f7700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa72c0a5f00 0x7fa72c0a9a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:40118/0 (socket says 172.21.15.174:40118) 2020-04-02T23:21:52.064 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.052+0000 7fa7313f7700 1 -- 172.21.15.174:0/3678070970 learned_addr learned my addr 172.21.15.174:0/3678070970 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:21:52.065 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.052+0000 7fa731bf8700 1 --2- 172.21.15.174:0/3678070970 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa72c13b600 0x7fa72c13ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:52.065 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.053+0000 7fa7313f7700 1 -- 172.21.15.174:0/3678070970 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa72c13b600 msgr2=0x7fa72c13ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:52.065 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.053+0000 7fa7313f7700 1 --2- 172.21.15.174:0/3678070970 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa72c13b600 0x7fa72c13ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:52.065 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.053+0000 7fa7313f7700 1 -- 172.21.15.174:0/3678070970 >> v1:172.21.15.196:6789/0 conn(0x7fa72c0a62e0 legacy=0x7fa72c05ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:52.065 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.053+0000 7fa7313f7700 1 -- 172.21.15.174:0/3678070970 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa72c05c3b0 con 0x7fa72c0a5f00 2020-04-02T23:21:52.065 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.053+0000 7fa7313f7700 1 --2- 172.21.15.174:0/3678070970 >> v2:172.21.15.174:3300/0 conn(0x7fa72c0a5f00 0x7fa72c0a9a90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa728002f30 tx=0x7fa72c0445b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:52.065 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.053+0000 7fa7313f7700 1 --2- 172.21.15.174:0/3678070970 >> v2:172.21.15.174:3300/0 conn(0x7fa72c0a5f00 0x7fa72c0a9a90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa728002f30 tx=0x7fa72c0445b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:52.065 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.053+0000 7fa7313f7700 1 --2- 172.21.15.174:0/3678070970 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa72c0a5f00 0x7fa72c0a9a90 secure :-1 s=READY pgs=158 cs=0 l=1 rx=0x7fa728002f30 tx=0x7fa72c0445b0).ready entity=mon.0 client_cookie=41a3d8a1d1388d1c server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:52.066 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.053+0000 7fa7313f7700 1 --2- 172.21.15.174:0/3678070970 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa72c0a5f00 0x7fa72c0a9a90 secure :-1 s=THROTTLE_DONE pgs=158 cs=0 l=1 rx=0x7fa728002f30 tx=0x7fa72c0445b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:52.066 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.053+0000 7fa71bfff700 1 -- 172.21.15.174:0/3678070970 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa728011670 con 0x7fa72c0a5f00 2020-04-02T23:21:52.066 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.053+0000 7fa7313f7700 1 --2- 172.21.15.174:0/3678070970 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa72c0a5f00 0x7fa72c0a9a90 secure :-1 s=THROTTLE_DONE pgs=158 cs=0 l=1 rx=0x7fa728002f30 tx=0x7fa72c0445b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:52.066 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.053+0000 7fa7313f7700 1 --2- 172.21.15.174:0/3678070970 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa72c0a5f00 0x7fa72c0a9a90 secure :-1 s=THROTTLE_DONE pgs=158 cs=0 l=1 rx=0x7fa728002f30 tx=0x7fa72c0445b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:52.066 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.053+0000 7fa71bfff700 1 -- 172.21.15.174:0/3678070970 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7280117d0 con 0x7fa72c0a5f00 2020-04-02T23:21:52.066 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.053+0000 7fa73365b700 1 -- 172.21.15.174:0/3678070970 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa72c0a5f00 msgr2=0x7fa72c0a9a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:52.066 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.053+0000 7fa73365b700 1 --2- 172.21.15.174:0/3678070970 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa72c0a5f00 0x7fa72c0a9a90 secure :-1 s=READY pgs=158 cs=0 l=1 rx=0x7fa728002f30 tx=0x7fa72c0445b0).stop 2020-04-02T23:21:52.067 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.053+0000 7fa71bfff700 1 -- 172.21.15.174:0/3678070970 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa728011bf0 con 0x7fa72c0a5f00 2020-04-02T23:21:52.067 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.053+0000 7fa73365b700 1 -- 172.21.15.174:0/3678070970 shutdown_connections 2020-04-02T23:21:52.067 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.053+0000 7fa73365b700 1 --2- 172.21.15.174:0/3678070970 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa72c13b600 0x7fa72c13ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:52.067 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.053+0000 7fa73365b700 1 --2- 172.21.15.174:0/3678070970 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa72c0a5f00 0x7fa72c0a9a90 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:52.067 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.053+0000 7fa73365b700 1 -- 172.21.15.174:0/3678070970 >> 172.21.15.174:0/3678070970 conn(0x7fa72c0ab320 msgr2=0x7fa72c0ab730 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:52.067 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.054+0000 7fa73365b700 1 -- 172.21.15.174:0/3678070970 shutdown_connections 2020-04-02T23:21:52.067 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.054+0000 7fa73365b700 1 -- 172.21.15.174:0/3678070970 wait complete. 2020-04-02T23:21:52.068 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.054+0000 7fa73365b700 1 Processor -- start 2020-04-02T23:21:52.068 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.054+0000 7fa73365b700 1 -- start start 2020-04-02T23:21:52.068 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.055+0000 7fa73365b700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fa72c13b600 0x7fa72c137f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:52.068 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.055+0000 7fa73365b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa72c149840 con 0x7fa72c0a5f00 2020-04-02T23:21:52.068 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.055+0000 7fa73365b700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa72c145800 con 0x7fa72c0a62e0 2020-04-02T23:21:52.068 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.055+0000 7fa73365b700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa72c145aa0 con 0x7fa72c13b600 2020-04-02T23:21:52.068 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.055+0000 7fa7313f7700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fa72c0a5f00 0x7fa72c148a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:45160/0 (socket says 172.21.15.174:45160) 2020-04-02T23:21:52.068 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.055+0000 7fa7313f7700 1 -- 172.21.15.174:0/2787875762 learned_addr learned my addr 172.21.15.174:0/2787875762 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:21:52.069 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.055+0000 7fa731bf8700 1 --2- 172.21.15.174:0/2787875762 >> v2:172.21.15.196:3300/0 conn(0x7fa72c13b600 0x7fa72c137f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:52.069 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.055+0000 7fa71a7fc700 1 -- 172.21.15.174:0/2787875762 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3844592567 0 0) 0x7fa72c149840 con 0x7fa72c0a5f00 2020-04-02T23:21:52.069 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.055+0000 7fa71a7fc700 1 -- 172.21.15.174:0/2787875762 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa70c002fe0 con 0x7fa72c0a5f00 2020-04-02T23:21:52.069 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.055+0000 7fa71a7fc700 1 -- 172.21.15.174:0/2787875762 <== mon.0 v1:172.21.15.174:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3803147281 0 0) 0x7fa70c002fe0 con 0x7fa72c0a5f00 2020-04-02T23:21:52.069 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.055+0000 7fa731bf8700 1 -- 172.21.15.174:0/2787875762 >> v1:172.21.15.196:6789/0 conn(0x7fa72c0a62e0 legacy=0x7fa72c149130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:52.069 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.056+0000 7fa731bf8700 1 -- 172.21.15.174:0/2787875762 >> v1:172.21.15.174:6789/0 conn(0x7fa72c0a5f00 legacy=0x7fa72c148a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:52.069 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.056+0000 7fa731bf8700 1 -- 172.21.15.174:0/2787875762 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa72c145d40 con 0x7fa72c13b600 2020-04-02T23:21:52.070 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.056+0000 7fa731bf8700 1 --2- 172.21.15.174:0/2787875762 >> v2:172.21.15.196:3300/0 conn(0x7fa72c13b600 0x7fa72c137f80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa728007aa0 tx=0x7fa724010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:52.070 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.056+0000 7fa731bf8700 1 --2- 172.21.15.174:0/2787875762 >> v2:172.21.15.196:3300/0 conn(0x7fa72c13b600 0x7fa72c137f80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa728007aa0 tx=0x7fa724010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:52.070 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.056+0000 7fa731bf8700 1 --2- 172.21.15.174:0/2787875762 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa72c13b600 0x7fa72c137f80 secure :-1 s=READY pgs=120 cs=0 l=1 rx=0x7fa728007aa0 tx=0x7fa724010ec0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:52.070 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.056+0000 7fa731bf8700 1 --2- 172.21.15.174:0/2787875762 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa72c13b600 0x7fa72c137f80 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7fa728007aa0 tx=0x7fa724010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:52.070 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.056+0000 7fa71a7fc700 1 -- 172.21.15.174:0/2787875762 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa728011e60 con 0x7fa72c13b600 2020-04-02T23:21:52.070 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.056+0000 7fa731bf8700 1 --2- 172.21.15.174:0/2787875762 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa72c13b600 0x7fa72c137f80 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7fa728007aa0 tx=0x7fa724010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:52.070 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.056+0000 7fa71a7fc700 1 -- 172.21.15.174:0/2787875762 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa72400e350 con 0x7fa72c13b600 2020-04-02T23:21:52.071 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.056+0000 7fa731bf8700 1 --2- 172.21.15.174:0/2787875762 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa72c13b600 0x7fa72c137f80 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7fa728007aa0 tx=0x7fa724010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:52.071 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.056+0000 7fa71a7fc700 1 -- 172.21.15.174:0/2787875762 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa724005c30 con 0x7fa72c13b600 2020-04-02T23:21:52.072 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.056+0000 7fa73365b700 1 -- 172.21.15.174:0/2787875762 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa72c135670 con 0x7fa72c13b600 2020-04-02T23:21:52.072 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.056+0000 7fa73365b700 1 -- 172.21.15.174:0/2787875762 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa72c1461e0 con 0x7fa72c13b600 2020-04-02T23:21:52.072 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.057+0000 7fa731bf8700 1 --2- 172.21.15.174:0/2787875762 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa72c13b600 0x7fa72c137f80 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7fa728007aa0 tx=0x7fa724010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:52.072 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.057+0000 7fa73365b700 1 -- 172.21.15.174:0/2787875762 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa72c145610 con 0x7fa72c13b600 2020-04-02T23:21:52.072 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.057+0000 7fa71a7fc700 1 -- 172.21.15.174:0/2787875762 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fa72400c900 con 0x7fa72c13b600 2020-04-02T23:21:52.072 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.057+0000 7fa731bf8700 1 --2- 172.21.15.174:0/2787875762 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa72c13b600 0x7fa72c137f80 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7fa728007aa0 tx=0x7fa724010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:52.073 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.058+0000 7fa71a7fc700 1 --2- 172.21.15.174:0/2787875762 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fa70c04d830 0x7fa70c04fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:52.073 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.058+0000 7fa71a7fc700 1 -- 172.21.15.174:0/2787875762 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa724060900 con 0x7fa72c13b600 2020-04-02T23:21:52.073 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.058+0000 7fa7313f7700 1 --2- 172.21.15.174:0/2787875762 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fa70c04d830 0x7fa70c04fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:52.073 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.058+0000 7fa7313f7700 1 --2- 172.21.15.174:0/2787875762 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fa70c04d830 0x7fa70c04fcf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa728007ae0 tx=0x7fa72c0445b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:52.073 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.058+0000 7fa7313f7700 1 --2- 172.21.15.174:0/2787875762 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fa70c04d830 0x7fa70c04fcf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa728007ae0 tx=0x7fa72c0445b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:52.073 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.058+0000 7fa7313f7700 1 --2- 172.21.15.174:0/2787875762 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fa70c04d830 0x7fa70c04fcf0 secure :-1 s=READY pgs=87 cs=0 l=1 rx=0x7fa728007ae0 tx=0x7fa72c0445b0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:52.074 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.061+0000 7fa731bf8700 1 --2- 172.21.15.174:0/2787875762 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa72c13b600 0x7fa72c137f80 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7fa728007aa0 tx=0x7fa724010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:52.074 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.061+0000 7fa71a7fc700 1 -- 172.21.15.174:0/2787875762 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fa72403c040 con 0x7fa72c13b600 2020-04-02T23:21:52.197 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.195+0000 7fa73365b700 1 -- 172.21.15.174:0/2787875762 --> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa72c145ed0 con 0x7fa70c04d830 2020-04-02T23:21:52.202 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.198+0000 7fa7313f7700 1 --2- 172.21.15.174:0/2787875762 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fa70c04d830 0x7fa70c04fcf0 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7fa728007ae0 tx=0x7fa72c0445b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:52.202 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.198+0000 7fa71a7fc700 1 -- 172.21.15.174:0/2787875762 <== mgr.4102 v2:172.21.15.196:6800/23210 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+82354 (secure 0 0 0) 0x7fa72c145ed0 con 0x7fa70c04d830 2020-04-02T23:21:52.202 INFO:teuthology.orchestra.run.smithi174.stdout: 2020-04-02T23:21:52.203 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.200+0000 7fa73365b700 1 -- 172.21.15.174:0/2787875762 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fa70c04d830 msgr2=0x7fa70c04fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:52.204 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.200+0000 7fa73365b700 1 --2- 172.21.15.174:0/2787875762 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fa70c04d830 0x7fa70c04fcf0 secure :-1 s=READY pgs=87 cs=0 l=1 rx=0x7fa728007ae0 tx=0x7fa72c0445b0).stop 2020-04-02T23:21:52.204 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.200+0000 7fa73365b700 1 -- 172.21.15.174:0/2787875762 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa72c13b600 msgr2=0x7fa72c137f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:52.204 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.200+0000 7fa73365b700 1 --2- 172.21.15.174:0/2787875762 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa72c13b600 0x7fa72c137f80 secure :-1 s=READY pgs=120 cs=0 l=1 rx=0x7fa728007aa0 tx=0x7fa724010ec0).stop 2020-04-02T23:21:52.204 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.200+0000 7fa73365b700 1 -- 172.21.15.174:0/2787875762 shutdown_connections 2020-04-02T23:21:52.204 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.200+0000 7fa73365b700 1 --2- 172.21.15.174:0/2787875762 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa72c13b600 0x7fa72c137f80 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:52.205 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.200+0000 7fa73365b700 1 --2- 172.21.15.174:0/2787875762 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fa70c04d830 0x7fa70c04fcf0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:52.205 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.200+0000 7fa73365b700 1 -- 172.21.15.174:0/2787875762 >> 172.21.15.174:0/2787875762 conn(0x7fa72c0ab320 msgr2=0x7fa72c0ab700 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:52.205 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.200+0000 7fa73365b700 1 -- 172.21.15.174:0/2787875762 shutdown_connections 2020-04-02T23:21:52.205 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.200+0000 7fa73365b700 1 -- 172.21.15.174:0/2787875762 wait complete. 2020-04-02T23:21:52.205 INFO:teuthology.orchestra.run.smithi174.stderr:dumped all 2020-04-02T23:21:52.213 INFO:teuthology.orchestra.run.smithi174.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2020-04-02T23:21:52.186618+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2286,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":50,"acting":50,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":749595040,"kb_used":6369128,"kb_used_data":743225920,"kb_used_omap":583,"kb_used_meta":0,"kb_avail":743225912,"statfs":{"total":767585320960,"available":761063333888,"internally_reserved":8192,"allocated":761063342080,"data_stored":761063342080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":597969,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2286,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.649116"},"pg_stats":[{"pgid":"4.2","version":"0'0","reported_seq":"9","reported_epoch":"22","state":"active+clean","last_fresh":"2020-04-02T23:21:40.542177+0000","last_change":"2020-04-02T23:21:40.541967+0000","last_active":"2020-04-02T23:21:40.542177+0000","last_peered":"2020-04-02T23:21:40.542177+0000","last_clean":"2020-04-02T23:21:40.542177+0000","last_became_active":"2020-04-02T23:21:40.541485+0000","last_became_peered":"2020-04-02T23:21:40.541485+0000","last_unstale":"2020-04-02T23:21:40.542177+0000","last_undegraded":"2020-04-02T23:21:40.542177+0000","last_fullsized":"2020-04-02T23:21:40.542177+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:40.142809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:40.142809+0000","last_clean_scrub_stamp":"2020-04-02T23:21:40.142809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"12","reported_epoch":"22","state":"active+clean","last_fresh":"2020-04-02T23:21:40.539398+0000","last_change":"2020-04-02T23:21:37.552581+0000","last_active":"2020-04-02T23:21:40.539398+0000","last_peered":"2020-04-02T23:21:40.539398+0000","last_clean":"2020-04-02T23:21:40.539398+0000","last_became_active":"2020-04-02T23:21:37.552244+0000","last_became_peered":"2020-04-02T23:21:37.552244+0000","last_unstale":"2020-04-02T23:21:40.539398+0000","last_undegraded":"2020-04-02T23:21:40.539398+0000","last_fullsized":"2020-04-02T23:21:40.539398+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:36.120823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:36.120823+0000","last_clean_scrub_stamp":"2020-04-02T23:21:36.120823+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"23'6","reported_seq":"16","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:21:44.137875+0000","last_change":"2020-04-02T23:21:40.162228+0000","last_active":"2020-04-02T23:21:44.137875+0000","last_peered":"2020-04-02T23:21:44.137875+0000","last_clean":"2020-04-02T23:21:44.137875+0000","last_became_active":"2020-04-02T23:21:40.161797+0000","last_became_peered":"2020-04-02T23:21:40.161797+0000","last_unstale":"2020-04-02T23:21:44.137875+0000","last_undegraded":"2020-04-02T23:21:44.137875+0000","last_fullsized":"2020-04-02T23:21:44.137875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:39.137888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:39.137888+0000","last_clean_scrub_stamp":"2020-04-02T23:21:39.137888+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":"9","reported_epoch":"22","state":"active+clean","last_fresh":"2020-04-02T23:21:40.542907+0000","last_change":"2020-04-02T23:21:40.542743+0000","last_active":"2020-04-02T23:21:40.542907+0000","last_peered":"2020-04-02T23:21:40.542907+0000","last_clean":"2020-04-02T23:21:40.542907+0000","last_became_active":"2020-04-02T23:21:40.542398+0000","last_became_peered":"2020-04-02T23:21:40.542398+0000","last_unstale":"2020-04-02T23:21:40.542907+0000","last_undegraded":"2020-04-02T23:21:40.542907+0000","last_fullsized":"2020-04-02T23:21:40.542907+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:40.142809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:40.142809+0000","last_clean_scrub_stamp":"2020-04-02T23:21:40.142809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"12","reported_epoch":"22","state":"active+clean","last_fresh":"2020-04-02T23:21:40.536883+0000","last_change":"2020-04-02T23:21:37.552581+0000","last_active":"2020-04-02T23:21:40.536883+0000","last_peered":"2020-04-02T23:21:40.536883+0000","last_clean":"2020-04-02T23:21:40.536883+0000","last_became_active":"2020-04-02T23:21:37.552288+0000","last_became_peered":"2020-04-02T23:21:37.552288+0000","last_unstale":"2020-04-02T23:21:40.536883+0000","last_undegraded":"2020-04-02T23:21:40.536883+0000","last_fullsized":"2020-04-02T23:21:40.536883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:36.120823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:36.120823+0000","last_clean_scrub_stamp":"2020-04-02T23:21:36.120823+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"23'5","reported_seq":"15","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:21:44.125744+0000","last_change":"2020-04-02T23:21:40.158169+0000","last_active":"2020-04-02T23:21:44.125744+0000","last_peered":"2020-04-02T23:21:44.125744+0000","last_clean":"2020-04-02T23:21:44.125744+0000","last_became_active":"2020-04-02T23:21:40.157809+0000","last_became_peered":"2020-04-02T23:21:40.157809+0000","last_unstale":"2020-04-02T23:21:44.125744+0000","last_undegraded":"2020-04-02T23:21:44.125744+0000","last_fullsized":"2020-04-02T23:21:44.125744+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:39.137888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:39.137888+0000","last_clean_scrub_stamp":"2020-04-02T23:21:39.137888+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":"9","reported_epoch":"22","state":"active+clean","last_fresh":"2020-04-02T23:21:40.552097+0000","last_change":"2020-04-02T23:21:40.551966+0000","last_active":"2020-04-02T23:21:40.552097+0000","last_peered":"2020-04-02T23:21:40.552097+0000","last_clean":"2020-04-02T23:21:40.552097+0000","last_became_active":"2020-04-02T23:21:40.551607+0000","last_became_peered":"2020-04-02T23:21:40.551607+0000","last_unstale":"2020-04-02T23:21:40.552097+0000","last_undegraded":"2020-04-02T23:21:40.552097+0000","last_fullsized":"2020-04-02T23:21:40.552097+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:40.142809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:40.142809+0000","last_clean_scrub_stamp":"2020-04-02T23:21:40.142809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"12","reported_epoch":"22","state":"active+clean","last_fresh":"2020-04-02T23:21:40.537856+0000","last_change":"2020-04-02T23:21:37.135095+0000","last_active":"2020-04-02T23:21:40.537856+0000","last_peered":"2020-04-02T23:21:40.537856+0000","last_clean":"2020-04-02T23:21:40.537856+0000","last_became_active":"2020-04-02T23:21:37.134712+0000","last_became_peered":"2020-04-02T23:21:37.134712+0000","last_unstale":"2020-04-02T23:21:40.537856+0000","last_undegraded":"2020-04-02T23:21:40.537856+0000","last_fullsized":"2020-04-02T23:21:40.537856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:36.120823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:36.120823+0000","last_clean_scrub_stamp":"2020-04-02T23:21:36.120823+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"23'8","reported_seq":"18","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:21:44.129789+0000","last_change":"2020-04-02T23:21:40.162349+0000","last_active":"2020-04-02T23:21:44.129789+0000","last_peered":"2020-04-02T23:21:44.129789+0000","last_clean":"2020-04-02T23:21:44.129789+0000","last_became_active":"2020-04-02T23:21:40.161970+0000","last_became_peered":"2020-04-02T23:21:40.161970+0000","last_unstale":"2020-04-02T23:21:44.129789+0000","last_undegraded":"2020-04-02T23:21:44.129789+0000","last_fullsized":"2020-04-02T23:21:44.129789+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:39.137888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:39.137888+0000","last_clean_scrub_stamp":"2020-04-02T23:21:39.137888+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":"9","reported_epoch":"22","state":"active+clean","last_fresh":"2020-04-02T23:21:40.550172+0000","last_change":"2020-04-02T23:21:40.550015+0000","last_active":"2020-04-02T23:21:40.550172+0000","last_peered":"2020-04-02T23:21:40.550172+0000","last_clean":"2020-04-02T23:21:40.550172+0000","last_became_active":"2020-04-02T23:21:40.549758+0000","last_became_peered":"2020-04-02T23:21:40.549758+0000","last_unstale":"2020-04-02T23:21:40.550172+0000","last_undegraded":"2020-04-02T23:21:40.550172+0000","last_fullsized":"2020-04-02T23:21:40.550172+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:40.142809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:40.142809+0000","last_clean_scrub_stamp":"2020-04-02T23:21:40.142809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"12","reported_epoch":"22","state":"active+clean","last_fresh":"2020-04-02T23:21:40.536894+0000","last_change":"2020-04-02T23:21:37.691403+0000","last_active":"2020-04-02T23:21:40.536894+0000","last_peered":"2020-04-02T23:21:40.536894+0000","last_clean":"2020-04-02T23:21:40.536894+0000","last_became_active":"2020-04-02T23:21:37.691080+0000","last_became_peered":"2020-04-02T23:21:37.691080+0000","last_unstale":"2020-04-02T23:21:40.536894+0000","last_undegraded":"2020-04-02T23:21:40.536894+0000","last_fullsized":"2020-04-02T23:21:40.536894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:36.120823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:36.120823+0000","last_clean_scrub_stamp":"2020-04-02T23:21:36.120823+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'2","reported_seq":"16","reported_epoch":"22","state":"active+clean","last_fresh":"2020-04-02T23:21:40.549160+0000","last_change":"2020-04-02T23:21:30.497862+0000","last_active":"2020-04-02T23:21:40.549160+0000","last_peered":"2020-04-02T23:21:40.549160+0000","last_clean":"2020-04-02T23:21:40.549160+0000","last_became_active":"2020-04-02T23:21:30.497574+0000","last_became_peered":"2020-04-02T23:21:30.497574+0000","last_unstale":"2020-04-02T23:21:40.549160+0000","last_undegraded":"2020-04-02T23:21:40.549160+0000","last_fullsized":"2020-04-02T23:21:40.549160+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":3,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:23.179251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:23.179251+0000","last_clean_scrub_stamp":"2020-04-02T23:21:23.179251+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"23'1","reported_seq":"11","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:21:41.538197+0000","last_change":"2020-04-02T23:21:40.158129+0000","last_active":"2020-04-02T23:21:41.538197+0000","last_peered":"2020-04-02T23:21:41.538197+0000","last_clean":"2020-04-02T23:21:41.538197+0000","last_became_active":"2020-04-02T23:21:40.157383+0000","last_became_peered":"2020-04-02T23:21:40.157383+0000","last_unstale":"2020-04-02T23:21:41.538197+0000","last_undegraded":"2020-04-02T23:21:41.538197+0000","last_fullsized":"2020-04-02T23:21:41.538197+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:39.137888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:39.137888+0000","last_clean_scrub_stamp":"2020-04-02T23:21:39.137888+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":"9","reported_epoch":"22","state":"active+clean","last_fresh":"2020-04-02T23:21:40.542052+0000","last_change":"2020-04-02T23:21:40.541839+0000","last_active":"2020-04-02T23:21:40.542052+0000","last_peered":"2020-04-02T23:21:40.542052+0000","last_clean":"2020-04-02T23:21:40.542052+0000","last_became_active":"2020-04-02T23:21:40.541400+0000","last_became_peered":"2020-04-02T23:21:40.541400+0000","last_unstale":"2020-04-02T23:21:40.542052+0000","last_undegraded":"2020-04-02T23:21:40.542052+0000","last_fullsized":"2020-04-02T23:21:40.542052+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:40.142809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:40.142809+0000","last_clean_scrub_stamp":"2020-04-02T23:21:40.142809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"12","reported_epoch":"22","state":"active+clean","last_fresh":"2020-04-02T23:21:40.536882+0000","last_change":"2020-04-02T23:21:37.134760+0000","last_active":"2020-04-02T23:21:40.536882+0000","last_peered":"2020-04-02T23:21:40.536882+0000","last_clean":"2020-04-02T23:21:40.536882+0000","last_became_active":"2020-04-02T23:21:37.134489+0000","last_became_peered":"2020-04-02T23:21:37.134489+0000","last_unstale":"2020-04-02T23:21:40.536882+0000","last_undegraded":"2020-04-02T23:21:40.536882+0000","last_fullsized":"2020-04-02T23:21:40.536882+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:36.120823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:36.120823+0000","last_clean_scrub_stamp":"2020-04-02T23:21:36.120823+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"10","reported_epoch":"22","state":"active+clean","last_fresh":"2020-04-02T23:21:40.539305+0000","last_change":"2020-04-02T23:21:40.160984+0000","last_active":"2020-04-02T23:21:40.539305+0000","last_peered":"2020-04-02T23:21:40.539305+0000","last_clean":"2020-04-02T23:21:40.539305+0000","last_became_active":"2020-04-02T23:21:40.160398+0000","last_became_peered":"2020-04-02T23:21:40.160398+0000","last_unstale":"2020-04-02T23:21:40.539305+0000","last_undegraded":"2020-04-02T23:21:40.539305+0000","last_fullsized":"2020-04-02T23:21:40.539305+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:39.137888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:39.137888+0000","last_clean_scrub_stamp":"2020-04-02T23:21:39.137888+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":"9","reported_epoch":"22","state":"active+clean","last_fresh":"2020-04-02T23:21:40.550538+0000","last_change":"2020-04-02T23:21:40.550387+0000","last_active":"2020-04-02T23:21:40.550538+0000","last_peered":"2020-04-02T23:21:40.550538+0000","last_clean":"2020-04-02T23:21:40.550538+0000","last_became_active":"2020-04-02T23:21:40.550121+0000","last_became_peered":"2020-04-02T23:21:40.550121+0000","last_unstale":"2020-04-02T23:21:40.550538+0000","last_undegraded":"2020-04-02T23:21:40.550538+0000","last_fullsized":"2020-04-02T23:21:40.550538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:40.142809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:40.142809+0000","last_clean_scrub_stamp":"2020-04-02T23:21:40.142809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"12","reported_epoch":"22","state":"active+clean","last_fresh":"2020-04-02T23:21:40.537250+0000","last_change":"2020-04-02T23:21:37.134441+0000","last_active":"2020-04-02T23:21:40.537250+0000","last_peered":"2020-04-02T23:21:40.537250+0000","last_clean":"2020-04-02T23:21:40.537250+0000","last_became_active":"2020-04-02T23:21:37.134185+0000","last_became_peered":"2020-04-02T23:21:37.134185+0000","last_unstale":"2020-04-02T23:21:40.537250+0000","last_undegraded":"2020-04-02T23:21:40.537250+0000","last_fullsized":"2020-04-02T23:21:40.537250+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:36.120823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:36.120823+0000","last_clean_scrub_stamp":"2020-04-02T23:21:36.120823+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"23'8","reported_seq":"18","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:21:44.139810+0000","last_change":"2020-04-02T23:21:40.160705+0000","last_active":"2020-04-02T23:21:44.139810+0000","last_peered":"2020-04-02T23:21:44.139810+0000","last_clean":"2020-04-02T23:21:44.139810+0000","last_became_active":"2020-04-02T23:21:40.160330+0000","last_became_peered":"2020-04-02T23:21:40.160330+0000","last_unstale":"2020-04-02T23:21:44.139810+0000","last_undegraded":"2020-04-02T23:21:44.139810+0000","last_fullsized":"2020-04-02T23:21:44.139810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:39.137888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:39.137888+0000","last_clean_scrub_stamp":"2020-04-02T23:21:39.137888+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1526,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":"9","reported_epoch":"22","state":"active+clean","last_fresh":"2020-04-02T23:21:40.550154+0000","last_change":"2020-04-02T23:21:40.549980+0000","last_active":"2020-04-02T23:21:40.550154+0000","last_peered":"2020-04-02T23:21:40.550154+0000","last_clean":"2020-04-02T23:21:40.550154+0000","last_became_active":"2020-04-02T23:21:40.549674+0000","last_became_peered":"2020-04-02T23:21:40.549674+0000","last_unstale":"2020-04-02T23:21:40.550154+0000","last_undegraded":"2020-04-02T23:21:40.550154+0000","last_fullsized":"2020-04-02T23:21:40.550154+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:40.142809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:40.142809+0000","last_clean_scrub_stamp":"2020-04-02T23:21:40.142809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"23'7","reported_seq":"17","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:21:44.131674+0000","last_change":"2020-04-02T23:21:40.162904+0000","last_active":"2020-04-02T23:21:44.131674+0000","last_peered":"2020-04-02T23:21:44.131674+0000","last_clean":"2020-04-02T23:21:44.131674+0000","last_became_active":"2020-04-02T23:21:40.162580+0000","last_became_peered":"2020-04-02T23:21:40.162580+0000","last_unstale":"2020-04-02T23:21:44.131674+0000","last_undegraded":"2020-04-02T23:21:44.131674+0000","last_fullsized":"2020-04-02T23:21:44.131674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:39.137888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:39.137888+0000","last_clean_scrub_stamp":"2020-04-02T23:21:39.137888+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"13","reported_epoch":"22","state":"active+clean","last_fresh":"2020-04-02T23:21:40.540437+0000","last_change":"2020-04-02T23:21:37.743494+0000","last_active":"2020-04-02T23:21:40.540437+0000","last_peered":"2020-04-02T23:21:40.540437+0000","last_clean":"2020-04-02T23:21:40.540437+0000","last_became_active":"2020-04-02T23:21:37.743135+0000","last_became_peered":"2020-04-02T23:21:37.743135+0000","last_unstale":"2020-04-02T23:21:40.540437+0000","last_undegraded":"2020-04-02T23:21:40.540437+0000","last_fullsized":"2020-04-02T23:21:40.540437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:36.120823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:36.120823+0000","last_clean_scrub_stamp":"2020-04-02T23:21:36.120823+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"9","reported_epoch":"22","state":"active+clean","last_fresh":"2020-04-02T23:21:40.542356+0000","last_change":"2020-04-02T23:21:40.540076+0000","last_active":"2020-04-02T23:21:40.542356+0000","last_peered":"2020-04-02T23:21:40.542356+0000","last_clean":"2020-04-02T23:21:40.542356+0000","last_became_active":"2020-04-02T23:21:40.539853+0000","last_became_peered":"2020-04-02T23:21:40.539853+0000","last_unstale":"2020-04-02T23:21:40.542356+0000","last_undegraded":"2020-04-02T23:21:40.542356+0000","last_fullsized":"2020-04-02T23:21:40.542356+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:40.142809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:40.142809+0000","last_clean_scrub_stamp":"2020-04-02T23:21:40.142809+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"12","reported_epoch":"22","state":"active+clean","last_fresh":"2020-04-02T23:21:40.536908+0000","last_change":"2020-04-02T23:21:37.743177+0000","last_active":"2020-04-02T23:21:40.536908+0000","last_peered":"2020-04-02T23:21:40.536908+0000","last_clean":"2020-04-02T23:21:40.536908+0000","last_became_active":"2020-04-02T23:21:37.742857+0000","last_became_peered":"2020-04-02T23:21:37.742857+0000","last_unstale":"2020-04-02T23:21:40.536908+0000","last_undegraded":"2020-04-02T23:21:40.536908+0000","last_fullsized":"2020-04-02T23:21:40.536908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:36.120823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:36.120823+0000","last_clean_scrub_stamp":"2020-04-02T23:21:36.120823+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'4","reported_seq":"14","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:21:44.129323+0000","last_change":"2020-04-02T23:21:40.162268+0000","last_active":"2020-04-02T23:21:44.129323+0000","last_peered":"2020-04-02T23:21:44.129323+0000","last_clean":"2020-04-02T23:21:44.129323+0000","last_became_active":"2020-04-02T23:21:40.161928+0000","last_became_peered":"2020-04-02T23:21:40.161928+0000","last_unstale":"2020-04-02T23:21:44.129323+0000","last_undegraded":"2020-04-02T23:21:44.129323+0000","last_fullsized":"2020-04-02T23:21:44.129323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:39.137888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:39.137888+0000","last_clean_scrub_stamp":"2020-04-02T23:21:39.137888+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":2286,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542152,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796136,"kb_used_data":92903248,"kb_used_omap":65,"kb_used_meta":0,"kb_avail":92903244,"statfs":{"total":95948165120,"available":95132921856,"internally_reserved":4096,"allocated":95132925952,"data_stored":95132925952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":67344,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.316}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]}]},{"osd":6,"up_from":14,"seq":60129542152,"num_pgs":10,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796160,"kb_used_data":92903220,"kb_used_omap":99,"kb_used_meta":0,"kb_avail":92903220,"statfs":{"total":95948165120,"available":95132897280,"internally_reserved":0,"allocated":95132897280,"data_stored":95132897280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":102061,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]}]},{"osd":1,"up_from":14,"seq":60129542151,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796132,"kb_used_data":92903248,"kb_used_omap":53,"kb_used_meta":0,"kb_avail":92903248,"statfs":{"total":95948165120,"available":95132925952,"internally_reserved":0,"allocated":95132925952,"data_stored":95132925952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":54877,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.247}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]}]},{"osd":0,"up_from":14,"seq":60129542151,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796136,"kb_used_data":92903244,"kb_used_omap":61,"kb_used_meta":0,"kb_avail":92903244,"statfs":{"total":95948165120,"available":95132921856,"internally_reserved":0,"allocated":95132921856,"data_stored":95132921856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":63458,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542151,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796144,"kb_used_data":92903236,"kb_used_omap":73,"kb_used_meta":0,"kb_avail":92903236,"statfs":{"total":95948165120,"available":95132913664,"internally_reserved":0,"allocated":95132913664,"data_stored":95132913664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":74853,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.217}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]}]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796132,"kb_used_data":92903248,"kb_used_omap":67,"kb_used_meta":0,"kb_avail":92903248,"statfs":{"total":95948165120,"available":95132925952,"internally_reserved":0,"allocated":95132925952,"data_stored":95132925952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":68786,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542151,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796144,"kb_used_data":92903240,"kb_used_omap":73,"kb_used_meta":0,"kb_avail":92903236,"statfs":{"total":95948165120,"available":95132913664,"internally_reserved":4096,"allocated":95132917760,"data_stored":95132917760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":75216,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]}]},{"osd":5,"up_from":14,"seq":60129542151,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796144,"kb_used_data":92903236,"kb_used_omap":89,"kb_used_meta":0,"kb_avail":92903236,"statfs":{"total":95948165120,"available":95132913664,"internally_reserved":0,"allocated":95132913664,"data_stored":95132913664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":91374,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]}]}]}} 2020-04-02T23:21:52.216 INFO:tasks.ceph.ceph_manager.ceph:clean! 2020-04-02T23:21:52.216 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2020-04-02T23:21:52.217 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2020-04-02T23:21:52.217 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:52.230 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early health --format=json 2020-04-02T23:21:52.374 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.372+0000 7f6d75810700 1 Processor -- start 2020-04-02T23:21:52.375 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.372+0000 7f6d75810700 1 -- start start 2020-04-02T23:21:52.382 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.372+0000 7f6d75810700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f6d7009e300 0x7f6d700a4b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:52.383 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.372+0000 7f6d75810700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d700a10a0 con 0x7f6d701382e0 2020-04-02T23:21:52.383 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.372+0000 7f6d75810700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d700a2a90 con 0x7f6d700a4f90 2020-04-02T23:21:52.383 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.372+0000 7f6d75810700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d700a2d30 con 0x7f6d7009e300 2020-04-02T23:21:52.383 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.373+0000 7f6d7500f700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f6d701382e0 0x7f6d7013f120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:45172/0 (socket says 172.21.15.174:45172) 2020-04-02T23:21:52.383 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.373+0000 7f6d7500f700 1 -- 172.21.15.174:0/1547065283 learned_addr learned my addr 172.21.15.174:0/1547065283 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:21:52.383 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.373+0000 7f6d6f7fe700 1 -- 172.21.15.174:0/1547065283 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 115696161 0 0) 0x7f6d700a10a0 con 0x7f6d701382e0 2020-04-02T23:21:52.384 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.373+0000 7f6d7480e700 1 --2- 172.21.15.174:0/1547065283 >> v2:172.21.15.196:3300/0 conn(0x7f6d7009e300 0x7f6d700a4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:52.384 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.373+0000 7f6d6f7fe700 1 -- 172.21.15.174:0/1547065283 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d5c003230 con 0x7f6d701382e0 2020-04-02T23:21:52.384 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.373+0000 7f6d6f7fe700 1 -- 172.21.15.174:0/1547065283 <== mon.0 v1:172.21.15.174:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 532778029 0 0) 0x7f6d5c003230 con 0x7f6d701382e0 2020-04-02T23:21:52.384 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.373+0000 7f6d6f7fe700 1 -- 172.21.15.174:0/1547065283 >> v2:172.21.15.196:3300/0 conn(0x7f6d7009e300 msgr2=0x7f6d700a4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:52.384 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.373+0000 7f6d6f7fe700 1 --2- 172.21.15.174:0/1547065283 >> v2:172.21.15.196:3300/0 conn(0x7f6d7009e300 0x7f6d700a4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:52.384 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.373+0000 7f6d6f7fe700 1 -- 172.21.15.174:0/1547065283 >> v1:172.21.15.196:6789/0 conn(0x7f6d700a4f90 legacy=0x7f6d70137bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:52.384 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.373+0000 7f6d6f7fe700 1 -- 172.21.15.174:0/1547065283 --> v1:172.21.15.174:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d7009e6e0 con 0x7f6d701382e0 2020-04-02T23:21:52.385 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.373+0000 7f6d6f7fe700 1 -- 172.21.15.174:0/1547065283 <== mon.0 v1:172.21.15.174:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2811762909 0 0) 0x7f6d68001a50 con 0x7f6d701382e0 2020-04-02T23:21:52.385 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.373+0000 7f6d6f7fe700 1 -- 172.21.15.174:0/1547065283 >> v1:172.21.15.174:6789/0 conn(0x7f6d701382e0 legacy=0x7f6d7013f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:52.385 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.373+0000 7f6d6f7fe700 1 --2- 172.21.15.174:0/1547065283 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d5c003720 0x7f6d5c003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:52.385 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.373+0000 7f6d6f7fe700 1 --2- 172.21.15.174:0/1547065283 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d5c0044d0 0x7f6d5c004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:52.385 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.373+0000 7f6d6f7fe700 1 --2- 172.21.15.174:0/1547065283 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6d5c004db0 0x7f6d5c00b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:52.385 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.373+0000 7f6d6f7fe700 1 -- 172.21.15.174:0/1547065283 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d700a2d30 con 0x7f6d5c003720 2020-04-02T23:21:52.385 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.373+0000 7f6d6f7fe700 1 -- 172.21.15.174:0/1547065283 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5c0041c0 con 0x7f6d5c0044d0 2020-04-02T23:21:52.385 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.373+0000 7f6d6f7fe700 1 -- 172.21.15.174:0/1547065283 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5c00bb80 con 0x7f6d5c004db0 2020-04-02T23:21:52.386 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.373+0000 7f6d7480e700 1 --2- 172.21.15.174:0/1547065283 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d5c003720 0x7f6d5c003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:52.386 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.373+0000 7f6d6ffff700 1 --2- 172.21.15.174:0/1547065283 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d5c0044d0 0x7f6d5c004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:52.386 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.373+0000 7f6d7500f700 1 --2- 172.21.15.174:0/1547065283 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6d5c004db0 0x7f6d5c00b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:52.386 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.373+0000 7f6d7480e700 1 -- 172.21.15.174:0/1547065283 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6d5c004db0 msgr2=0x7f6d5c00b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:52.386 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.373+0000 7f6d7480e700 1 --2- 172.21.15.174:0/1547065283 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6d5c004db0 0x7f6d5c00b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:52.386 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.373+0000 7f6d7480e700 1 -- 172.21.15.174:0/1547065283 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d5c0044d0 msgr2=0x7f6d5c004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:52.386 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.373+0000 7f6d7480e700 1 --2- 172.21.15.174:0/1547065283 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d5c0044d0 0x7f6d5c004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:52.387 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.373+0000 7f6d7500f700 1 -- 172.21.15.174:0/1547065283 reap_dead start 2020-04-02T23:21:52.387 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.373+0000 7f6d7480e700 1 -- 172.21.15.174:0/1547065283 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d5c003230 con 0x7f6d5c003720 2020-04-02T23:21:52.387 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.374+0000 7f6d7480e700 1 --2- 172.21.15.174:0/1547065283 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d5c003720 0x7f6d5c003b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6d60002f30 tx=0x7f6d60007dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:52.387 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.374+0000 7f6d7480e700 1 --2- 172.21.15.174:0/1547065283 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d5c003720 0x7f6d5c003b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6d60002f30 tx=0x7f6d60007dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:52.387 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.374+0000 7f6d7480e700 1 --2- 172.21.15.174:0/1547065283 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d5c003720 0x7f6d5c003b40 secure :-1 s=READY pgs=161 cs=0 l=1 rx=0x7f6d60002f30 tx=0x7f6d60007dd0).ready entity=mon.0 client_cookie=8fb3b5cd7ffd14d9 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:52.389 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.374+0000 7f6d7480e700 1 --2- 172.21.15.174:0/1547065283 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d5c003720 0x7f6d5c003b40 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7f6d60002f30 tx=0x7f6d60007dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:52.390 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.374+0000 7f6d6f7fe700 1 -- 172.21.15.174:0/1547065283 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d60008d30 con 0x7f6d5c003720 2020-04-02T23:21:52.391 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.374+0000 7f6d7480e700 1 --2- 172.21.15.174:0/1547065283 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d5c003720 0x7f6d5c003b40 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7f6d60002f30 tx=0x7f6d60007dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:52.391 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.374+0000 7f6d7480e700 1 --2- 172.21.15.174:0/1547065283 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d5c003720 0x7f6d5c003b40 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7f6d60002f30 tx=0x7f6d60007dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:52.391 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.374+0000 7f6d6f7fe700 1 -- 172.21.15.174:0/1547065283 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d60008e90 con 0x7f6d5c003720 2020-04-02T23:21:52.392 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.374+0000 7f6d6f7fe700 1 -- 172.21.15.174:0/1547065283 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d60010a30 con 0x7f6d5c003720 2020-04-02T23:21:52.392 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.374+0000 7f6d75810700 1 -- 172.21.15.174:0/1547065283 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d5c003720 msgr2=0x7f6d5c003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:52.392 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.374+0000 7f6d75810700 1 --2- 172.21.15.174:0/1547065283 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d5c003720 0x7f6d5c003b40 secure :-1 s=READY pgs=161 cs=0 l=1 rx=0x7f6d60002f30 tx=0x7f6d60007dd0).stop 2020-04-02T23:21:52.392 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.374+0000 7f6d75810700 1 -- 172.21.15.174:0/1547065283 shutdown_connections 2020-04-02T23:21:52.392 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.374+0000 7f6d75810700 1 --2- 172.21.15.174:0/1547065283 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d5c003720 0x7f6d5c003b40 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:52.392 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.374+0000 7f6d75810700 1 -- 172.21.15.174:0/1547065283 >> 172.21.15.174:0/1547065283 conn(0x7f6d700a6d00 msgr2=0x7f6d700a7110 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:52.392 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.374+0000 7f6d75810700 1 -- 172.21.15.174:0/1547065283 shutdown_connections 2020-04-02T23:21:52.393 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.374+0000 7f6d75810700 1 -- 172.21.15.174:0/1547065283 wait complete. 2020-04-02T23:21:52.393 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.375+0000 7f6d75810700 1 Processor -- start 2020-04-02T23:21:52.393 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.375+0000 7f6d75810700 1 -- start start 2020-04-02T23:21:52.393 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.376+0000 7f6d75810700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6d7012f5b0 0x7f6d70146fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:52.393 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.376+0000 7f6d75810700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d700a7a30 con 0x7f6d7012e310 2020-04-02T23:21:52.393 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.376+0000 7f6d75810700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d700a7500 con 0x7f6d5c003720 2020-04-02T23:21:52.393 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.376+0000 7f6d75810700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d701475a0 con 0x7f6d7012f5b0 2020-04-02T23:21:52.394 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.376+0000 7f6d6ffff700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f6d7012e310 0x7f6d70135eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:45182/0 (socket says 172.21.15.174:45182) 2020-04-02T23:21:52.394 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.376+0000 7f6d6ffff700 1 -- 172.21.15.174:0/1851903872 learned_addr learned my addr 172.21.15.174:0/1851903872 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:21:52.394 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.376+0000 7f6d7500f700 1 --2- 172.21.15.174:0/1851903872 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6d7012f5b0 0x7f6d70146fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:52.394 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.376+0000 7f6d6dffb700 1 -- 172.21.15.174:0/1851903872 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 315644215 0 0) 0x7f6d700a7a30 con 0x7f6d7012e310 2020-04-02T23:21:52.394 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.376+0000 7f6d6dffb700 1 -- 172.21.15.174:0/1851903872 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d50002fe0 con 0x7f6d7012e310 2020-04-02T23:21:52.394 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.376+0000 7f6d6dffb700 1 -- 172.21.15.174:0/1851903872 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1706965350 0 0) 0x7f6d700a7500 con 0x7f6d5c003720 2020-04-02T23:21:52.394 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.376+0000 7f6d6dffb700 1 -- 172.21.15.174:0/1851903872 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d700a7a30 con 0x7f6d5c003720 2020-04-02T23:21:52.395 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.376+0000 7f6d7500f700 1 -- 172.21.15.174:0/1851903872 >> v1:172.21.15.196:6789/0 conn(0x7f6d5c003720 legacy=0x7f6d7012dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:52.395 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.376+0000 7f6d7500f700 1 -- 172.21.15.174:0/1851903872 >> v1:172.21.15.174:6789/0 conn(0x7f6d7012e310 legacy=0x7f6d70135eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:52.395 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.376+0000 7f6d7500f700 1 -- 172.21.15.174:0/1851903872 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d70147840 con 0x7f6d7012f5b0 2020-04-02T23:21:52.395 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.376+0000 7f6d7500f700 1 --2- 172.21.15.174:0/1851903872 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6d7012f5b0 0x7f6d70146fe0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6d68001820 tx=0x7f6d7009e870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:52.395 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.376+0000 7f6d7500f700 1 --2- 172.21.15.174:0/1851903872 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6d7012f5b0 0x7f6d70146fe0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6d68001820 tx=0x7f6d7009e870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:52.396 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.376+0000 7f6d7500f700 1 --2- 172.21.15.174:0/1851903872 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6d7012f5b0 0x7f6d70146fe0 secure :-1 s=READY pgs=33 cs=0 l=1 rx=0x7f6d68001820 tx=0x7f6d7009e870).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:52.397 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.377+0000 7f6d7500f700 1 --2- 172.21.15.174:0/1851903872 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6d7012f5b0 0x7f6d70146fe0 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f6d68001820 tx=0x7f6d7009e870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:52.397 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.377+0000 7f6d6dffb700 1 -- 172.21.15.174:0/1851903872 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d68004c50 con 0x7f6d7012f5b0 2020-04-02T23:21:52.397 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.377+0000 7f6d7500f700 1 --2- 172.21.15.174:0/1851903872 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6d7012f5b0 0x7f6d70146fe0 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f6d68001820 tx=0x7f6d7009e870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:52.397 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.377+0000 7f6d6dffb700 1 -- 172.21.15.174:0/1851903872 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d68004db0 con 0x7f6d7012f5b0 2020-04-02T23:21:52.397 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.377+0000 7f6d7500f700 1 --2- 172.21.15.174:0/1851903872 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6d7012f5b0 0x7f6d70146fe0 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f6d68001820 tx=0x7f6d7009e870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:52.397 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.377+0000 7f6d75810700 1 -- 172.21.15.174:0/1851903872 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d700a4900 con 0x7f6d7012f5b0 2020-04-02T23:21:52.397 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.377+0000 7f6d6dffb700 1 -- 172.21.15.174:0/1851903872 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d680129a0 con 0x7f6d7012f5b0 2020-04-02T23:21:52.397 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.377+0000 7f6d75810700 1 -- 172.21.15.174:0/1851903872 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d70136780 con 0x7f6d7012f5b0 2020-04-02T23:21:52.398 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.377+0000 7f6d7500f700 1 --2- 172.21.15.174:0/1851903872 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6d7012f5b0 0x7f6d70146fe0 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f6d68001820 tx=0x7f6d7009e870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:52.398 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.378+0000 7f6d75810700 1 -- 172.21.15.174:0/1851903872 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d70130aa0 con 0x7f6d7012f5b0 2020-04-02T23:21:52.398 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.378+0000 7f6d6dffb700 1 -- 172.21.15.174:0/1851903872 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f6d68001550 con 0x7f6d7012f5b0 2020-04-02T23:21:52.398 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.378+0000 7f6d7500f700 1 --2- 172.21.15.174:0/1851903872 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6d7012f5b0 0x7f6d70146fe0 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f6d68001820 tx=0x7f6d7009e870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:52.398 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.378+0000 7f6d6dffb700 1 --2- 172.21.15.174:0/1851903872 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f6d5004dac0 0x7f6d5004ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:52.398 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.378+0000 7f6d6dffb700 1 -- 172.21.15.174:0/1851903872 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f6d680612e0 con 0x7f6d7012f5b0 2020-04-02T23:21:52.398 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.378+0000 7f6d7480e700 1 --2- 172.21.15.174:0/1851903872 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f6d5004dac0 0x7f6d5004ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:52.399 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.378+0000 7f6d7480e700 1 --2- 172.21.15.174:0/1851903872 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f6d5004dac0 0x7f6d5004ff80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6d60007fa0 tx=0x7f6d60007dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:52.399 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.379+0000 7f6d7480e700 1 --2- 172.21.15.174:0/1851903872 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f6d5004dac0 0x7f6d5004ff80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6d60007fa0 tx=0x7f6d60007dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:52.399 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.379+0000 7f6d7480e700 1 --2- 172.21.15.174:0/1851903872 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f6d5004dac0 0x7f6d5004ff80 secure :-1 s=READY pgs=88 cs=0 l=1 rx=0x7f6d60007fa0 tx=0x7f6d60007dd0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:52.400 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.382+0000 7f6d7500f700 1 --2- 172.21.15.174:0/1851903872 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6d7012f5b0 0x7f6d70146fe0 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f6d68001820 tx=0x7f6d7009e870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:52.400 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.382+0000 7f6d6dffb700 1 -- 172.21.15.174:0/1851903872 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f6d6803c960 con 0x7f6d7012f5b0 2020-04-02T23:21:52.569 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.566+0000 7f6d75810700 1 -- 172.21.15.174:0/1851903872 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f6d701479d0 con 0x7f6d7012f5b0 2020-04-02T23:21:52.570 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.567+0000 7f6d7500f700 1 --2- 172.21.15.174:0/1851903872 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6d7012f5b0 0x7f6d70146fe0 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f6d68001820 tx=0x7f6d7009e870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:52.570 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.567+0000 7f6d6dffb700 1 -- 172.21.15.174:0/1851903872 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7f6d6803ff80 con 0x7f6d7012f5b0 2020-04-02T23:21:52.570 INFO:teuthology.orchestra.run.smithi174.stdout: 2020-04-02T23:21:52.571 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.569+0000 7f6d75810700 1 -- 172.21.15.174:0/1851903872 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f6d5004dac0 msgr2=0x7f6d5004ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:52.572 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.569+0000 7f6d75810700 1 --2- 172.21.15.174:0/1851903872 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f6d5004dac0 0x7f6d5004ff80 secure :-1 s=READY pgs=88 cs=0 l=1 rx=0x7f6d60007fa0 tx=0x7f6d60007dd0).stop 2020-04-02T23:21:52.572 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.569+0000 7f6d75810700 1 -- 172.21.15.174:0/1851903872 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6d7012f5b0 msgr2=0x7f6d70146fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:52.572 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.569+0000 7f6d75810700 1 --2- 172.21.15.174:0/1851903872 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6d7012f5b0 0x7f6d70146fe0 secure :-1 s=READY pgs=33 cs=0 l=1 rx=0x7f6d68001820 tx=0x7f6d7009e870).stop 2020-04-02T23:21:52.572 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.569+0000 7f6d75810700 1 -- 172.21.15.174:0/1851903872 shutdown_connections 2020-04-02T23:21:52.572 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.569+0000 7f6d75810700 1 --2- 172.21.15.174:0/1851903872 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6d7012f5b0 0x7f6d70146fe0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:52.572 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.569+0000 7f6d75810700 1 --2- 172.21.15.174:0/1851903872 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f6d5004dac0 0x7f6d5004ff80 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:52.573 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.569+0000 7f6d75810700 1 -- 172.21.15.174:0/1851903872 >> 172.21.15.174:0/1851903872 conn(0x7f6d700a6d00 msgr2=0x7f6d7005ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:52.573 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.569+0000 7f6d75810700 1 -- 172.21.15.174:0/1851903872 shutdown_connections 2020-04-02T23:21:52.573 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.569+0000 7f6d75810700 1 -- 172.21.15.174:0/1851903872 wait complete. 2020-04-02T23:21:52.583 INFO:teuthology.orchestra.run.smithi174.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2020-04-02T23:21:52.583 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2020-04-02T23:21:52.584 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:52.597 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-02T23:21:52.745 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.740+0000 7f759670c700 1 Processor -- start 2020-04-02T23:21:52.745 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.740+0000 7f759670c700 1 -- start start 2020-04-02T23:21:52.746 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.740+0000 7f759670c700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f75900a7a60 0x7f75900a22b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:52.746 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.740+0000 7f759670c700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7590138bb0 0x7f7590134dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:52.746 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.740+0000 7f759670c700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75900a3ae0 con 0x7f75900a4330 2020-04-02T23:21:52.746 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.740+0000 7f759670c700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75900a3d80 con 0x7f75900a7a60 2020-04-02T23:21:52.746 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.740+0000 7f759670c700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75900a4020 con 0x7f7590138bb0 2020-04-02T23:21:52.746 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.741+0000 7f7594ca9700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7590138bb0 0x7f7590134dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:52.746 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.741+0000 7f758ffff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f75900a7a60 0x7f75900a22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:52.747 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.741+0000 7f758f7fe700 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f75900a4330 0x7f75901384a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.174:51282/0 (socket says 172.21.15.174:51282) 2020-04-02T23:21:52.747 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.741+0000 7f758ffff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f75900a7a60 0x7f75900a22b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.174:48242/0 (socket says 172.21.15.174:48242) 2020-04-02T23:21:52.747 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.741+0000 7f758f7fe700 1 -- 172.21.15.174:0/1841977846 learned_addr learned my addr 172.21.15.174:0/1841977846 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:21:52.747 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.741+0000 7f758ffff700 1 -- 172.21.15.174:0/1841977846 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7590138bb0 msgr2=0x7f7590134dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:52.747 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.741+0000 7f758ffff700 1 --2- 172.21.15.174:0/1841977846 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7590138bb0 0x7f7590134dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:52.747 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.741+0000 7f758ffff700 1 -- 172.21.15.174:0/1841977846 >> v1:172.21.15.196:6789/0 conn(0x7f75900a4330 legacy=0x7f75901384a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:52.747 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.741+0000 7f758ffff700 1 -- 172.21.15.174:0/1841977846 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75900a1a60 con 0x7f75900a7a60 2020-04-02T23:21:52.748 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.741+0000 7f758effd700 1 -- 172.21.15.174:0/1841977846 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2202586673 0 0) 0x7f75900a3ae0 con 0x7f75900a4330 2020-04-02T23:21:52.748 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.741+0000 7f758ffff700 1 --2- 172.21.15.174:0/1841977846 >> v2:172.21.15.196:3300/0 conn(0x7f75900a7a60 0x7f75900a22b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7580002f30 tx=0x7f7580007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:52.748 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.741+0000 7f758ffff700 1 --2- 172.21.15.174:0/1841977846 >> v2:172.21.15.196:3300/0 conn(0x7f75900a7a60 0x7f75900a22b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7580002f30 tx=0x7f7580007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:52.748 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.741+0000 7f758ffff700 1 --2- 172.21.15.174:0/1841977846 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f75900a7a60 0x7f75900a22b0 secure :-1 s=READY pgs=124 cs=0 l=1 rx=0x7f7580002f30 tx=0x7f7580007a40).ready entity=mon.1 client_cookie=c68762702a852081 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:52.748 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.741+0000 7f758ffff700 1 --2- 172.21.15.174:0/1841977846 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f75900a7a60 0x7f75900a22b0 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7f7580002f30 tx=0x7f7580007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:52.748 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.741+0000 7f758effd700 1 -- 172.21.15.174:0/1841977846 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7580008d00 con 0x7f75900a7a60 2020-04-02T23:21:52.748 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.741+0000 7f758ffff700 1 --2- 172.21.15.174:0/1841977846 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f75900a7a60 0x7f75900a22b0 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7f7580002f30 tx=0x7f7580007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:52.749 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.741+0000 7f758ffff700 1 --2- 172.21.15.174:0/1841977846 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f75900a7a60 0x7f75900a22b0 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7f7580002f30 tx=0x7f7580007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:52.749 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.741+0000 7f758effd700 1 -- 172.21.15.174:0/1841977846 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7580008e60 con 0x7f75900a7a60 2020-04-02T23:21:52.749 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.741+0000 7f758effd700 1 -- 172.21.15.174:0/1841977846 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7580011930 con 0x7f75900a7a60 2020-04-02T23:21:52.749 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.742+0000 7f759670c700 1 -- 172.21.15.174:0/1841977846 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f75900a7a60 msgr2=0x7f75900a22b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:52.749 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.742+0000 7f759670c700 1 --2- 172.21.15.174:0/1841977846 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f75900a7a60 0x7f75900a22b0 secure :-1 s=READY pgs=124 cs=0 l=1 rx=0x7f7580002f30 tx=0x7f7580007a40).stop 2020-04-02T23:21:52.749 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.742+0000 7f759670c700 1 -- 172.21.15.174:0/1841977846 shutdown_connections 2020-04-02T23:21:52.749 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.742+0000 7f759670c700 1 --2- 172.21.15.174:0/1841977846 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7590138bb0 0x7f7590134dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:52.750 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.742+0000 7f759670c700 1 --2- 172.21.15.174:0/1841977846 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f75900a7a60 0x7f75900a22b0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:52.750 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.742+0000 7f759670c700 1 -- 172.21.15.174:0/1841977846 >> 172.21.15.174:0/1841977846 conn(0x7f75900aaf80 msgr2=0x7f75900a6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:52.750 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.742+0000 7f759670c700 1 -- 172.21.15.174:0/1841977846 shutdown_connections 2020-04-02T23:21:52.750 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.742+0000 7f759670c700 1 -- 172.21.15.174:0/1841977846 wait complete. 2020-04-02T23:21:52.750 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.743+0000 7f759670c700 1 Processor -- start 2020-04-02T23:21:52.750 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.743+0000 7f759670c700 1 -- start start 2020-04-02T23:21:52.753 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.744+0000 7f759670c700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f75900a7a60 0x7f7590132000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:52.753 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.744+0000 7f759670c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7590138bb0 0x7f75901340a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:52.754 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.744+0000 7f759670c700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7590131620 con 0x7f75900a4330 2020-04-02T23:21:52.754 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.744+0000 7f759670c700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75901318c0 con 0x7f7590138bb0 2020-04-02T23:21:52.754 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.744+0000 7f759670c700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7590131b60 con 0x7f75900a7a60 2020-04-02T23:21:52.754 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.744+0000 7f758ffff700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f75900a4330 0x7f75901425b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:45194/0 (socket says 172.21.15.174:45194) 2020-04-02T23:21:52.754 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.744+0000 7f758ffff700 1 -- 172.21.15.174:0/2998594807 learned_addr learned my addr 172.21.15.174:0/2998594807 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:21:52.754 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.744+0000 7f7594ca9700 1 --2- 172.21.15.174:0/2998594807 >> v2:172.21.15.174:3300/0 conn(0x7f7590138bb0 0x7f75901340a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:52.754 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.744+0000 7f758f7fe700 1 --2- 172.21.15.174:0/2998594807 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f75900a7a60 0x7f7590132000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:52.755 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.744+0000 7f7594ca9700 1 -- 172.21.15.174:0/2998594807 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f75900a7a60 msgr2=0x7f7590132000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:52.755 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.744+0000 7f7594ca9700 1 --2- 172.21.15.174:0/2998594807 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f75900a7a60 0x7f7590132000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:52.755 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.744+0000 7f7594ca9700 1 -- 172.21.15.174:0/2998594807 >> v1:172.21.15.174:6789/0 conn(0x7f75900a4330 legacy=0x7f75901425b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:52.755 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.744+0000 7f758d7fa700 1 -- 172.21.15.174:0/2998594807 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3528171871 0 0) 0x7f7590131620 con 0x7f75900a4330 2020-04-02T23:21:52.755 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.744+0000 7f7594ca9700 1 -- 172.21.15.174:0/2998594807 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75900aa060 con 0x7f7590138bb0 2020-04-02T23:21:52.756 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.744+0000 7f7594ca9700 1 --2- 172.21.15.174:0/2998594807 >> v2:172.21.15.174:3300/0 conn(0x7f7590138bb0 0x7f75901340a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f75880032b0 tx=0x7f7588010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:52.756 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.744+0000 7f7594ca9700 1 --2- 172.21.15.174:0/2998594807 >> v2:172.21.15.174:3300/0 conn(0x7f7590138bb0 0x7f75901340a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f75880032b0 tx=0x7f7588010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:52.756 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.744+0000 7f7594ca9700 1 --2- 172.21.15.174:0/2998594807 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7590138bb0 0x7f75901340a0 secure :-1 s=READY pgs=164 cs=0 l=1 rx=0x7f75880032b0 tx=0x7f7588010ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:52.756 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.744+0000 7f7594ca9700 1 --2- 172.21.15.174:0/2998594807 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7590138bb0 0x7f75901340a0 secure :-1 s=THROTTLE_DONE pgs=164 cs=0 l=1 rx=0x7f75880032b0 tx=0x7f7588010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:52.756 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.744+0000 7f758d7fa700 1 -- 172.21.15.174:0/2998594807 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f758800ebf0 con 0x7f7590138bb0 2020-04-02T23:21:52.756 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.744+0000 7f7594ca9700 1 --2- 172.21.15.174:0/2998594807 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7590138bb0 0x7f75901340a0 secure :-1 s=THROTTLE_DONE pgs=164 cs=0 l=1 rx=0x7f75880032b0 tx=0x7f7588010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:52.757 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.744+0000 7f7594ca9700 1 --2- 172.21.15.174:0/2998594807 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7590138bb0 0x7f75901340a0 secure :-1 s=THROTTLE_DONE pgs=164 cs=0 l=1 rx=0x7f75880032b0 tx=0x7f7588010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:52.757 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.744+0000 7f758d7fa700 1 -- 172.21.15.174:0/2998594807 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f758800ed50 con 0x7f7590138bb0 2020-04-02T23:21:52.757 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.744+0000 7f758d7fa700 1 -- 172.21.15.174:0/2998594807 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75880118b0 con 0x7f7590138bb0 2020-04-02T23:21:52.757 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.744+0000 7f759670c700 1 -- 172.21.15.174:0/2998594807 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7590132c60 con 0x7f7590138bb0 2020-04-02T23:21:52.757 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.744+0000 7f759670c700 1 -- 172.21.15.174:0/2998594807 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f759012de50 con 0x7f7590138bb0 2020-04-02T23:21:52.757 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.745+0000 7f7594ca9700 1 --2- 172.21.15.174:0/2998594807 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7590138bb0 0x7f75901340a0 secure :-1 s=THROTTLE_DONE pgs=164 cs=0 l=1 rx=0x7f75880032b0 tx=0x7f7588010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:52.757 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.745+0000 7f758d7fa700 1 -- 172.21.15.174:0/2998594807 <== mon.0 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f7588011b70 con 0x7f7590138bb0 2020-04-02T23:21:52.757 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.745+0000 7f7594ca9700 1 --2- 172.21.15.174:0/2998594807 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7590138bb0 0x7f75901340a0 secure :-1 s=THROTTLE_DONE pgs=164 cs=0 l=1 rx=0x7f75880032b0 tx=0x7f7588010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:52.758 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.745+0000 7f759670c700 1 -- 172.21.15.174:0/2998594807 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7590056c50 con 0x7f7590138bb0 2020-04-02T23:21:52.758 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.746+0000 7f758d7fa700 1 --2- 172.21.15.174:0/2998594807 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f757004d420 0x7f757004f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:52.758 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.746+0000 7f758d7fa700 1 -- 172.21.15.174:0/2998594807 <== mon.0 v2:172.21.15.174:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7588060d50 con 0x7f7590138bb0 2020-04-02T23:21:52.758 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.746+0000 7f758ffff700 1 --2- 172.21.15.174:0/2998594807 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f757004d420 0x7f757004f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:52.758 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.746+0000 7f758ffff700 1 --2- 172.21.15.174:0/2998594807 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f757004d420 0x7f757004f8e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7580002ed0 tx=0x7f7580007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:52.758 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.746+0000 7f758ffff700 1 --2- 172.21.15.174:0/2998594807 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f757004d420 0x7f757004f8e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7580002ed0 tx=0x7f7580007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:52.758 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.746+0000 7f758ffff700 1 --2- 172.21.15.174:0/2998594807 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f757004d420 0x7f757004f8e0 secure :-1 s=READY pgs=89 cs=0 l=1 rx=0x7f7580002ed0 tx=0x7f7580007a40).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:52.759 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.749+0000 7f7594ca9700 1 --2- 172.21.15.174:0/2998594807 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7590138bb0 0x7f75901340a0 secure :-1 s=THROTTLE_DONE pgs=164 cs=0 l=1 rx=0x7f75880032b0 tx=0x7f7588010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:52.759 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.749+0000 7f758d7fa700 1 -- 172.21.15.174:0/2998594807 <== mon.0 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f758803c490 con 0x7f7590138bb0 2020-04-02T23:21:52.891 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.887+0000 7f759670c700 1 -- 172.21.15.174:0/2998594807 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7590131cd0 con 0x7f7590138bb0 2020-04-02T23:21:52.892 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.888+0000 7f7594ca9700 1 --2- 172.21.15.174:0/2998594807 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7590138bb0 0x7f75901340a0 secure :-1 s=THROTTLE_DONE pgs=164 cs=0 l=1 rx=0x7f75880032b0 tx=0x7f7588010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:52.892 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.888+0000 7f758d7fa700 1 -- 172.21.15.174:0/2998594807 <== mon.0 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16134 (secure 0 0 0) 0x7f758803fab0 con 0x7f7590138bb0 2020-04-02T23:21:52.892 INFO:teuthology.orchestra.run.smithi174.stdout: 2020-04-02T23:21:52.892 INFO:teuthology.orchestra.run.smithi174.stdout:{"epoch":23,"fsid":"06504ece-4284-40ba-b298-58864abc4224","created":"2020-04-02T23:21:19.153932+0000","modified":"2020-04-02T23:21:41.535533+0000","last_up_change":"2020-04-02T23:21:29.337390+0000","last_in_change":"2020-04-02T23:21:29.337390+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-02T23:21:22.199702+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-02T23:21:35.314601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-04-02T23:21:38.762876+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-04-02T23:21:39.474986+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c9d748ee-c52f-4f21-b8c9-2a53a937be1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":24590},{"type":"v1","addr":"172.21.15.174:6801","nonce":24590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":24590},{"type":"v1","addr":"172.21.15.174:6803","nonce":24590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":24590},{"type":"v1","addr":"172.21.15.174:6807","nonce":24590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":24590},{"type":"v1","addr":"172.21.15.174:6805","nonce":24590}]},"public_addr":"172.21.15.174:6801/24590","cluster_addr":"172.21.15.174:6803/24590","heartbeat_back_addr":"172.21.15.174:6807/24590","heartbeat_front_addr":"172.21.15.174:6805/24590","state":["exists","up"]},{"osd":1,"uuid":"27c05faf-11f5-4cef-9bde-1a6653a9e533","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":24754},{"type":"v1","addr":"172.21.15.174:6809","nonce":24754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":24754},{"type":"v1","addr":"172.21.15.174:6811","nonce":24754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":24754},{"type":"v1","addr":"172.21.15.174:6815","nonce":24754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":24754},{"type":"v1","addr":"172.21.15.174:6813","nonce":24754}]},"public_addr":"172.21.15.174:6809/24754","cluster_addr":"172.21.15.174:6811/24754","heartbeat_back_addr":"172.21.15.174:6815/24754","heartbeat_front_addr":"172.21.15.174:6813/24754","state":["exists","up"]},{"osd":2,"uuid":"02b1b455-b518-4393-b257-40c3a76af157","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":24781},{"type":"v1","addr":"172.21.15.174:6817","nonce":24781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":24781},{"type":"v1","addr":"172.21.15.174:6819","nonce":24781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":24781},{"type":"v1","addr":"172.21.15.174:6823","nonce":24781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":24781},{"type":"v1","addr":"172.21.15.174:6821","nonce":24781}]},"public_addr":"172.21.15.174:6817/24781","cluster_addr":"172.21.15.174:6819/24781","heartbeat_back_addr":"172.21.15.174:6823/24781","heartbeat_front_addr":"172.21.15.174:6821/24781","state":["exists","up"]},{"osd":3,"uuid":"d7fb3499-9e13-4076-b3cf-28f27eb62967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":24972},{"type":"v1","addr":"172.21.15.174:6825","nonce":24972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":24972},{"type":"v1","addr":"172.21.15.174:6827","nonce":24972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":24972},{"type":"v1","addr":"172.21.15.174:6831","nonce":24972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":24972},{"type":"v1","addr":"172.21.15.174:6829","nonce":24972}]},"public_addr":"172.21.15.174:6825/24972","cluster_addr":"172.21.15.174:6827/24972","heartbeat_back_addr":"172.21.15.174:6831/24972","heartbeat_front_addr":"172.21.15.174:6829/24972","state":["exists","up"]},{"osd":4,"uuid":"16923c47-2f21-43ea-9647-5ead4b1b2101","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":24034},{"type":"v1","addr":"172.21.15.196:6803","nonce":24034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":24034},{"type":"v1","addr":"172.21.15.196:6805","nonce":24034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":24034},{"type":"v1","addr":"172.21.15.196:6809","nonce":24034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":24034},{"type":"v1","addr":"172.21.15.196:6807","nonce":24034}]},"public_addr":"172.21.15.196:6803/24034","cluster_addr":"172.21.15.196:6805/24034","heartbeat_back_addr":"172.21.15.196:6809/24034","heartbeat_front_addr":"172.21.15.196:6807/24034","state":["exists","up"]},{"osd":5,"uuid":"7cf2859b-2226-4908-8d70-6e699d1acb0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":24190},{"type":"v1","addr":"172.21.15.196:6811","nonce":24190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":24190},{"type":"v1","addr":"172.21.15.196:6813","nonce":24190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":24190},{"type":"v1","addr":"172.21.15.196:6817","nonce":24190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":24190},{"type":"v1","addr":"172.21.15.196:6815","nonce":24190}]},"public_addr":"172.21.15.196:6811/24190","cluster_addr":"172.21.15.196:6813/24190","heartbeat_back_addr":"172.21.15.196:6817/24190","heartbeat_front_addr":"172.21.15.196:6815/24190","state":["exists","up"]},{"osd":6,"uuid":"441081ef-133a-41ec-8041-094e129707e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":24212},{"type":"v1","addr":"172.21.15.196:6819","nonce":24212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":24212},{"type":"v1","addr":"172.21.15.196:6821","nonce":24212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":24212},{"type":"v1","addr":"172.21.15.196:6825","nonce":24212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":24212},{"type":"v1","addr":"172.21.15.196:6823","nonce":24212}]},"public_addr":"172.21.15.196:6819/24212","cluster_addr":"172.21.15.196:6821/24212","heartbeat_back_addr":"172.21.15.196:6825/24212","heartbeat_front_addr":"172.21.15.196:6823/24212","state":["exists","up"]},{"osd":7,"uuid":"17ee8d46-46bf-4ef0-8d02-82cbc4ef5a5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":24408},{"type":"v1","addr":"172.21.15.196:6827","nonce":24408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":24408},{"type":"v1","addr":"172.21.15.196:6829","nonce":24408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":24408},{"type":"v1","addr":"172.21.15.196:6833","nonce":24408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":24408},{"type":"v1","addr":"172.21.15.196:6831","nonce":24408}]},"public_addr":"172.21.15.196:6827/24408","cluster_addr":"172.21.15.196:6829/24408","heartbeat_back_addr":"172.21.15.196:6833/24408","heartbeat_front_addr":"172.21.15.196:6831/24408","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.725574+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.732598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.775890+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.854998+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.545334+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.591623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.627501+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.614807+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-02T23:21:52.894 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.889+0000 7f759670c700 1 -- 172.21.15.174:0/2998594807 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f757004d420 msgr2=0x7f757004f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:52.894 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.889+0000 7f759670c700 1 --2- 172.21.15.174:0/2998594807 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f757004d420 0x7f757004f8e0 secure :-1 s=READY pgs=89 cs=0 l=1 rx=0x7f7580002ed0 tx=0x7f7580007a40).stop 2020-04-02T23:21:52.894 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.889+0000 7f759670c700 1 -- 172.21.15.174:0/2998594807 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7590138bb0 msgr2=0x7f75901340a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:52.894 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.889+0000 7f759670c700 1 --2- 172.21.15.174:0/2998594807 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7590138bb0 0x7f75901340a0 secure :-1 s=READY pgs=164 cs=0 l=1 rx=0x7f75880032b0 tx=0x7f7588010ec0).stop 2020-04-02T23:21:52.894 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.890+0000 7f759670c700 1 -- 172.21.15.174:0/2998594807 shutdown_connections 2020-04-02T23:21:52.895 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.890+0000 7f759670c700 1 --2- 172.21.15.174:0/2998594807 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f757004d420 0x7f757004f8e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:52.895 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.890+0000 7f759670c700 1 --2- 172.21.15.174:0/2998594807 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7590138bb0 0x7f75901340a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:52.895 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.890+0000 7f759670c700 1 --2- 172.21.15.174:0/2998594807 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f75900a7a60 0x7f7590132000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:52.895 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.890+0000 7f759670c700 1 -- 172.21.15.174:0/2998594807 >> 172.21.15.174:0/2998594807 conn(0x7f75900aaf80 msgr2=0x7f75900695c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:52.895 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.890+0000 7f759670c700 1 -- 172.21.15.174:0/2998594807 shutdown_connections 2020-04-02T23:21:52.895 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:52.890+0000 7f759670c700 1 -- 172.21.15.174:0/2998594807 wait complete. 2020-04-02T23:21:52.904 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 1, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-02T23:21:22.199702+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 1, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 1, u'pg_num': 1, u'type': 1, u'grade_table': [], u'pool_name': u'device_health_metrics', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 1, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'mgr_devicehealth': {}}, u'options': {u'pg_num_min': 1}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'16', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-02T23:21:35.314601+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'19', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-02T23:21:38.762876+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 3, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'22', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-02T23:21:39.474986+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 4, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'23', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-04-02T23:21:52.904 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:52.918 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-04-02T23:21:53.073 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.070+0000 7fa7cf465700 1 Processor -- start 2020-04-02T23:21:53.073 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.070+0000 7fa7cf465700 1 -- start start 2020-04-02T23:21:53.079 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.071+0000 7fa7cf465700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fa7c80a5900 0x7fa7c8135030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:53.080 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.071+0000 7fa7cf465700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa7c805ac00 0x7fa7c812e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:53.080 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.071+0000 7fa7cf465700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7c8134420 con 0x7fa7c812e6c0 2020-04-02T23:21:53.080 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.071+0000 7fa7cf465700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7c805b0b0 con 0x7fa7c80a5900 2020-04-02T23:21:53.080 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.071+0000 7fa7cf465700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c80a49d0 con 0x7fa7c805ac00 2020-04-02T23:21:53.080 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.071+0000 7fa7cca00700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa7c805ac00 0x7fa7c812e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:53.080 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.071+0000 7fa7cda02700 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7fa7c812e6c0 0x7fa7c81379f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.174:51296/0 (socket says 172.21.15.174:51296) 2020-04-02T23:21:53.081 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.071+0000 7fa7cda02700 1 -- 172.21.15.174:0/4097821921 learned_addr learned my addr 172.21.15.174:0/4097821921 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:21:53.081 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.071+0000 7fa7cd201700 1 --2- 172.21.15.174:0/4097821921 >> v2:172.21.15.196:3300/0 conn(0x7fa7c80a5900 0x7fa7c8135030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:53.081 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.072+0000 7fa7b7fff700 1 -- 172.21.15.174:0/4097821921 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3090543227 0 0) 0x7fa7c8134420 con 0x7fa7c812e6c0 2020-04-02T23:21:53.081 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.072+0000 7fa7b7fff700 1 -- 172.21.15.174:0/4097821921 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7b0003230 con 0x7fa7c812e6c0 2020-04-02T23:21:53.081 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.072+0000 7fa7cca00700 1 -- 172.21.15.174:0/4097821921 >> v2:172.21.15.196:3300/0 conn(0x7fa7c80a5900 msgr2=0x7fa7c8135030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:53.081 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.072+0000 7fa7cca00700 1 --2- 172.21.15.174:0/4097821921 >> v2:172.21.15.196:3300/0 conn(0x7fa7c80a5900 0x7fa7c8135030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:53.081 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.072+0000 7fa7cca00700 1 -- 172.21.15.174:0/4097821921 >> v1:172.21.15.196:6789/0 conn(0x7fa7c812e6c0 legacy=0x7fa7c81379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:53.082 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.072+0000 7fa7cca00700 1 -- 172.21.15.174:0/4097821921 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7c8134650 con 0x7fa7c805ac00 2020-04-02T23:21:53.082 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.072+0000 7fa7cd201700 1 --2- 172.21.15.174:0/4097821921 >> v2:172.21.15.196:3300/0 conn(0x7fa7c80a5900 0x7fa7c8135030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:21:53.082 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.072+0000 7fa7cca00700 1 --2- 172.21.15.174:0/4097821921 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa7c805ac00 0x7fa7c812e260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa7b8002f30 tx=0x7fa7b8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:53.082 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.072+0000 7fa7cca00700 1 --2- 172.21.15.174:0/4097821921 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa7c805ac00 0x7fa7c812e260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa7b8002f30 tx=0x7fa7b8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:53.082 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.072+0000 7fa7cca00700 1 --2- 172.21.15.174:0/4097821921 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa7c805ac00 0x7fa7c812e260 secure :-1 s=READY pgs=34 cs=0 l=1 rx=0x7fa7b8002f30 tx=0x7fa7b8007a40).ready entity=mon.2 client_cookie=2a392dc2f6f2b1fa server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:53.083 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.072+0000 7fa7cca00700 1 --2- 172.21.15.174:0/4097821921 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa7c805ac00 0x7fa7c812e260 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7fa7b8002f30 tx=0x7fa7b8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:53.083 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.072+0000 7fa7b7fff700 1 -- 172.21.15.174:0/4097821921 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7b8012610 con 0x7fa7c805ac00 2020-04-02T23:21:53.083 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.072+0000 7fa7cca00700 1 --2- 172.21.15.174:0/4097821921 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa7c805ac00 0x7fa7c812e260 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7fa7b8002f30 tx=0x7fa7b8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:53.084 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.072+0000 7fa7b7fff700 1 -- 172.21.15.174:0/4097821921 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7b8012770 con 0x7fa7c805ac00 2020-04-02T23:21:53.084 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.072+0000 7fa7cca00700 1 --2- 172.21.15.174:0/4097821921 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa7c805ac00 0x7fa7c812e260 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7fa7b8002f30 tx=0x7fa7b8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:53.084 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.072+0000 7fa7b7fff700 1 -- 172.21.15.174:0/4097821921 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7b8012b90 con 0x7fa7c805ac00 2020-04-02T23:21:53.084 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.072+0000 7fa7cf465700 1 -- 172.21.15.174:0/4097821921 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa7c805ac00 msgr2=0x7fa7c812e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:53.084 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.072+0000 7fa7cf465700 1 --2- 172.21.15.174:0/4097821921 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa7c805ac00 0x7fa7c812e260 secure :-1 s=READY pgs=34 cs=0 l=1 rx=0x7fa7b8002f30 tx=0x7fa7b8007a40).stop 2020-04-02T23:21:53.084 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.073+0000 7fa7cf465700 1 -- 172.21.15.174:0/4097821921 shutdown_connections 2020-04-02T23:21:53.085 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.073+0000 7fa7cf465700 1 --2- 172.21.15.174:0/4097821921 >> v2:172.21.15.196:3300/0 conn(0x7fa7c80a5900 0x7fa7c8135030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:53.085 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.073+0000 7fa7cf465700 1 --2- 172.21.15.174:0/4097821921 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa7c805ac00 0x7fa7c812e260 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:53.085 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.073+0000 7fa7cf465700 1 -- 172.21.15.174:0/4097821921 >> 172.21.15.174:0/4097821921 conn(0x7fa7c80aaf80 msgr2=0x7fa7c80a6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:53.085 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.073+0000 7fa7cf465700 1 -- 172.21.15.174:0/4097821921 shutdown_connections 2020-04-02T23:21:53.085 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.073+0000 7fa7cf465700 1 -- 172.21.15.174:0/4097821921 wait complete. 2020-04-02T23:21:53.085 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.074+0000 7fa7cf465700 1 Processor -- start 2020-04-02T23:21:53.085 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.074+0000 7fa7cf465700 1 -- start start 2020-04-02T23:21:53.086 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.074+0000 7fa7cf465700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa7c805ac00 0x7fa7c809f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:53.086 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.074+0000 7fa7cf465700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa7c80a5900 0x7fa7c8146a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:53.086 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.074+0000 7fa7cf465700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7c809d240 con 0x7fa7c812e6c0 2020-04-02T23:21:53.086 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.074+0000 7fa7cf465700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7c80a25d0 con 0x7fa7c80a5900 2020-04-02T23:21:53.086 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.074+0000 7fa7cf465700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c809d490 con 0x7fa7c805ac00 2020-04-02T23:21:53.086 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.074+0000 7fa7cca00700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa7c80a5900 0x7fa7c8146a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:53.086 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.074+0000 7fa7cca00700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa7c80a5900 0x7fa7c8146a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:40168/0 (socket says 172.21.15.174:40168) 2020-04-02T23:21:53.086 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.074+0000 7fa7cca00700 1 -- 172.21.15.174:0/3539609314 learned_addr learned my addr 172.21.15.174:0/3539609314 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:21:53.087 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.074+0000 7fa7cd201700 1 --2- 172.21.15.174:0/3539609314 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa7c805ac00 0x7fa7c809f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:53.087 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.075+0000 7fa7cca00700 1 -- 172.21.15.174:0/3539609314 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa7c805ac00 msgr2=0x7fa7c809f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:53.087 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.075+0000 7fa7cca00700 1 --2- 172.21.15.174:0/3539609314 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa7c805ac00 0x7fa7c809f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:53.087 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.075+0000 7fa7cca00700 1 -- 172.21.15.174:0/3539609314 >> v1:172.21.15.196:6789/0 conn(0x7fa7c812e6c0 legacy=0x7fa7c81377a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:53.087 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.075+0000 7fa7cca00700 1 -- 172.21.15.174:0/3539609314 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7c809d730 con 0x7fa7c80a5900 2020-04-02T23:21:53.087 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.075+0000 7fa7cca00700 1 --2- 172.21.15.174:0/3539609314 >> v2:172.21.15.174:3300/0 conn(0x7fa7c80a5900 0x7fa7c8146a50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa7b8002f30 tx=0x7fa7b8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:53.087 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.075+0000 7fa7cca00700 1 --2- 172.21.15.174:0/3539609314 >> v2:172.21.15.174:3300/0 conn(0x7fa7c80a5900 0x7fa7c8146a50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa7b8002f30 tx=0x7fa7b8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:53.088 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.075+0000 7fa7cca00700 1 --2- 172.21.15.174:0/3539609314 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa7c80a5900 0x7fa7c8146a50 secure :-1 s=READY pgs=165 cs=0 l=1 rx=0x7fa7b8002f30 tx=0x7fa7b8007a40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:53.088 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.075+0000 7fa7cca00700 1 --2- 172.21.15.174:0/3539609314 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa7c80a5900 0x7fa7c8146a50 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7fa7b8002f30 tx=0x7fa7b8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:53.088 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.075+0000 7fa7b67fc700 1 -- 172.21.15.174:0/3539609314 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7b8010990 con 0x7fa7c80a5900 2020-04-02T23:21:53.088 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.075+0000 7fa7cca00700 1 --2- 172.21.15.174:0/3539609314 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa7c80a5900 0x7fa7c8146a50 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7fa7b8002f30 tx=0x7fa7b8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:53.088 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.075+0000 7fa7b67fc700 1 -- 172.21.15.174:0/3539609314 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7b8012e50 con 0x7fa7c80a5900 2020-04-02T23:21:53.088 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.075+0000 7fa7cca00700 1 --2- 172.21.15.174:0/3539609314 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa7c80a5900 0x7fa7c8146a50 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7fa7b8002f30 tx=0x7fa7b8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:53.088 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.075+0000 7fa7cf465700 1 -- 172.21.15.174:0/3539609314 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7c809d9d0 con 0x7fa7c80a5900 2020-04-02T23:21:53.089 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.075+0000 7fa7b67fc700 1 -- 172.21.15.174:0/3539609314 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7b8012c50 con 0x7fa7c80a5900 2020-04-02T23:21:53.089 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.075+0000 7fa7cf465700 1 -- 172.21.15.174:0/3539609314 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7c8131200 con 0x7fa7c80a5900 2020-04-02T23:21:53.089 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.076+0000 7fa7cca00700 1 --2- 172.21.15.174:0/3539609314 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa7c80a5900 0x7fa7c8146a50 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7fa7b8002f30 tx=0x7fa7b8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:53.089 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.076+0000 7fa7b67fc700 1 -- 172.21.15.174:0/3539609314 <== mon.0 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fa7b80088e0 con 0x7fa7c80a5900 2020-04-02T23:21:53.089 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.076+0000 7fa7cca00700 1 --2- 172.21.15.174:0/3539609314 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa7c80a5900 0x7fa7c8146a50 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7fa7b8002f30 tx=0x7fa7b8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:53.089 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.076+0000 7fa7cf465700 1 -- 172.21.15.174:0/3539609314 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7c8056c50 con 0x7fa7c80a5900 2020-04-02T23:21:53.089 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.076+0000 7fa7b67fc700 1 --2- 172.21.15.174:0/3539609314 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fa7a804d4a0 0x7fa7a804f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:53.090 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.076+0000 7fa7b67fc700 1 -- 172.21.15.174:0/3539609314 <== mon.0 v2:172.21.15.174:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa7b8060c70 con 0x7fa7c80a5900 2020-04-02T23:21:53.090 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.076+0000 7fa7cd201700 1 --2- 172.21.15.174:0/3539609314 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fa7a804d4a0 0x7fa7a804f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:53.090 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.077+0000 7fa7cd201700 1 --2- 172.21.15.174:0/3539609314 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fa7a804d4a0 0x7fa7a804f960 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa7c4002f30 tx=0x7fa7c400eba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:53.090 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.077+0000 7fa7cd201700 1 --2- 172.21.15.174:0/3539609314 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fa7a804d4a0 0x7fa7a804f960 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa7c4002f30 tx=0x7fa7c400eba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:53.090 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.077+0000 7fa7cd201700 1 --2- 172.21.15.174:0/3539609314 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fa7a804d4a0 0x7fa7a804f960 secure :-1 s=READY pgs=90 cs=0 l=1 rx=0x7fa7c4002f30 tx=0x7fa7c400eba0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:53.091 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.079+0000 7fa7cca00700 1 --2- 172.21.15.174:0/3539609314 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa7c80a5900 0x7fa7c8146a50 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7fa7b8002f30 tx=0x7fa7b8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:53.091 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.079+0000 7fa7b67fc700 1 -- 172.21.15.174:0/3539609314 <== mon.0 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fa7b803c520 con 0x7fa7c80a5900 2020-04-02T23:21:53.219 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.216+0000 7fa7cf465700 1 -- 172.21.15.174:0/3539609314 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fa7c805a690 con 0x7fa7c80a5900 2020-04-02T23:21:53.219 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.216+0000 7fa7cca00700 1 --2- 172.21.15.174:0/3539609314 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa7c80a5900 0x7fa7c8146a50 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7fa7b8002f30 tx=0x7fa7b8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:53.219 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.216+0000 7fa7b67fc700 1 -- 172.21.15.174:0/3539609314 <== mon.0 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v23) v1 ==== 110+0+10 (secure 0 0 0) 0x7fa7b803fb40 con 0x7fa7c80a5900 2020-04-02T23:21:53.219 INFO:teuthology.orchestra.run.smithi174.stdout:pg_num: 1 2020-04-02T23:21:53.220 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.218+0000 7fa7cf465700 1 -- 172.21.15.174:0/3539609314 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fa7a804d4a0 msgr2=0x7fa7a804f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:53.221 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.218+0000 7fa7cf465700 1 --2- 172.21.15.174:0/3539609314 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fa7a804d4a0 0x7fa7a804f960 secure :-1 s=READY pgs=90 cs=0 l=1 rx=0x7fa7c4002f30 tx=0x7fa7c400eba0).stop 2020-04-02T23:21:53.221 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.218+0000 7fa7cf465700 1 -- 172.21.15.174:0/3539609314 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa7c80a5900 msgr2=0x7fa7c8146a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:53.221 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.218+0000 7fa7cf465700 1 --2- 172.21.15.174:0/3539609314 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa7c80a5900 0x7fa7c8146a50 secure :-1 s=READY pgs=165 cs=0 l=1 rx=0x7fa7b8002f30 tx=0x7fa7b8007a40).stop 2020-04-02T23:21:53.221 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.218+0000 7fa7cf465700 1 -- 172.21.15.174:0/3539609314 shutdown_connections 2020-04-02T23:21:53.221 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.218+0000 7fa7cf465700 1 --2- 172.21.15.174:0/3539609314 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fa7a804d4a0 0x7fa7a804f960 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:53.221 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.218+0000 7fa7cf465700 1 --2- 172.21.15.174:0/3539609314 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa7c805ac00 0x7fa7c809f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:53.221 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.218+0000 7fa7cf465700 1 --2- 172.21.15.174:0/3539609314 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa7c80a5900 0x7fa7c8146a50 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:53.222 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.218+0000 7fa7cf465700 1 -- 172.21.15.174:0/3539609314 >> 172.21.15.174:0/3539609314 conn(0x7fa7c80aaf80 msgr2=0x7fa7c80a7190 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:53.222 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.218+0000 7fa7cf465700 1 -- 172.21.15.174:0/3539609314 shutdown_connections 2020-04-02T23:21:53.222 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.218+0000 7fa7cf465700 1 -- 172.21.15.174:0/3539609314 wait complete. 2020-04-02T23:21:53.235 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:53.250 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-04-02T23:21:53.396 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.394+0000 7f08013eb700 1 Processor -- start 2020-04-02T23:21:53.397 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.394+0000 7f08013eb700 1 -- start start 2020-04-02T23:21:53.402 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.395+0000 7f08013eb700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f07fc0a7a60 0x7f07fc0a22b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:53.402 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.395+0000 7f08013eb700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f07fc0a4330 0x7f07fc1384a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:53.403 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.395+0000 7f08013eb700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f07fc138900 0x7f07fc12e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:53.403 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.395+0000 7f08013eb700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07fc0a3ae0 con 0x7f07fc138900 2020-04-02T23:21:53.404 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.395+0000 7f08013eb700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07fc0a3d80 con 0x7f07fc0a7a60 2020-04-02T23:21:53.404 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.395+0000 7f08013eb700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07fc0a4020 con 0x7f07fc0a4330 2020-04-02T23:21:53.404 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.395+0000 7f07fb7fe700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f07fc138900 0x7f07fc12e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:53.404 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.395+0000 7f07fb7fe700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f07fc138900 0x7f07fc12e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:40178/0 (socket says 172.21.15.174:40178) 2020-04-02T23:21:53.404 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.395+0000 7f07fb7fe700 1 -- 172.21.15.174:0/943359815 learned_addr learned my addr 172.21.15.174:0/943359815 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:21:53.404 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.395+0000 7f07fa7fc700 1 --2- 172.21.15.174:0/943359815 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f07fc0a4330 0x7f07fc1384a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:53.404 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.395+0000 7f07faffd700 1 --2- 172.21.15.174:0/943359815 >> v2:172.21.15.196:3300/0 conn(0x7f07fc0a7a60 0x7f07fc0a22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:53.404 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.395+0000 7f07fb7fe700 1 -- 172.21.15.174:0/943359815 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f07fc0a4330 msgr2=0x7f07fc1384a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:53.405 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.395+0000 7f07fb7fe700 1 --2- 172.21.15.174:0/943359815 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f07fc0a4330 0x7f07fc1384a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:53.405 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.395+0000 7f07fb7fe700 1 -- 172.21.15.174:0/943359815 >> v2:172.21.15.196:3300/0 conn(0x7f07fc0a7a60 msgr2=0x7f07fc0a22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:53.405 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.395+0000 7f07fb7fe700 1 --2- 172.21.15.174:0/943359815 >> v2:172.21.15.196:3300/0 conn(0x7f07fc0a7a60 0x7f07fc0a22b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:53.405 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.395+0000 7f07fb7fe700 1 -- 172.21.15.174:0/943359815 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07fc0a1a60 con 0x7f07fc138900 2020-04-02T23:21:53.405 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.395+0000 7f07fb7fe700 1 --2- 172.21.15.174:0/943359815 >> v2:172.21.15.174:3300/0 conn(0x7f07fc138900 0x7f07fc12e750 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f07f40032b0 tx=0x7f07f4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:53.405 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.395+0000 7f07fb7fe700 1 --2- 172.21.15.174:0/943359815 >> v2:172.21.15.174:3300/0 conn(0x7f07fc138900 0x7f07fc12e750 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f07f40032b0 tx=0x7f07f4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:53.405 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.395+0000 7f07fb7fe700 1 --2- 172.21.15.174:0/943359815 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07fc138900 0x7f07fc12e750 secure :-1 s=READY pgs=166 cs=0 l=1 rx=0x7f07f40032b0 tx=0x7f07f4007dc0).ready entity=mon.0 client_cookie=7a88cfcc6de37c8c server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:53.406 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.395+0000 7f07fb7fe700 1 --2- 172.21.15.174:0/943359815 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07fc138900 0x7f07fc12e750 secure :-1 s=THROTTLE_DONE pgs=166 cs=0 l=1 rx=0x7f07f40032b0 tx=0x7f07f4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:53.406 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.395+0000 7f07f9ffb700 1 -- 172.21.15.174:0/943359815 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07f40110c0 con 0x7f07fc138900 2020-04-02T23:21:53.406 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.396+0000 7f07fb7fe700 1 --2- 172.21.15.174:0/943359815 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07fc138900 0x7f07fc12e750 secure :-1 s=THROTTLE_DONE pgs=166 cs=0 l=1 rx=0x7f07f40032b0 tx=0x7f07f4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:53.406 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.396+0000 7f07fb7fe700 1 --2- 172.21.15.174:0/943359815 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07fc138900 0x7f07fc12e750 secure :-1 s=THROTTLE_DONE pgs=166 cs=0 l=1 rx=0x7f07f40032b0 tx=0x7f07f4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:53.406 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.396+0000 7f07f9ffb700 1 -- 172.21.15.174:0/943359815 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07f4011220 con 0x7f07fc138900 2020-04-02T23:21:53.406 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.396+0000 7f07f9ffb700 1 -- 172.21.15.174:0/943359815 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07f4011600 con 0x7f07fc138900 2020-04-02T23:21:53.406 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.396+0000 7f08013eb700 1 -- 172.21.15.174:0/943359815 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07fc138900 msgr2=0x7f07fc12e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:53.406 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.396+0000 7f08013eb700 1 --2- 172.21.15.174:0/943359815 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07fc138900 0x7f07fc12e750 secure :-1 s=READY pgs=166 cs=0 l=1 rx=0x7f07f40032b0 tx=0x7f07f4007dc0).stop 2020-04-02T23:21:53.407 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.396+0000 7f08013eb700 1 -- 172.21.15.174:0/943359815 shutdown_connections 2020-04-02T23:21:53.407 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.396+0000 7f08013eb700 1 --2- 172.21.15.174:0/943359815 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07fc138900 0x7f07fc12e750 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:53.407 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.396+0000 7f08013eb700 1 --2- 172.21.15.174:0/943359815 >> v2:172.21.15.196:3300/0 conn(0x7f07fc0a7a60 0x7f07fc0a22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:53.407 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.396+0000 7f08013eb700 1 --2- 172.21.15.174:0/943359815 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f07fc0a4330 0x7f07fc1384a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:53.407 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.396+0000 7f08013eb700 1 -- 172.21.15.174:0/943359815 >> 172.21.15.174:0/943359815 conn(0x7f07fc0aaf80 msgr2=0x7f07fc0a6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:53.407 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.396+0000 7f08013eb700 1 -- 172.21.15.174:0/943359815 shutdown_connections 2020-04-02T23:21:53.407 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.396+0000 7f08013eb700 1 -- 172.21.15.174:0/943359815 wait complete. 2020-04-02T23:21:53.408 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.397+0000 7f08013eb700 1 Processor -- start 2020-04-02T23:21:53.408 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.397+0000 7f08013eb700 1 -- start start 2020-04-02T23:21:53.408 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.398+0000 7f08013eb700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f07fc0a4330 0x7f07fc1440a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:53.408 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.398+0000 7f08013eb700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f07fc138900 0x7f07fc05ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:53.408 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.398+0000 7f08013eb700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07fc135f30 con 0x7f07fc0a7a60 2020-04-02T23:21:53.408 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.398+0000 7f08013eb700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07fc1434d0 con 0x7f07fc0a4330 2020-04-02T23:21:53.408 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.398+0000 7f08013eb700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07fc05b060 con 0x7f07fc138900 2020-04-02T23:21:53.408 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.398+0000 7f07faffd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f07fc0a4330 0x7f07fc1440a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:53.409 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.398+0000 7f07faffd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f07fc0a4330 0x7f07fc1440a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:40180/0 (socket says 172.21.15.174:40180) 2020-04-02T23:21:53.409 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.398+0000 7f07faffd700 1 -- 172.21.15.174:0/3570761559 learned_addr learned my addr 172.21.15.174:0/3570761559 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:21:53.409 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.398+0000 7f07fb7fe700 1 --2- 172.21.15.174:0/3570761559 >> v2:172.21.15.196:3300/0 conn(0x7f07fc138900 0x7f07fc05ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:53.409 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.398+0000 7f07faffd700 1 -- 172.21.15.174:0/3570761559 >> v2:172.21.15.196:3300/0 conn(0x7f07fc138900 msgr2=0x7f07fc05ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:53.409 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.398+0000 7f07faffd700 1 --2- 172.21.15.174:0/3570761559 >> v2:172.21.15.196:3300/0 conn(0x7f07fc138900 0x7f07fc05ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:53.409 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.398+0000 7f07faffd700 1 -- 172.21.15.174:0/3570761559 >> v1:172.21.15.174:6789/0 conn(0x7f07fc0a7a60 legacy=0x7f07fc062490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:53.409 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.398+0000 7f07ebfff700 1 -- 172.21.15.174:0/3570761559 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1244349043 0 0) 0x7f07fc135f30 con 0x7f07fc0a7a60 2020-04-02T23:21:53.410 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.398+0000 7f07faffd700 1 -- 172.21.15.174:0/3570761559 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07fc061b90 con 0x7f07fc0a4330 2020-04-02T23:21:53.410 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.398+0000 7f07fb7fe700 1 --2- 172.21.15.174:0/3570761559 >> v2:172.21.15.196:3300/0 conn(0x7f07fc138900 0x7f07fc05ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-02T23:21:53.411 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.398+0000 7f07faffd700 1 --2- 172.21.15.174:0/3570761559 >> v2:172.21.15.174:3300/0 conn(0x7f07fc0a4330 0x7f07fc1440a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f07f0007b00 tx=0x7f07f0010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:53.411 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.398+0000 7f07faffd700 1 --2- 172.21.15.174:0/3570761559 >> v2:172.21.15.174:3300/0 conn(0x7f07fc0a4330 0x7f07fc1440a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f07f0007b00 tx=0x7f07f0010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:53.412 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.398+0000 7f07faffd700 1 --2- 172.21.15.174:0/3570761559 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07fc0a4330 0x7f07fc1440a0 secure :-1 s=READY pgs=168 cs=0 l=1 rx=0x7f07f0007b00 tx=0x7f07f0010ca0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:53.412 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.398+0000 7f07faffd700 1 --2- 172.21.15.174:0/3570761559 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07fc0a4330 0x7f07fc1440a0 secure :-1 s=THROTTLE_DONE pgs=168 cs=0 l=1 rx=0x7f07f0007b00 tx=0x7f07f0010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:53.412 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.398+0000 7f07ebfff700 1 -- 172.21.15.174:0/3570761559 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07f0005e90 con 0x7f07fc0a4330 2020-04-02T23:21:53.412 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.398+0000 7f07faffd700 1 --2- 172.21.15.174:0/3570761559 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07fc0a4330 0x7f07fc1440a0 secure :-1 s=THROTTLE_DONE pgs=168 cs=0 l=1 rx=0x7f07f0007b00 tx=0x7f07f0010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:53.412 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.398+0000 7f07faffd700 1 --2- 172.21.15.174:0/3570761559 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07fc0a4330 0x7f07fc1440a0 secure :-1 s=THROTTLE_DONE pgs=168 cs=0 l=1 rx=0x7f07f0007b00 tx=0x7f07f0010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:53.412 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.398+0000 7f07ebfff700 1 -- 172.21.15.174:0/3570761559 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07f0007160 con 0x7f07fc0a4330 2020-04-02T23:21:53.412 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.398+0000 7f07ebfff700 1 -- 172.21.15.174:0/3570761559 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07f0007500 con 0x7f07fc0a4330 2020-04-02T23:21:53.412 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.398+0000 7f08013eb700 1 -- 172.21.15.174:0/3570761559 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07fc061e30 con 0x7f07fc0a4330 2020-04-02T23:21:53.413 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.398+0000 7f08013eb700 1 -- 172.21.15.174:0/3570761559 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07fc143c00 con 0x7f07fc0a4330 2020-04-02T23:21:53.413 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.399+0000 7f07faffd700 1 --2- 172.21.15.174:0/3570761559 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07fc0a4330 0x7f07fc1440a0 secure :-1 s=THROTTLE_DONE pgs=168 cs=0 l=1 rx=0x7f07f0007b00 tx=0x7f07f0010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:53.413 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.399+0000 7f08013eb700 1 -- 172.21.15.174:0/3570761559 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07fc143dc0 con 0x7f07fc0a4330 2020-04-02T23:21:53.413 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.399+0000 7f07ebfff700 1 -- 172.21.15.174:0/3570761559 <== mon.0 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f07f0012300 con 0x7f07fc0a4330 2020-04-02T23:21:53.414 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.399+0000 7f07faffd700 1 --2- 172.21.15.174:0/3570761559 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07fc0a4330 0x7f07fc1440a0 secure :-1 s=THROTTLE_DONE pgs=168 cs=0 l=1 rx=0x7f07f0007b00 tx=0x7f07f0010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:53.414 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.399+0000 7f07ebfff700 1 --2- 172.21.15.174:0/3570761559 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f07d804d3e0 0x7f07d804f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:53.414 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.400+0000 7f07ebfff700 1 -- 172.21.15.174:0/3570761559 <== mon.0 v2:172.21.15.174:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f07f0061540 con 0x7f07fc0a4330 2020-04-02T23:21:53.414 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.400+0000 7f07fa7fc700 1 --2- 172.21.15.174:0/3570761559 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f07d804d3e0 0x7f07d804f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:53.414 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.400+0000 7f07fa7fc700 1 --2- 172.21.15.174:0/3570761559 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f07d804d3e0 0x7f07d804f8a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f07ec007a40 tx=0x7f07ec002340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:53.414 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.400+0000 7f07fa7fc700 1 --2- 172.21.15.174:0/3570761559 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f07d804d3e0 0x7f07d804f8a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f07ec007a40 tx=0x7f07ec002340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:53.414 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.400+0000 7f07fa7fc700 1 --2- 172.21.15.174:0/3570761559 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f07d804d3e0 0x7f07d804f8a0 secure :-1 s=READY pgs=91 cs=0 l=1 rx=0x7f07ec007a40 tx=0x7f07ec002340).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:53.415 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.403+0000 7f07faffd700 1 --2- 172.21.15.174:0/3570761559 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07fc0a4330 0x7f07fc1440a0 secure :-1 s=THROTTLE_DONE pgs=168 cs=0 l=1 rx=0x7f07f0007b00 tx=0x7f07f0010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:53.415 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.403+0000 7f07ebfff700 1 -- 172.21.15.174:0/3570761559 <== mon.0 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f07f003cc20 con 0x7f07fc0a4330 2020-04-02T23:21:53.541 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.538+0000 7f08013eb700 1 -- 172.21.15.174:0/3570761559 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f07fc056c50 con 0x7f07fc0a4330 2020-04-02T23:21:53.541 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.539+0000 7f07faffd700 1 --2- 172.21.15.174:0/3570761559 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07fc0a4330 0x7f07fc1440a0 secure :-1 s=THROTTLE_DONE pgs=168 cs=0 l=1 rx=0x7f07f0007b00 tx=0x7f07f0010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:53.542 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.539+0000 7f07ebfff700 1 -- 172.21.15.174:0/3570761559 <== mon.0 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f07f000a0e0 con 0x7f07fc0a4330 2020-04-02T23:21:53.542 INFO:teuthology.orchestra.run.smithi174.stdout:pg_num: 8 2020-04-02T23:21:53.543 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.540+0000 7f08013eb700 1 -- 172.21.15.174:0/3570761559 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f07d804d3e0 msgr2=0x7f07d804f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:53.543 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.540+0000 7f08013eb700 1 --2- 172.21.15.174:0/3570761559 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f07d804d3e0 0x7f07d804f8a0 secure :-1 s=READY pgs=91 cs=0 l=1 rx=0x7f07ec007a40 tx=0x7f07ec002340).stop 2020-04-02T23:21:53.543 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.540+0000 7f08013eb700 1 -- 172.21.15.174:0/3570761559 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07fc0a4330 msgr2=0x7f07fc1440a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:53.543 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.540+0000 7f08013eb700 1 --2- 172.21.15.174:0/3570761559 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07fc0a4330 0x7f07fc1440a0 secure :-1 s=READY pgs=168 cs=0 l=1 rx=0x7f07f0007b00 tx=0x7f07f0010ca0).stop 2020-04-02T23:21:53.543 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.540+0000 7f08013eb700 1 -- 172.21.15.174:0/3570761559 shutdown_connections 2020-04-02T23:21:53.544 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.540+0000 7f08013eb700 1 --2- 172.21.15.174:0/3570761559 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f07d804d3e0 0x7f07d804f8a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:53.544 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.540+0000 7f08013eb700 1 --2- 172.21.15.174:0/3570761559 >> v2:172.21.15.196:3300/0 conn(0x7f07fc138900 0x7f07fc05ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:53.544 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.540+0000 7f08013eb700 1 --2- 172.21.15.174:0/3570761559 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07fc0a4330 0x7f07fc1440a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:53.544 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.540+0000 7f08013eb700 1 -- 172.21.15.174:0/3570761559 >> 172.21.15.174:0/3570761559 conn(0x7f07fc0aaf80 msgr2=0x7f07fc0a9d80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:53.544 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.540+0000 7f08013eb700 1 -- 172.21.15.174:0/3570761559 shutdown_connections 2020-04-02T23:21:53.544 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.540+0000 7f08013eb700 1 -- 172.21.15.174:0/3570761559 wait complete. 2020-04-02T23:21:53.553 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:53.566 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-04-02T23:21:53.713 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.711+0000 7f3d6e234700 1 Processor -- start 2020-04-02T23:21:53.714 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.711+0000 7f3d6e234700 1 -- start start 2020-04-02T23:21:53.717 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.712+0000 7f3d6e234700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3d6809f250 0x7f3d6809f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:53.717 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.712+0000 7f3d6e234700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f3d6809fb10 0x7f3d6813fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:53.717 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.712+0000 7f3d6e234700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d680a2a70 con 0x7f3d6805bf90 2020-04-02T23:21:53.717 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.712+0000 7f3d6e234700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d6809e140 con 0x7f3d6809fb10 2020-04-02T23:21:53.717 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.712+0000 7f3d6e234700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6809e3e0 con 0x7f3d6809f250 2020-04-02T23:21:53.717 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.712+0000 7f3d6da33700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f3d6809fb10 0x7f3d6813fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:53.717 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.712+0000 7f3d6ca31700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3d6809f250 0x7f3d6809f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:53.718 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.712+0000 7f3d6da33700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f3d6809fb10 0x7f3d6813fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.174:48282/0 (socket says 172.21.15.174:48282) 2020-04-02T23:21:53.718 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.712+0000 7f3d6d232700 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f3d6805bf90 0x7f3d6809e810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.174:51320/0 (socket says 172.21.15.174:51320) 2020-04-02T23:21:53.718 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.712+0000 7f3d6da33700 1 -- 172.21.15.174:0/3432562826 learned_addr learned my addr 172.21.15.174:0/3432562826 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:21:53.718 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.712+0000 7f3d6ca31700 1 --2- 172.21.15.174:0/3432562826 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3d6809f250 0x7f3d6809f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.174:34780/0 (socket says 172.21.15.174:34780) 2020-04-02T23:21:53.718 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.712+0000 7f3d6ca31700 1 -- 172.21.15.174:0/3432562826 >> v2:172.21.15.196:3300/0 conn(0x7f3d6809fb10 msgr2=0x7f3d6813fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:53.718 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.712+0000 7f3d6ca31700 1 --2- 172.21.15.174:0/3432562826 >> v2:172.21.15.196:3300/0 conn(0x7f3d6809fb10 0x7f3d6813fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:53.718 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.712+0000 7f3d6ca31700 1 -- 172.21.15.174:0/3432562826 >> v1:172.21.15.196:6789/0 conn(0x7f3d6805bf90 legacy=0x7f3d6809e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:53.719 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.712+0000 7f3d6ca31700 1 -- 172.21.15.174:0/3432562826 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d680a65b0 con 0x7f3d6809f250 2020-04-02T23:21:53.719 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.712+0000 7f3d57fff700 1 -- 172.21.15.174:0/3432562826 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2802069016 0 0) 0x7f3d680a2a70 con 0x7f3d6805bf90 2020-04-02T23:21:53.719 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.712+0000 7f3d6da33700 1 --2- 172.21.15.174:0/3432562826 >> v2:172.21.15.196:3300/0 conn(0x7f3d6809fb10 0x7f3d6813fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:21:53.719 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.712+0000 7f3d6ca31700 1 --2- 172.21.15.174:0/3432562826 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3d6809f250 0x7f3d6809f6b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3d64002f30 tx=0x7f3d64007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:53.719 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.713+0000 7f3d6ca31700 1 --2- 172.21.15.174:0/3432562826 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3d6809f250 0x7f3d6809f6b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3d64002f30 tx=0x7f3d64007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:53.719 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.713+0000 7f3d6ca31700 1 --2- 172.21.15.174:0/3432562826 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3d6809f250 0x7f3d6809f6b0 secure :-1 s=READY pgs=35 cs=0 l=1 rx=0x7f3d64002f30 tx=0x7f3d64007a40).ready entity=mon.2 client_cookie=633b754c1c383f0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:53.719 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.713+0000 7f3d6ca31700 1 --2- 172.21.15.174:0/3432562826 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3d6809f250 0x7f3d6809f6b0 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7f3d64002f30 tx=0x7f3d64007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:53.719 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.713+0000 7f3d57fff700 1 -- 172.21.15.174:0/3432562826 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d640113c0 con 0x7f3d6809f250 2020-04-02T23:21:53.720 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.713+0000 7f3d6ca31700 1 --2- 172.21.15.174:0/3432562826 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3d6809f250 0x7f3d6809f6b0 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7f3d64002f30 tx=0x7f3d64007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:53.720 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.713+0000 7f3d57fff700 1 -- 172.21.15.174:0/3432562826 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d64011520 con 0x7f3d6809f250 2020-04-02T23:21:53.720 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.713+0000 7f3d6ca31700 1 --2- 172.21.15.174:0/3432562826 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3d6809f250 0x7f3d6809f6b0 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7f3d64002f30 tx=0x7f3d64007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:53.720 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.713+0000 7f3d6e234700 1 -- 172.21.15.174:0/3432562826 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3d6809f250 msgr2=0x7f3d6809f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:53.720 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.713+0000 7f3d57fff700 1 -- 172.21.15.174:0/3432562826 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d64011900 con 0x7f3d6809f250 2020-04-02T23:21:53.720 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.713+0000 7f3d6e234700 1 --2- 172.21.15.174:0/3432562826 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3d6809f250 0x7f3d6809f6b0 secure :-1 s=READY pgs=35 cs=0 l=1 rx=0x7f3d64002f30 tx=0x7f3d64007a40).stop 2020-04-02T23:21:53.720 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.713+0000 7f3d6e234700 1 -- 172.21.15.174:0/3432562826 shutdown_connections 2020-04-02T23:21:53.721 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.713+0000 7f3d6e234700 1 --2- 172.21.15.174:0/3432562826 >> v2:172.21.15.196:3300/0 conn(0x7f3d6809fb10 0x7f3d6813fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:53.721 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.713+0000 7f3d6e234700 1 --2- 172.21.15.174:0/3432562826 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3d6809f250 0x7f3d6809f6b0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:53.721 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.713+0000 7f3d6e234700 1 -- 172.21.15.174:0/3432562826 >> 172.21.15.174:0/3432562826 conn(0x7f3d680a6d00 msgr2=0x7f3d680a7110 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:53.721 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.713+0000 7f3d6e234700 1 -- 172.21.15.174:0/3432562826 shutdown_connections 2020-04-02T23:21:53.721 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.713+0000 7f3d6e234700 1 -- 172.21.15.174:0/3432562826 wait complete. 2020-04-02T23:21:53.721 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.714+0000 7f3d6e234700 1 Processor -- start 2020-04-02T23:21:53.721 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.714+0000 7f3d6e234700 1 -- start start 2020-04-02T23:21:53.725 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.715+0000 7f3d6e234700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3d6805bf90 0x7f3d68130b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:53.725 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.715+0000 7f3d6e234700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f3d6809f250 0x7f3d68141590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:53.725 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.715+0000 7f3d6e234700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d68132410 con 0x7f3d6809fb10 2020-04-02T23:21:53.726 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.715+0000 7f3d6e234700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d681326b0 con 0x7f3d6809f250 2020-04-02T23:21:53.726 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.715+0000 7f3d6e234700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d68132950 con 0x7f3d6805bf90 2020-04-02T23:21:53.726 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.715+0000 7f3d6d232700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3d6805bf90 0x7f3d68130b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:53.726 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.715+0000 7f3d6d232700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3d6805bf90 0x7f3d68130b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.174:34782/0 (socket says 172.21.15.174:34782) 2020-04-02T23:21:53.726 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.715+0000 7f3d6da33700 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f3d6809fb10 0x7f3d6809cf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.174:51330/0 (socket says 172.21.15.174:51330) 2020-04-02T23:21:53.726 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.715+0000 7f3d6d232700 1 -- 172.21.15.174:0/4124584993 learned_addr learned my addr 172.21.15.174:0/4124584993 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:21:53.726 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.715+0000 7f3d6ca31700 1 --2- 172.21.15.174:0/4124584993 >> v2:172.21.15.196:3300/0 conn(0x7f3d6809f250 0x7f3d68141590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:53.727 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.715+0000 7f3d567fc700 1 -- 172.21.15.174:0/4124584993 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1206496133 0 0) 0x7f3d68132410 con 0x7f3d6809fb10 2020-04-02T23:21:53.727 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.715+0000 7f3d6d232700 1 -- 172.21.15.174:0/4124584993 >> v2:172.21.15.196:3300/0 conn(0x7f3d6809f250 msgr2=0x7f3d68141590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:53.727 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.715+0000 7f3d6d232700 1 --2- 172.21.15.174:0/4124584993 >> v2:172.21.15.196:3300/0 conn(0x7f3d6809f250 0x7f3d68141590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:53.727 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.715+0000 7f3d6d232700 1 -- 172.21.15.174:0/4124584993 >> v1:172.21.15.196:6789/0 conn(0x7f3d6809fb10 legacy=0x7f3d6809cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:53.727 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.715+0000 7f3d6d232700 1 -- 172.21.15.174:0/4124584993 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d680a70e0 con 0x7f3d6805bf90 2020-04-02T23:21:53.727 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.715+0000 7f3d6d232700 1 --2- 172.21.15.174:0/4124584993 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3d6805bf90 0x7f3d68130b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3d58000b80 tx=0x7f3d58010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:53.727 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.715+0000 7f3d6d232700 1 --2- 172.21.15.174:0/4124584993 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3d6805bf90 0x7f3d68130b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3d58000b80 tx=0x7f3d58010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:53.727 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.715+0000 7f3d6d232700 1 --2- 172.21.15.174:0/4124584993 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3d6805bf90 0x7f3d68130b40 secure :-1 s=READY pgs=36 cs=0 l=1 rx=0x7f3d58000b80 tx=0x7f3d58010940).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:53.728 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.715+0000 7f3d6d232700 1 --2- 172.21.15.174:0/4124584993 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3d6805bf90 0x7f3d68130b40 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7f3d58000b80 tx=0x7f3d58010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:53.728 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.715+0000 7f3d567fc700 1 -- 172.21.15.174:0/4124584993 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d58011650 con 0x7f3d6805bf90 2020-04-02T23:21:53.728 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.716+0000 7f3d6d232700 1 --2- 172.21.15.174:0/4124584993 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3d6805bf90 0x7f3d68130b40 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7f3d58000b80 tx=0x7f3d58010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:53.728 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.716+0000 7f3d6d232700 1 --2- 172.21.15.174:0/4124584993 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3d6805bf90 0x7f3d68130b40 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7f3d58000b80 tx=0x7f3d58010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:53.728 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.716+0000 7f3d567fc700 1 -- 172.21.15.174:0/4124584993 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d580117b0 con 0x7f3d6805bf90 2020-04-02T23:21:53.728 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.716+0000 7f3d567fc700 1 -- 172.21.15.174:0/4124584993 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d58011b90 con 0x7f3d6805bf90 2020-04-02T23:21:53.728 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.716+0000 7f3d6e234700 1 -- 172.21.15.174:0/4124584993 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d68132c60 con 0x7f3d6805bf90 2020-04-02T23:21:53.729 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.716+0000 7f3d6e234700 1 -- 172.21.15.174:0/4124584993 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d68130320 con 0x7f3d6805bf90 2020-04-02T23:21:53.729 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.716+0000 7f3d6d232700 1 --2- 172.21.15.174:0/4124584993 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3d6805bf90 0x7f3d68130b40 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7f3d58000b80 tx=0x7f3d58010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:53.729 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.717+0000 7f3d567fc700 1 -- 172.21.15.174:0/4124584993 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f3d5800b0a0 con 0x7f3d6805bf90 2020-04-02T23:21:53.729 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.717+0000 7f3d6e234700 1 -- 172.21.15.174:0/4124584993 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d6809d9b0 con 0x7f3d6805bf90 2020-04-02T23:21:53.729 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.717+0000 7f3d6d232700 1 --2- 172.21.15.174:0/4124584993 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3d6805bf90 0x7f3d68130b40 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7f3d58000b80 tx=0x7f3d58010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:53.729 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.717+0000 7f3d567fc700 1 --2- 172.21.15.174:0/4124584993 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f3d4804d470 0x7f3d4804f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:53.729 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.717+0000 7f3d567fc700 1 -- 172.21.15.174:0/4124584993 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3d58060d80 con 0x7f3d6805bf90 2020-04-02T23:21:53.729 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.717+0000 7f3d6ca31700 1 --2- 172.21.15.174:0/4124584993 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f3d4804d470 0x7f3d4804f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:53.730 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.717+0000 7f3d6ca31700 1 --2- 172.21.15.174:0/4124584993 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f3d4804d470 0x7f3d4804f930 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3d64002f30 tx=0x7f3d64007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:53.730 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.718+0000 7f3d6ca31700 1 --2- 172.21.15.174:0/4124584993 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f3d4804d470 0x7f3d4804f930 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3d64002f30 tx=0x7f3d64007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:53.730 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.718+0000 7f3d6ca31700 1 --2- 172.21.15.174:0/4124584993 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f3d4804d470 0x7f3d4804f930 secure :-1 s=READY pgs=92 cs=0 l=1 rx=0x7f3d64002f30 tx=0x7f3d64007a40).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:53.730 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.721+0000 7f3d6d232700 1 --2- 172.21.15.174:0/4124584993 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3d6805bf90 0x7f3d68130b40 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7f3d58000b80 tx=0x7f3d58010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:53.730 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.721+0000 7f3d567fc700 1 -- 172.21.15.174:0/4124584993 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f3d5803c4e0 con 0x7f3d6805bf90 2020-04-02T23:21:53.817 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:53.832 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:21:53.864 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.861+0000 7f3d6e234700 1 -- 172.21.15.174:0/4124584993 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3d68056c50 con 0x7f3d6805bf90 2020-04-02T23:21:53.865 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.862+0000 7f3d6d232700 1 --2- 172.21.15.174:0/4124584993 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3d6805bf90 0x7f3d68130b40 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7f3d58000b80 tx=0x7f3d58010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:53.865 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.862+0000 7f3d567fc700 1 -- 172.21.15.174:0/4124584993 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+10 (secure 0 0 0) 0x7f3d5803fb00 con 0x7f3d6805bf90 2020-04-02T23:21:53.866 INFO:teuthology.orchestra.run.smithi174.stdout:pg_num: 8 2020-04-02T23:21:53.867 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:53.868 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.863+0000 7f3d6e234700 1 -- 172.21.15.174:0/4124584993 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f3d4804d470 msgr2=0x7f3d4804f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:53.868 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.863+0000 7f3d6e234700 1 --2- 172.21.15.174:0/4124584993 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f3d4804d470 0x7f3d4804f930 secure :-1 s=READY pgs=92 cs=0 l=1 rx=0x7f3d64002f30 tx=0x7f3d64007a40).stop 2020-04-02T23:21:53.869 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.863+0000 7f3d6e234700 1 -- 172.21.15.174:0/4124584993 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3d6805bf90 msgr2=0x7f3d68130b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:53.869 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.863+0000 7f3d6e234700 1 --2- 172.21.15.174:0/4124584993 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3d6805bf90 0x7f3d68130b40 secure :-1 s=READY pgs=36 cs=0 l=1 rx=0x7f3d58000b80 tx=0x7f3d58010940).stop 2020-04-02T23:21:53.869 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.863+0000 7f3d6e234700 1 -- 172.21.15.174:0/4124584993 shutdown_connections 2020-04-02T23:21:53.869 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.863+0000 7f3d6e234700 1 --2- 172.21.15.174:0/4124584993 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f3d4804d470 0x7f3d4804f930 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:53.870 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.863+0000 7f3d6e234700 1 --2- 172.21.15.174:0/4124584993 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3d6805bf90 0x7f3d68130b40 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:53.870 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.863+0000 7f3d6e234700 1 --2- 172.21.15.174:0/4124584993 >> v2:172.21.15.196:3300/0 conn(0x7f3d6809f250 0x7f3d68141590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:53.870 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.863+0000 7f3d6e234700 1 -- 172.21.15.174:0/4124584993 >> 172.21.15.174:0/4124584993 conn(0x7f3d680a6d00 msgr2=0x7f3d680a13a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:53.870 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.863+0000 7f3d6e234700 1 -- 172.21.15.174:0/4124584993 shutdown_connections 2020-04-02T23:21:53.871 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:53.863+0000 7f3d6e234700 1 -- 172.21.15.174:0/4124584993 wait complete. 2020-04-02T23:21:53.877 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:53.887 INFO:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:21:53.974 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-04-02T23:21:54.117 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.115+0000 7f07df59e700 1 Processor -- start 2020-04-02T23:21:54.118 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.115+0000 7f07df59e700 1 -- start start 2020-04-02T23:21:54.123 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.116+0000 7f07df59e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f07e009e300 0x7f07e00a4b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:54.123 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.116+0000 7f07df59e700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f07e00a4f90 0x7f07e0137bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:54.123 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.116+0000 7f07df59e700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f07e005bc10 0x7f07e0138030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:54.123 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.116+0000 7f07df59e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07e00a42f0 con 0x7f07e009e300 2020-04-02T23:21:54.123 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.116+0000 7f07df59e700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07e00a10a0 con 0x7f07e00a4f90 2020-04-02T23:21:54.124 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.116+0000 7f07df59e700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07e00a2a90 con 0x7f07e005bc10 2020-04-02T23:21:54.124 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.116+0000 7f07de59c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f07e009e300 0x7f07e00a4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:54.124 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.116+0000 7f07de59c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f07e009e300 0x7f07e00a4b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:40202/0 (socket says 172.21.15.174:40202) 2020-04-02T23:21:54.124 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.116+0000 7f07de59c700 1 -- 172.21.15.174:0/2949265089 learned_addr learned my addr 172.21.15.174:0/2949265089 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:21:54.124 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.116+0000 7f07ded9d700 1 --2- 172.21.15.174:0/2949265089 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f07e005bc10 0x7f07e0138030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:54.124 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.116+0000 7f07de59c700 1 -- 172.21.15.174:0/2949265089 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f07e005bc10 msgr2=0x7f07e0138030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:54.124 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.116+0000 7f07ddd9b700 1 --2- 172.21.15.174:0/2949265089 >> v2:172.21.15.196:3300/0 conn(0x7f07e00a4f90 0x7f07e0137bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:54.124 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.116+0000 7f07de59c700 1 --2- 172.21.15.174:0/2949265089 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f07e005bc10 0x7f07e0138030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:54.125 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.116+0000 7f07de59c700 1 -- 172.21.15.174:0/2949265089 >> v2:172.21.15.196:3300/0 conn(0x7f07e00a4f90 msgr2=0x7f07e0137bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:54.125 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.116+0000 7f07de59c700 1 --2- 172.21.15.174:0/2949265089 >> v2:172.21.15.196:3300/0 conn(0x7f07e00a4f90 0x7f07e0137bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:54.125 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.116+0000 7f07de59c700 1 -- 172.21.15.174:0/2949265089 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e00a2d30 con 0x7f07e009e300 2020-04-02T23:21:54.125 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.116+0000 7f07de59c700 1 --2- 172.21.15.174:0/2949265089 >> v2:172.21.15.174:3300/0 conn(0x7f07e009e300 0x7f07e00a4b30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f07d4002f30 tx=0x7f07d4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:54.125 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.116+0000 7f07de59c700 1 --2- 172.21.15.174:0/2949265089 >> v2:172.21.15.174:3300/0 conn(0x7f07e009e300 0x7f07e00a4b30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f07d4002f30 tx=0x7f07d4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:54.125 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.116+0000 7f07de59c700 1 --2- 172.21.15.174:0/2949265089 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07e009e300 0x7f07e00a4b30 secure :-1 s=READY pgs=169 cs=0 l=1 rx=0x7f07d4002f30 tx=0x7f07d4007a40).ready entity=mon.0 client_cookie=fa508c6f132937fb server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:54.125 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.117+0000 7f07de59c700 1 -- 172.21.15.174:0/2949265089 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07e009e300 msgr2=0x7f07e00a4b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2020-04-02T23:21:54.126 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.117+0000 7f07de59c700 1 -- 172.21.15.174:0/2949265089 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07e009e300 msgr2=0x7f07e00a4b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2020-04-02T23:21:54.126 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.117+0000 7f07de59c700 1 --2- 172.21.15.174:0/2949265089 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07e009e300 0x7f07e00a4b30 secure :-1 s=READY pgs=169 cs=0 l=1 rx=0x7f07d4002f30 tx=0x7f07d4007a40).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-04-02T23:21:54.126 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.117+0000 7f07de59c700 1 --2- 172.21.15.174:0/2949265089 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07e009e300 0x7f07e00a4b30 secure :-1 s=READY pgs=169 cs=0 l=1 rx=0x7f07d4002f30 tx=0x7f07d4007a40).stop 2020-04-02T23:21:54.126 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.117+0000 7f07dd59a700 1 -- 172.21.15.174:0/2949265089 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07e009e300 msgr2=0x7f07e00a4b30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2020-04-02T23:21:54.126 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.117+0000 7f07dd59a700 1 --2- 172.21.15.174:0/2949265089 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07e009e300 0x7f07e00a4b30 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:54.126 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.117+0000 7f07dd59a700 1 -- 172.21.15.174:0/2949265089 --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07c400ad90 con 0x7f07c4006fe0 2020-04-02T23:21:54.126 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.117+0000 7f07dd59a700 1 -- 172.21.15.174:0/2949265089 --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07c400bf90 con 0x7f07c4003210 2020-04-02T23:21:54.126 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.117+0000 7f07dd59a700 1 -- 172.21.15.174:0/2949265089 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1402638078 0 0) 0x7f07c400ad90 con 0x7f07c4006fe0 2020-04-02T23:21:54.127 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.117+0000 7f07dd59a700 1 -- 172.21.15.174:0/2949265089 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07c400c200 con 0x7f07c4006fe0 2020-04-02T23:21:54.127 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.117+0000 7f07dd59a700 1 -- 172.21.15.174:0/2949265089 <== mon.0 v1:172.21.15.174:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3482917034 0 0) 0x7f07c400c200 con 0x7f07c4006fe0 2020-04-02T23:21:54.127 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.117+0000 7f07dd59a700 1 -- 172.21.15.174:0/2949265089 >> v1:172.21.15.196:6789/0 conn(0x7f07c4003210 legacy=0x7f07c4005690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:54.127 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.117+0000 7f07dd59a700 1 -- 172.21.15.174:0/2949265089 --> v1:172.21.15.174:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07c400d250 con 0x7f07c4006fe0 2020-04-02T23:21:54.130 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.117+0000 7f07dd59a700 1 -- 172.21.15.174:0/2949265089 <== mon.0 v1:172.21.15.174:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2811762909 0 0) 0x7f07d0001470 con 0x7f07c4006fe0 2020-04-02T23:21:54.130 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.117+0000 7f07dd59a700 1 -- 172.21.15.174:0/2949265089 >> v1:172.21.15.174:6789/0 conn(0x7f07c4006fe0 legacy=0x7f07c40094a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:54.130 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.117+0000 7f07ded9d700 1 -- 172.21.15.174:0/2949265089 reap_dead start 2020-04-02T23:21:54.130 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.117+0000 7f07dd59a700 1 --2- 172.21.15.174:0/2949265089 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f07c400c980 0x7f07c4005600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:54.130 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.117+0000 7f07dd59a700 1 --2- 172.21.15.174:0/2949265089 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f07c400af20 0x7f07c400b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:54.130 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.117+0000 7f07dd59a700 1 --2- 172.21.15.174:0/2949265089 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07c400b7e0 0x7f07c4005e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:54.130 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.117+0000 7f07dd59a700 1 -- 172.21.15.174:0/2949265089 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c400bd20 con 0x7f07c400b7e0 2020-04-02T23:21:54.131 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.117+0000 7f07dd59a700 1 -- 172.21.15.174:0/2949265089 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c400cd60 con 0x7f07c400c980 2020-04-02T23:21:54.131 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.117+0000 7f07dd59a700 1 -- 172.21.15.174:0/2949265089 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07c400cf20 con 0x7f07c400af20 2020-04-02T23:21:54.131 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.117+0000 7f07ded9d700 1 --2- 172.21.15.174:0/2949265089 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07c400b7e0 0x7f07c4005e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:54.131 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.117+0000 7f07de59c700 1 --2- 172.21.15.174:0/2949265089 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f07c400c980 0x7f07c4005600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:54.131 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.118+0000 7f07ddd9b700 1 --2- 172.21.15.174:0/2949265089 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f07c400af20 0x7f07c400b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:54.131 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.118+0000 7f07ded9d700 1 -- 172.21.15.174:0/2949265089 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f07c400af20 msgr2=0x7f07c400b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:54.131 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.118+0000 7f07ded9d700 1 --2- 172.21.15.174:0/2949265089 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f07c400af20 0x7f07c400b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:54.131 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.118+0000 7f07ded9d700 1 -- 172.21.15.174:0/2949265089 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f07c400c980 msgr2=0x7f07c4005600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:54.132 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.118+0000 7f07ded9d700 1 --2- 172.21.15.174:0/2949265089 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f07c400c980 0x7f07c4005600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:54.132 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.118+0000 7f07ded9d700 1 -- 172.21.15.174:0/2949265089 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07c400c200 con 0x7f07c400b7e0 2020-04-02T23:21:54.132 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.118+0000 7f07ded9d700 1 --2- 172.21.15.174:0/2949265089 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07c400b7e0 0x7f07c4005e50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f07d40088e0 tx=0x7f07d8007d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:54.132 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.118+0000 7f07ded9d700 1 --2- 172.21.15.174:0/2949265089 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07c400b7e0 0x7f07c4005e50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f07d40088e0 tx=0x7f07d8007d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:54.132 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.118+0000 7f07ded9d700 1 --2- 172.21.15.174:0/2949265089 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07c400b7e0 0x7f07c4005e50 secure :-1 s=READY pgs=171 cs=0 l=1 rx=0x7f07d40088e0 tx=0x7f07d8007d00).ready entity=mon.0 client_cookie=a970bb82aa8cb637 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:54.132 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.119+0000 7f07ded9d700 1 --2- 172.21.15.174:0/2949265089 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07c400b7e0 0x7f07c4005e50 secure :-1 s=THROTTLE_DONE pgs=171 cs=0 l=1 rx=0x7f07d40088e0 tx=0x7f07d8007d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:54.132 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.119+0000 7f07dd59a700 1 -- 172.21.15.174:0/2949265089 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07d8006e50 con 0x7f07c400b7e0 2020-04-02T23:21:54.133 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.119+0000 7f07ded9d700 1 --2- 172.21.15.174:0/2949265089 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07c400b7e0 0x7f07c4005e50 secure :-1 s=THROTTLE_DONE pgs=171 cs=0 l=1 rx=0x7f07d40088e0 tx=0x7f07d8007d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:54.133 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.119+0000 7f07ded9d700 1 --2- 172.21.15.174:0/2949265089 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07c400b7e0 0x7f07c4005e50 secure :-1 s=THROTTLE_DONE pgs=171 cs=0 l=1 rx=0x7f07d40088e0 tx=0x7f07d8007d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:54.133 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.119+0000 7f07dd59a700 1 -- 172.21.15.174:0/2949265089 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d80116d0 con 0x7f07c400b7e0 2020-04-02T23:21:54.133 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.119+0000 7f07dd59a700 1 -- 172.21.15.174:0/2949265089 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07d8011a70 con 0x7f07c400b7e0 2020-04-02T23:21:54.133 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.119+0000 7f07df59e700 1 -- 172.21.15.174:0/2949265089 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07c400b7e0 msgr2=0x7f07c4005e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:54.133 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.119+0000 7f07df59e700 1 --2- 172.21.15.174:0/2949265089 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07c400b7e0 0x7f07c4005e50 secure :-1 s=READY pgs=171 cs=0 l=1 rx=0x7f07d40088e0 tx=0x7f07d8007d00).stop 2020-04-02T23:21:54.133 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.119+0000 7f07df59e700 1 -- 172.21.15.174:0/2949265089 shutdown_connections 2020-04-02T23:21:54.134 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.119+0000 7f07df59e700 1 --2- 172.21.15.174:0/2949265089 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07c400b7e0 0x7f07c4005e50 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:54.134 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.119+0000 7f07df59e700 1 --2- 172.21.15.174:0/2949265089 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f07c400af20 0x7f07c400b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:54.134 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.119+0000 7f07df59e700 1 --2- 172.21.15.174:0/2949265089 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f07c400c980 0x7f07c4005600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:54.134 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.120+0000 7f07df59e700 1 --2- 172.21.15.174:0/2949265089 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07e009e300 0x7f07e00a4b30 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:54.134 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.120+0000 7f07df59e700 1 -- 172.21.15.174:0/2949265089 >> 172.21.15.174:0/2949265089 conn(0x7f07e00a6d00 msgr2=0x7f07e00a7110 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:54.134 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.120+0000 7f07df59e700 1 -- 172.21.15.174:0/2949265089 shutdown_connections 2020-04-02T23:21:54.134 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.120+0000 7f07df59e700 1 -- 172.21.15.174:0/2949265089 wait complete. 2020-04-02T23:21:54.134 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.120+0000 7f07df59e700 1 Processor -- start 2020-04-02T23:21:54.135 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.120+0000 7f07df59e700 1 -- start start 2020-04-02T23:21:54.139 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.121+0000 7f07df59e700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f07c400c980 0x7f07e0134480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:54.139 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.121+0000 7f07df59e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07e0062b00 con 0x7f07c400b7e0 2020-04-02T23:21:54.139 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.121+0000 7f07df59e700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07e0060a30 con 0x7f07c400af20 2020-04-02T23:21:54.139 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.121+0000 7f07df59e700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07e0062d30 con 0x7f07c400c980 2020-04-02T23:21:54.139 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.121+0000 7f07ddd9b700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f07c400b7e0 0x7f07e0133d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:45256/0 (socket says 172.21.15.174:45256) 2020-04-02T23:21:54.139 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.121+0000 7f07ddd9b700 1 -- 172.21.15.174:0/3771713810 learned_addr learned my addr 172.21.15.174:0/3771713810 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:21:54.140 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.121+0000 7f07ded9d700 1 --2- 172.21.15.174:0/3771713810 >> v2:172.21.15.196:3300/0 conn(0x7f07c400c980 0x7f07e0134480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:54.140 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.121+0000 7f07cf7fe700 1 -- 172.21.15.174:0/3771713810 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3328673072 0 0) 0x7f07e0062b00 con 0x7f07c400b7e0 2020-04-02T23:21:54.140 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.121+0000 7f07cf7fe700 1 -- 172.21.15.174:0/3771713810 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07bc002fe0 con 0x7f07c400b7e0 2020-04-02T23:21:54.140 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.121+0000 7f07cf7fe700 1 -- 172.21.15.174:0/3771713810 <== mon.0 v1:172.21.15.174:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2580757434 0 0) 0x7f07bc002fe0 con 0x7f07c400b7e0 2020-04-02T23:21:54.140 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.121+0000 7f07ded9d700 1 -- 172.21.15.174:0/3771713810 >> v1:172.21.15.196:6789/0 conn(0x7f07c400af20 legacy=0x7f07e0132fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:54.140 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.121+0000 7f07ded9d700 1 -- 172.21.15.174:0/3771713810 >> v1:172.21.15.174:6789/0 conn(0x7f07c400b7e0 legacy=0x7f07e0133d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:54.140 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.122+0000 7f07ded9d700 1 -- 172.21.15.174:0/3771713810 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e0062fd0 con 0x7f07c400c980 2020-04-02T23:21:54.141 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.122+0000 7f07ded9d700 1 --2- 172.21.15.174:0/3771713810 >> v2:172.21.15.196:3300/0 conn(0x7f07c400c980 0x7f07e0134480 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f07d000fa40 tx=0x7f07d8007d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:54.141 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.122+0000 7f07ded9d700 1 --2- 172.21.15.174:0/3771713810 >> v2:172.21.15.196:3300/0 conn(0x7f07c400c980 0x7f07e0134480 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f07d000fa40 tx=0x7f07d8007d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:54.141 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.122+0000 7f07ded9d700 1 --2- 172.21.15.174:0/3771713810 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f07c400c980 0x7f07e0134480 secure :-1 s=READY pgs=131 cs=0 l=1 rx=0x7f07d000fa40 tx=0x7f07d8007d00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:54.141 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.122+0000 7f07ded9d700 1 --2- 172.21.15.174:0/3771713810 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f07c400c980 0x7f07e0134480 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7f07d000fa40 tx=0x7f07d8007d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:54.141 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.122+0000 7f07cf7fe700 1 -- 172.21.15.174:0/3771713810 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07d0001470 con 0x7f07c400c980 2020-04-02T23:21:54.141 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.122+0000 7f07ded9d700 1 --2- 172.21.15.174:0/3771713810 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f07c400c980 0x7f07e0134480 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7f07d000fa40 tx=0x7f07d8007d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:54.141 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.122+0000 7f07cf7fe700 1 -- 172.21.15.174:0/3771713810 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d8007380 con 0x7f07c400c980 2020-04-02T23:21:54.141 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.122+0000 7f07ded9d700 1 --2- 172.21.15.174:0/3771713810 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f07c400c980 0x7f07e0134480 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7f07d000fa40 tx=0x7f07d8007d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:54.142 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.122+0000 7f07df59e700 1 -- 172.21.15.174:0/3771713810 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07e00a7a30 con 0x7f07c400c980 2020-04-02T23:21:54.142 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.122+0000 7f07cf7fe700 1 -- 172.21.15.174:0/3771713810 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07d80076e0 con 0x7f07c400c980 2020-04-02T23:21:54.142 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.122+0000 7f07df59e700 1 -- 172.21.15.174:0/3771713810 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07e01352d0 con 0x7f07c400c980 2020-04-02T23:21:54.142 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.122+0000 7f07ded9d700 1 --2- 172.21.15.174:0/3771713810 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f07c400c980 0x7f07e0134480 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7f07d000fa40 tx=0x7f07d8007d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:54.142 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.123+0000 7f07cf7fe700 1 -- 172.21.15.174:0/3771713810 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f07d8007840 con 0x7f07c400c980 2020-04-02T23:21:54.142 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.123+0000 7f07ded9d700 1 --2- 172.21.15.174:0/3771713810 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f07c400c980 0x7f07e0134480 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7f07d000fa40 tx=0x7f07d8007d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:54.142 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.123+0000 7f07df59e700 1 -- 172.21.15.174:0/3771713810 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07e0135580 con 0x7f07c400c980 2020-04-02T23:21:54.143 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.123+0000 7f07cf7fe700 1 --2- 172.21.15.174:0/3771713810 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f07bc04d830 0x7f07bc04fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:54.143 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.123+0000 7f07cf7fe700 1 -- 172.21.15.174:0/3771713810 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f07d8061770 con 0x7f07c400c980 2020-04-02T23:21:54.143 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.124+0000 7f07de59c700 1 --2- 172.21.15.174:0/3771713810 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f07bc04d830 0x7f07bc04fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:54.143 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.124+0000 7f07de59c700 1 --2- 172.21.15.174:0/3771713810 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f07bc04d830 0x7f07bc04fcf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f07d4008320 tx=0x7f07d4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:54.143 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.124+0000 7f07de59c700 1 --2- 172.21.15.174:0/3771713810 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f07bc04d830 0x7f07bc04fcf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f07d4008320 tx=0x7f07d4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:54.143 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.124+0000 7f07de59c700 1 --2- 172.21.15.174:0/3771713810 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f07bc04d830 0x7f07bc04fcf0 secure :-1 s=READY pgs=93 cs=0 l=1 rx=0x7f07d4008320 tx=0x7f07d4007a40).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:54.143 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.127+0000 7f07ded9d700 1 --2- 172.21.15.174:0/3771713810 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f07c400c980 0x7f07e0134480 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7f07d000fa40 tx=0x7f07d8007d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:54.144 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.127+0000 7f07cf7fe700 1 -- 172.21.15.174:0/3771713810 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f07d8040e60 con 0x7f07c400c980 2020-04-02T23:21:54.268 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.265+0000 7f07df59e700 1 -- 172.21.15.174:0/3771713810 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f07e0063160 con 0x7f07c400c980 2020-04-02T23:21:54.268 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.266+0000 7f07ded9d700 1 --2- 172.21.15.174:0/3771713810 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f07c400c980 0x7f07e0134480 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7f07d000fa40 tx=0x7f07d8007d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:54.269 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.266+0000 7f07cf7fe700 1 -- 172.21.15.174:0/3771713810 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+10 (secure 0 0 0) 0x7f07d803cf70 con 0x7f07c400c980 2020-04-02T23:21:54.269 INFO:teuthology.orchestra.run.smithi174.stdout:pg_num: 8 2020-04-02T23:21:54.270 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.267+0000 7f07df59e700 1 -- 172.21.15.174:0/3771713810 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f07bc04d830 msgr2=0x7f07bc04fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:54.270 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.267+0000 7f07df59e700 1 --2- 172.21.15.174:0/3771713810 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f07bc04d830 0x7f07bc04fcf0 secure :-1 s=READY pgs=93 cs=0 l=1 rx=0x7f07d4008320 tx=0x7f07d4007a40).stop 2020-04-02T23:21:54.270 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.267+0000 7f07df59e700 1 -- 172.21.15.174:0/3771713810 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f07c400c980 msgr2=0x7f07e0134480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:54.271 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.267+0000 7f07df59e700 1 --2- 172.21.15.174:0/3771713810 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f07c400c980 0x7f07e0134480 secure :-1 s=READY pgs=131 cs=0 l=1 rx=0x7f07d000fa40 tx=0x7f07d8007d00).stop 2020-04-02T23:21:54.271 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.267+0000 7f07df59e700 1 -- 172.21.15.174:0/3771713810 shutdown_connections 2020-04-02T23:21:54.271 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.267+0000 7f07df59e700 1 --2- 172.21.15.174:0/3771713810 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f07c400c980 0x7f07e0134480 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:54.271 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.267+0000 7f07df59e700 1 --2- 172.21.15.174:0/3771713810 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f07bc04d830 0x7f07bc04fcf0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:54.271 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.267+0000 7f07df59e700 1 -- 172.21.15.174:0/3771713810 >> 172.21.15.174:0/3771713810 conn(0x7f07e00a6d00 msgr2=0x7f07e00a9a80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:54.271 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.268+0000 7f07df59e700 1 -- 172.21.15.174:0/3771713810 shutdown_connections 2020-04-02T23:21:54.271 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.268+0000 7f07df59e700 1 -- 172.21.15.174:0/3771713810 wait complete. 2020-04-02T23:21:54.281 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:54.294 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-02T23:21:54.442 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.440+0000 7fc62b262700 1 Processor -- start 2020-04-02T23:21:54.443 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.440+0000 7fc62b262700 1 -- start start 2020-04-02T23:21:54.461 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.441+0000 7fc62b262700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc62412e970 0x7fc624135030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:54.461 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.441+0000 7fc62b262700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc624134420 con 0x7fc62405ac00 2020-04-02T23:21:54.461 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.441+0000 7fc62b262700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc62405b090 con 0x7fc6240a5900 2020-04-02T23:21:54.461 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.441+0000 7fc62b262700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6240a49d0 con 0x7fc62412e970 2020-04-02T23:21:54.462 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.441+0000 7fc6297ff700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fc62405ac00 0x7fc62413ed90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:45266/0 (socket says 172.21.15.174:45266) 2020-04-02T23:21:54.477 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.441+0000 7fc6297ff700 1 -- 172.21.15.174:0/2143194644 learned_addr learned my addr 172.21.15.174:0/2143194644 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:21:54.477 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.441+0000 7fc623fff700 1 --2- 172.21.15.174:0/2143194644 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc62412e970 0x7fc624135030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:54.477 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.441+0000 7fc6237fe700 1 -- 172.21.15.174:0/2143194644 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 555491264 0 0) 0x7fc624134420 con 0x7fc62405ac00 2020-04-02T23:21:54.477 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.441+0000 7fc6237fe700 1 -- 172.21.15.174:0/2143194644 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc610003230 con 0x7fc62405ac00 2020-04-02T23:21:54.477 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.441+0000 7fc6237fe700 1 -- 172.21.15.174:0/2143194644 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1213807431 0 0) 0x7fc62405b090 con 0x7fc6240a5900 2020-04-02T23:21:54.478 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.441+0000 7fc6237fe700 1 -- 172.21.15.174:0/2143194644 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc624134420 con 0x7fc6240a5900 2020-04-02T23:21:54.478 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.441+0000 7fc6237fe700 1 -- 172.21.15.174:0/2143194644 <== mon.0 v1:172.21.15.174:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3973434317 0 0) 0x7fc610003230 con 0x7fc62405ac00 2020-04-02T23:21:54.478 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.441+0000 7fc6237fe700 1 -- 172.21.15.174:0/2143194644 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc62412e970 msgr2=0x7fc624135030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:54.478 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.441+0000 7fc6237fe700 1 --2- 172.21.15.174:0/2143194644 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc62412e970 0x7fc624135030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:54.478 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.441+0000 7fc6237fe700 1 -- 172.21.15.174:0/2143194644 >> v1:172.21.15.196:6789/0 conn(0x7fc6240a5900 legacy=0x7fc62412e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:54.478 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.441+0000 7fc6237fe700 1 -- 172.21.15.174:0/2143194644 --> v1:172.21.15.174:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc624134650 con 0x7fc62405ac00 2020-04-02T23:21:54.478 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.441+0000 7fc6237fe700 1 -- 172.21.15.174:0/2143194644 <== mon.0 v1:172.21.15.174:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2811762909 0 0) 0x7fc61c001a50 con 0x7fc62405ac00 2020-04-02T23:21:54.479 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.441+0000 7fc6237fe700 1 -- 172.21.15.174:0/2143194644 >> v1:172.21.15.174:6789/0 conn(0x7fc62405ac00 legacy=0x7fc62413ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:54.479 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.441+0000 7fc6237fe700 1 --2- 172.21.15.174:0/2143194644 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6100038e0 0x7fc610003ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:54.479 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.441+0000 7fc6237fe700 1 --2- 172.21.15.174:0/2143194644 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc6100044d0 0x7fc610004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:54.479 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.441+0000 7fc6237fe700 1 --2- 172.21.15.174:0/2143194644 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc610004db0 0x7fc61000b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:54.480 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.441+0000 7fc6237fe700 1 -- 172.21.15.174:0/2143194644 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6240a49d0 con 0x7fc6100044d0 2020-04-02T23:21:54.480 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.441+0000 7fc6237fe700 1 -- 172.21.15.174:0/2143194644 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6100051b0 con 0x7fc6100038e0 2020-04-02T23:21:54.480 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.441+0000 7fc6237fe700 1 -- 172.21.15.174:0/2143194644 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc610005370 con 0x7fc610004db0 2020-04-02T23:21:54.480 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.441+0000 7fc623fff700 1 --2- 172.21.15.174:0/2143194644 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc6100044d0 0x7fc610004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:54.480 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.441+0000 7fc628ffe700 1 --2- 172.21.15.174:0/2143194644 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6100038e0 0x7fc610003ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:54.480 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.441+0000 7fc6297ff700 1 --2- 172.21.15.174:0/2143194644 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc610004db0 0x7fc61000b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:54.481 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.442+0000 7fc623fff700 1 -- 172.21.15.174:0/2143194644 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc610004db0 msgr2=0x7fc61000b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:54.481 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.442+0000 7fc623fff700 1 --2- 172.21.15.174:0/2143194644 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc610004db0 0x7fc61000b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:54.481 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.442+0000 7fc623fff700 1 -- 172.21.15.174:0/2143194644 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6100038e0 msgr2=0x7fc610003ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:54.481 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.442+0000 7fc623fff700 1 --2- 172.21.15.174:0/2143194644 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6100038e0 0x7fc610003ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:54.481 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.442+0000 7fc623fff700 1 -- 172.21.15.174:0/2143194644 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc610003230 con 0x7fc6100044d0 2020-04-02T23:21:54.482 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.442+0000 7fc623fff700 1 --2- 172.21.15.174:0/2143194644 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc6100044d0 0x7fc610004950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc618002f30 tx=0x7fc618010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:54.482 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.442+0000 7fc623fff700 1 --2- 172.21.15.174:0/2143194644 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc6100044d0 0x7fc610004950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc618002f30 tx=0x7fc618010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:54.482 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.442+0000 7fc623fff700 1 --2- 172.21.15.174:0/2143194644 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc6100044d0 0x7fc610004950 secure :-1 s=READY pgs=174 cs=0 l=1 rx=0x7fc618002f30 tx=0x7fc618010020).ready entity=mon.0 client_cookie=5d90cf1aa5d81561 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:54.482 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.442+0000 7fc623fff700 1 --2- 172.21.15.174:0/2143194644 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc6100044d0 0x7fc610004950 secure :-1 s=THROTTLE_DONE pgs=174 cs=0 l=1 rx=0x7fc618002f30 tx=0x7fc618010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:54.483 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.442+0000 7fc6237fe700 1 -- 172.21.15.174:0/2143194644 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc618008d30 con 0x7fc6100044d0 2020-04-02T23:21:54.483 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.442+0000 7fc623fff700 1 --2- 172.21.15.174:0/2143194644 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc6100044d0 0x7fc610004950 secure :-1 s=THROTTLE_DONE pgs=174 cs=0 l=1 rx=0x7fc618002f30 tx=0x7fc618010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:54.483 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.442+0000 7fc6237fe700 1 -- 172.21.15.174:0/2143194644 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc618008e90 con 0x7fc6100044d0 2020-04-02T23:21:54.483 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.442+0000 7fc623fff700 1 --2- 172.21.15.174:0/2143194644 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc6100044d0 0x7fc610004950 secure :-1 s=THROTTLE_DONE pgs=174 cs=0 l=1 rx=0x7fc618002f30 tx=0x7fc618010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:54.483 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.442+0000 7fc6237fe700 1 -- 172.21.15.174:0/2143194644 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc618010a90 con 0x7fc6100044d0 2020-04-02T23:21:54.483 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.442+0000 7fc62b262700 1 -- 172.21.15.174:0/2143194644 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc6100044d0 msgr2=0x7fc610004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:54.483 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.442+0000 7fc62b262700 1 --2- 172.21.15.174:0/2143194644 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc6100044d0 0x7fc610004950 secure :-1 s=READY pgs=174 cs=0 l=1 rx=0x7fc618002f30 tx=0x7fc618010020).stop 2020-04-02T23:21:54.484 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.442+0000 7fc6297ff700 1 -- 172.21.15.174:0/2143194644 reap_dead start 2020-04-02T23:21:54.484 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.442+0000 7fc62b262700 1 -- 172.21.15.174:0/2143194644 shutdown_connections 2020-04-02T23:21:54.484 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.442+0000 7fc62b262700 1 -- 172.21.15.174:0/2143194644 >> 172.21.15.174:0/2143194644 conn(0x7fc6240aaf80 msgr2=0x7fc6240a6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:54.484 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.443+0000 7fc62b262700 1 -- 172.21.15.174:0/2143194644 shutdown_connections 2020-04-02T23:21:54.484 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.443+0000 7fc62b262700 1 -- 172.21.15.174:0/2143194644 wait complete. 2020-04-02T23:21:54.484 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.443+0000 7fc62b262700 1 Processor -- start 2020-04-02T23:21:54.496 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.443+0000 7fc62b262700 1 -- start start 2020-04-02T23:21:54.497 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.444+0000 7fc62b262700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc624130280 0x7fc624144670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:54.497 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.444+0000 7fc62b262700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fc6241378a0 0x7fc624144ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:54.497 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.444+0000 7fc62b262700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc62405f2b0 con 0x7fc6241381b0 2020-04-02T23:21:54.497 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.444+0000 7fc62b262700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc624136a90 con 0x7fc6241378a0 2020-04-02T23:21:54.497 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.444+0000 7fc62b262700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc624136d30 con 0x7fc624130280 2020-04-02T23:21:54.497 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.444+0000 7fc628ffe700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc624130280 0x7fc624144670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:54.498 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.444+0000 7fc623fff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fc6241378a0 0x7fc624144ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:54.498 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.444+0000 7fc628ffe700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc624130280 0x7fc624144670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.174:34824/0 (socket says 172.21.15.174:34824) 2020-04-02T23:21:54.498 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.444+0000 7fc628ffe700 1 -- 172.21.15.174:0/2210783010 learned_addr learned my addr 172.21.15.174:0/2210783010 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:21:54.498 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.445+0000 7fc623fff700 1 -- 172.21.15.174:0/2210783010 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc624130280 msgr2=0x7fc624144670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:54.498 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.445+0000 7fc623fff700 1 --2- 172.21.15.174:0/2210783010 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc624130280 0x7fc624144670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:54.498 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.445+0000 7fc623fff700 1 -- 172.21.15.174:0/2210783010 >> v1:172.21.15.196:6789/0 conn(0x7fc6241381b0 legacy=0x7fc62412d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:54.498 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.445+0000 7fc621ffb700 1 -- 172.21.15.174:0/2210783010 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 968025037 0 0) 0x7fc62405f2b0 con 0x7fc6241381b0 2020-04-02T23:21:54.499 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.445+0000 7fc623fff700 1 -- 172.21.15.174:0/2210783010 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc624136fd0 con 0x7fc6241378a0 2020-04-02T23:21:54.499 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.445+0000 7fc623fff700 1 --2- 172.21.15.174:0/2210783010 >> v2:172.21.15.196:3300/0 conn(0x7fc6241378a0 0x7fc624144ad0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc618002f30 tx=0x7fc618010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:54.499 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.445+0000 7fc623fff700 1 --2- 172.21.15.174:0/2210783010 >> v2:172.21.15.196:3300/0 conn(0x7fc6241378a0 0x7fc624144ad0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc618002f30 tx=0x7fc618010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:54.499 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.445+0000 7fc623fff700 1 --2- 172.21.15.174:0/2210783010 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6241378a0 0x7fc624144ad0 secure :-1 s=READY pgs=134 cs=0 l=1 rx=0x7fc618002f30 tx=0x7fc618010020).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:54.499 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.445+0000 7fc623fff700 1 --2- 172.21.15.174:0/2210783010 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6241378a0 0x7fc624144ad0 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7fc618002f30 tx=0x7fc618010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:54.499 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.445+0000 7fc621ffb700 1 -- 172.21.15.174:0/2210783010 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc618010e20 con 0x7fc6241378a0 2020-04-02T23:21:54.499 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.445+0000 7fc623fff700 1 --2- 172.21.15.174:0/2210783010 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6241378a0 0x7fc624144ad0 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7fc618002f30 tx=0x7fc618010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:54.500 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.445+0000 7fc621ffb700 1 -- 172.21.15.174:0/2210783010 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6180056c0 con 0x7fc6241378a0 2020-04-02T23:21:54.500 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.445+0000 7fc623fff700 1 --2- 172.21.15.174:0/2210783010 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6241378a0 0x7fc624144ad0 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7fc618002f30 tx=0x7fc618010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:54.500 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.445+0000 7fc62b262700 1 -- 172.21.15.174:0/2210783010 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc624136780 con 0x7fc6241378a0 2020-04-02T23:21:54.500 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.445+0000 7fc621ffb700 1 -- 172.21.15.174:0/2210783010 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc618005a20 con 0x7fc6241378a0 2020-04-02T23:21:54.501 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.445+0000 7fc62b262700 1 -- 172.21.15.174:0/2210783010 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc62412df80 con 0x7fc6241378a0 2020-04-02T23:21:54.501 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.446+0000 7fc623fff700 1 --2- 172.21.15.174:0/2210783010 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6241378a0 0x7fc624144ad0 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7fc618002f30 tx=0x7fc618010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:54.501 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.446+0000 7fc62b262700 1 -- 172.21.15.174:0/2210783010 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6241371b0 con 0x7fc6241378a0 2020-04-02T23:21:54.501 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.446+0000 7fc621ffb700 1 -- 172.21.15.174:0/2210783010 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fc618005ca0 con 0x7fc6241378a0 2020-04-02T23:21:54.501 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.446+0000 7fc623fff700 1 --2- 172.21.15.174:0/2210783010 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6241378a0 0x7fc624144ad0 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7fc618002f30 tx=0x7fc618010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:54.501 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.446+0000 7fc621ffb700 1 --2- 172.21.15.174:0/2210783010 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fc60404d460 0x7fc60404f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:54.501 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.447+0000 7fc621ffb700 1 -- 172.21.15.174:0/2210783010 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc618060da0 con 0x7fc6241378a0 2020-04-02T23:21:54.502 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.447+0000 7fc628ffe700 1 --2- 172.21.15.174:0/2210783010 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fc60404d460 0x7fc60404f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:54.502 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.447+0000 7fc628ffe700 1 --2- 172.21.15.174:0/2210783010 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fc60404d460 0x7fc60404f920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc614001110 tx=0x7fc61400ca80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:54.502 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.447+0000 7fc628ffe700 1 --2- 172.21.15.174:0/2210783010 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fc60404d460 0x7fc60404f920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc614001110 tx=0x7fc61400ca80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:54.502 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.447+0000 7fc628ffe700 1 --2- 172.21.15.174:0/2210783010 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fc60404d460 0x7fc60404f920 secure :-1 s=READY pgs=94 cs=0 l=1 rx=0x7fc614001110 tx=0x7fc61400ca80).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:54.502 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.450+0000 7fc623fff700 1 --2- 172.21.15.174:0/2210783010 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6241378a0 0x7fc624144ad0 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7fc618002f30 tx=0x7fc618010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:54.502 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.450+0000 7fc621ffb700 1 -- 172.21.15.174:0/2210783010 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fc6241371b0 con 0x7fc6241378a0 2020-04-02T23:21:54.636 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.633+0000 7fc62b262700 1 -- 172.21.15.174:0/2210783010 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc6241371b0 con 0x7fc6241378a0 2020-04-02T23:21:54.637 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.634+0000 7fc623fff700 1 --2- 172.21.15.174:0/2210783010 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6241378a0 0x7fc624144ad0 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7fc618002f30 tx=0x7fc618010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:54.637 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.634+0000 7fc621ffb700 1 -- 172.21.15.174:0/2210783010 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2140 (secure 0 0 0) 0x7fc6241371b0 con 0x7fc6241378a0 2020-04-02T23:21:54.638 INFO:teuthology.orchestra.run.smithi174.stdout: 2020-04-02T23:21:54.638 INFO:teuthology.orchestra.run.smithi174.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4354,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6833/2321559941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":2321559941},{"type":"v1","addr":"172.21.15.174:6833","nonce":2321559941}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":6}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-02T23:21:40.534377+0000","modified":"2020-04-02T23:21:45.125652+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4374},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4374":{"gid":4374,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.196:6835/4070765568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":4070765568},{"type":"v1","addr":"172.21.15.196:6835","nonce":4070765568}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-04-02T23:21:54.640 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.635+0000 7fc62b262700 1 -- 172.21.15.174:0/2210783010 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fc60404d460 msgr2=0x7fc60404f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:54.640 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.635+0000 7fc62b262700 1 --2- 172.21.15.174:0/2210783010 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fc60404d460 0x7fc60404f920 secure :-1 s=READY pgs=94 cs=0 l=1 rx=0x7fc614001110 tx=0x7fc61400ca80).stop 2020-04-02T23:21:54.640 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.635+0000 7fc62b262700 1 -- 172.21.15.174:0/2210783010 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6241378a0 msgr2=0x7fc624144ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:54.641 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.635+0000 7fc62b262700 1 --2- 172.21.15.174:0/2210783010 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6241378a0 0x7fc624144ad0 secure :-1 s=READY pgs=134 cs=0 l=1 rx=0x7fc618002f30 tx=0x7fc618010020).stop 2020-04-02T23:21:54.641 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.636+0000 7fc62b262700 1 -- 172.21.15.174:0/2210783010 shutdown_connections 2020-04-02T23:21:54.641 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.636+0000 7fc62b262700 1 --2- 172.21.15.174:0/2210783010 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fc60404d460 0x7fc60404f920 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:54.642 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.636+0000 7fc62b262700 1 --2- 172.21.15.174:0/2210783010 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc624130280 0x7fc624144670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:54.642 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.636+0000 7fc62b262700 1 --2- 172.21.15.174:0/2210783010 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6241378a0 0x7fc624144ad0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:54.642 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.636+0000 7fc62b262700 1 -- 172.21.15.174:0/2210783010 >> 172.21.15.174:0/2210783010 conn(0x7fc6240aaf80 msgr2=0x7fc62409dc20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:54.642 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.636+0000 7fc62b262700 1 -- 172.21.15.174:0/2210783010 shutdown_connections 2020-04-02T23:21:54.643 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:54.636+0000 7fc62b262700 1 -- 172.21.15.174:0/2210783010 wait complete. 2020-04-02T23:21:54.643 INFO:teuthology.orchestra.run.smithi174.stderr:dumped fsmap epoch 6 2020-04-02T23:21:54.851 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 4374}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 3, u'failed': [], u'epoch': 5, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [4], u'info': {u'gid_4374': {u'export_targets': [], u'name': u'b', u'incarnation': 4, u'state_seq': 2, u'state': u'up:active', u'gid': 4374, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'join_fscid': -1, u'addrs': {u'addrvec': [{u'nonce': 4070765568, u'type': u'v2', u'addr': u'172.21.15.196:6834'}, {u'nonce': 4070765568, u'type': u'v1', u'addr': u'172.21.15.196:6835'}]}, u'addr': u'172.21.15.196:6835/4070765568'}}, u'fs_name': u'cephfs', u'created': u'2020-04-02T23:21:40.534377+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-04-02T23:21:45.125652+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-04-02T23:21:54.851 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-04-02T23:21:54.851 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:54.868 INFO:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok status 2020-04-02T23:21:55.041 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2020-04-02T23:21:55.041 INFO:teuthology.orchestra.run.smithi196.stdout: "cluster_fsid": "06504ece-4284-40ba-b298-58864abc4224", 2020-04-02T23:21:55.041 INFO:teuthology.orchestra.run.smithi196.stdout: "whoami": 0, 2020-04-02T23:21:55.041 INFO:teuthology.orchestra.run.smithi196.stdout: "id": 4374, 2020-04-02T23:21:55.041 INFO:teuthology.orchestra.run.smithi196.stdout: "want_state": "up:active", 2020-04-02T23:21:55.042 INFO:teuthology.orchestra.run.smithi196.stdout: "state": "up:active", 2020-04-02T23:21:55.042 INFO:teuthology.orchestra.run.smithi196.stdout: "rank_uptime": 10.921796705, 2020-04-02T23:21:55.042 INFO:teuthology.orchestra.run.smithi196.stdout: "mdsmap_epoch": 5, 2020-04-02T23:21:55.042 INFO:teuthology.orchestra.run.smithi196.stdout: "osdmap_epoch": 23, 2020-04-02T23:21:55.042 INFO:teuthology.orchestra.run.smithi196.stdout: "osdmap_epoch_barrier": 23, 2020-04-02T23:21:55.042 INFO:teuthology.orchestra.run.smithi196.stdout: "uptime": 11.645659586000001 2020-04-02T23:21:55.042 INFO:teuthology.orchestra.run.smithi196.stdout:} 2020-04-02T23:21:55.049 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "06504ece-4284-40ba-b298-58864abc4224", "whoami": 0, "id": 4374, "want_state": "up:active", "state": "up:active", "rank_uptime": 10.921796705, "mdsmap_epoch": 5, "osdmap_epoch": 23, "osdmap_epoch_barrier": 23, "uptime": 11.645659586000001 } 2020-04-02T23:21:55.050 INFO:teuthology.run_tasks:Running task ceph-fuse... 2020-04-02T23:21:55.066 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2020-04-02T23:21:55.066 INFO:tasks.ceph_fuse:config is None 2020-04-02T23:21:55.066 INFO:tasks.ceph_fuse:new config is {'client.0': None} 2020-04-02T23:21:55.066 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2020-04-02T23:21:55.067 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:55.081 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-02T23:21:55.229 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.226+0000 7f59be7d9700 1 Processor -- start 2020-04-02T23:21:55.229 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.226+0000 7f59be7d9700 1 -- start start 2020-04-02T23:21:55.236 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.227+0000 7f59be7d9700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f59b80a7a60 0x7f59b80a4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:55.236 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.227+0000 7f59be7d9700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f59b80a14f0 0x7f59b80a3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:55.236 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.227+0000 7f59be7d9700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59b80a6aa0 con 0x7f59b80a4060 2020-04-02T23:21:55.237 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.227+0000 7f59be7d9700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59b80a5e70 con 0x7f59b80a14f0 2020-04-02T23:21:55.237 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.227+0000 7f59be7d9700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59b809ed60 con 0x7f59b80a7a60 2020-04-02T23:21:55.237 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.227+0000 7f59b7fff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f59b80a7a60 0x7f59b80a4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:55.237 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.227+0000 7f59b7fff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f59b80a7a60 0x7f59b80a4e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.174:34832/0 (socket says 172.21.15.174:34832) 2020-04-02T23:21:55.237 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.227+0000 7f59b7fff700 1 -- 172.21.15.174:0/4061786899 learned_addr learned my addr 172.21.15.174:0/4061786899 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:21:55.237 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.228+0000 7f59b77fe700 1 --2- 172.21.15.174:0/4061786899 >> v2:172.21.15.196:3300/0 conn(0x7f59b80a14f0 0x7f59b80a3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:55.237 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.228+0000 7f59b6ffd700 1 -- 172.21.15.174:0/4061786899 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 450230411 0 0) 0x7f59b80a6aa0 con 0x7f59b80a4060 2020-04-02T23:21:55.238 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.228+0000 7f59b6ffd700 1 -- 172.21.15.174:0/4061786899 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59a4003230 con 0x7f59b80a4060 2020-04-02T23:21:55.238 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.228+0000 7f59b7fff700 1 -- 172.21.15.174:0/4061786899 >> v2:172.21.15.196:3300/0 conn(0x7f59b80a14f0 msgr2=0x7f59b80a3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:55.238 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.228+0000 7f59b7fff700 1 --2- 172.21.15.174:0/4061786899 >> v2:172.21.15.196:3300/0 conn(0x7f59b80a14f0 0x7f59b80a3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:55.238 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.228+0000 7f59b7fff700 1 -- 172.21.15.174:0/4061786899 >> v1:172.21.15.196:6789/0 conn(0x7f59b80a4060 legacy=0x7f59b805ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:55.238 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.228+0000 7f59b7fff700 1 -- 172.21.15.174:0/4061786899 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b80a5430 con 0x7f59b80a7a60 2020-04-02T23:21:55.238 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.228+0000 7f59b77fe700 1 --2- 172.21.15.174:0/4061786899 >> v2:172.21.15.196:3300/0 conn(0x7f59b80a14f0 0x7f59b80a3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:21:55.238 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.228+0000 7f59b7fff700 1 --2- 172.21.15.174:0/4061786899 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f59b80a7a60 0x7f59b80a4e00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f59a8002f30 tx=0x7f59a8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:55.239 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.228+0000 7f59b7fff700 1 --2- 172.21.15.174:0/4061786899 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f59b80a7a60 0x7f59b80a4e00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f59a8002f30 tx=0x7f59a8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:55.239 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.228+0000 7f59b7fff700 1 --2- 172.21.15.174:0/4061786899 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f59b80a7a60 0x7f59b80a4e00 secure :-1 s=READY pgs=37 cs=0 l=1 rx=0x7f59a8002f30 tx=0x7f59a8007a40).ready entity=mon.2 client_cookie=f5a0cb20487026fc server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:55.239 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.228+0000 7f59b7fff700 1 --2- 172.21.15.174:0/4061786899 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f59b80a7a60 0x7f59b80a4e00 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f59a8002f30 tx=0x7f59a8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:55.239 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.228+0000 7f59b6ffd700 1 -- 172.21.15.174:0/4061786899 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59a80115c0 con 0x7f59b80a7a60 2020-04-02T23:21:55.239 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.228+0000 7f59b7fff700 1 --2- 172.21.15.174:0/4061786899 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f59b80a7a60 0x7f59b80a4e00 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f59a8002f30 tx=0x7f59a8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:55.239 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.228+0000 7f59b7fff700 1 --2- 172.21.15.174:0/4061786899 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f59b80a7a60 0x7f59b80a4e00 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f59a8002f30 tx=0x7f59a8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:55.239 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.228+0000 7f59b6ffd700 1 -- 172.21.15.174:0/4061786899 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59a8011720 con 0x7f59b80a7a60 2020-04-02T23:21:55.240 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.228+0000 7f59b6ffd700 1 -- 172.21.15.174:0/4061786899 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59a8011b40 con 0x7f59b80a7a60 2020-04-02T23:21:55.240 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.228+0000 7f59be7d9700 1 -- 172.21.15.174:0/4061786899 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f59b80a7a60 msgr2=0x7f59b80a4e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:55.240 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.228+0000 7f59be7d9700 1 --2- 172.21.15.174:0/4061786899 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f59b80a7a60 0x7f59b80a4e00 secure :-1 s=READY pgs=37 cs=0 l=1 rx=0x7f59a8002f30 tx=0x7f59a8007a40).stop 2020-04-02T23:21:55.240 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.229+0000 7f59be7d9700 1 -- 172.21.15.174:0/4061786899 shutdown_connections 2020-04-02T23:21:55.240 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.229+0000 7f59be7d9700 1 --2- 172.21.15.174:0/4061786899 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f59b80a7a60 0x7f59b80a4e00 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:55.240 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.229+0000 7f59be7d9700 1 --2- 172.21.15.174:0/4061786899 >> v2:172.21.15.196:3300/0 conn(0x7f59b80a14f0 0x7f59b80a3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:55.240 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.229+0000 7f59be7d9700 1 -- 172.21.15.174:0/4061786899 >> 172.21.15.174:0/4061786899 conn(0x7f59b80aaf80 msgr2=0x7f59b80a6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:55.241 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.229+0000 7f59be7d9700 1 -- 172.21.15.174:0/4061786899 shutdown_connections 2020-04-02T23:21:55.241 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.229+0000 7f59be7d9700 1 -- 172.21.15.174:0/4061786899 wait complete. 2020-04-02T23:21:55.241 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.229+0000 7f59be7d9700 1 Processor -- start 2020-04-02T23:21:55.241 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.230+0000 7f59be7d9700 1 -- start start 2020-04-02T23:21:55.241 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.230+0000 7f59be7d9700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f59b80a14f0 0x7f59b8143c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:55.241 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.230+0000 7f59be7d9700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59b8143500 con 0x7f59b80a7a60 2020-04-02T23:21:55.241 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.230+0000 7f59be7d9700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59b81437a0 con 0x7f59b80a4060 2020-04-02T23:21:55.241 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.230+0000 7f59be7d9700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59b81432f0 con 0x7f59b80a14f0 2020-04-02T23:21:55.242 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.230+0000 7f59bcd76700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f59b80a7a60 0x7f59b8135650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:45292/0 (socket says 172.21.15.174:45292) 2020-04-02T23:21:55.242 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.230+0000 7f59bcd76700 1 -- 172.21.15.174:0/3186948627 learned_addr learned my addr 172.21.15.174:0/3186948627 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:21:55.242 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.230+0000 7f59b7fff700 1 --2- 172.21.15.174:0/3186948627 >> v2:172.21.15.196:3300/0 conn(0x7f59b80a14f0 0x7f59b8143c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:55.242 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.231+0000 7f59b57fa700 1 -- 172.21.15.174:0/3186948627 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2742416013 0 0) 0x7f59b8143500 con 0x7f59b80a7a60 2020-04-02T23:21:55.242 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.231+0000 7f59b57fa700 1 -- 172.21.15.174:0/3186948627 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5998002fe0 con 0x7f59b80a7a60 2020-04-02T23:21:55.242 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.231+0000 7f59b57fa700 1 -- 172.21.15.174:0/3186948627 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3043683517 0 0) 0x7f59b81437a0 con 0x7f59b80a4060 2020-04-02T23:21:55.242 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.231+0000 7f59b7fff700 1 -- 172.21.15.174:0/3186948627 >> v1:172.21.15.196:6789/0 conn(0x7f59b80a4060 legacy=0x7f59b81342c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:55.243 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.231+0000 7f59b7fff700 1 -- 172.21.15.174:0/3186948627 >> v1:172.21.15.174:6789/0 conn(0x7f59b80a7a60 legacy=0x7f59b8135650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:55.243 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.231+0000 7f59b7fff700 1 -- 172.21.15.174:0/3186948627 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b81440a0 con 0x7f59b80a14f0 2020-04-02T23:21:55.243 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.231+0000 7f59b7fff700 1 --2- 172.21.15.174:0/3186948627 >> v2:172.21.15.196:3300/0 conn(0x7f59b80a14f0 0x7f59b8143c40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f59b8130e40 tx=0x7f59a8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:55.243 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.231+0000 7f59b7fff700 1 --2- 172.21.15.174:0/3186948627 >> v2:172.21.15.196:3300/0 conn(0x7f59b80a14f0 0x7f59b8143c40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f59b8130e40 tx=0x7f59a8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:55.243 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.231+0000 7f59b7fff700 1 --2- 172.21.15.174:0/3186948627 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f59b80a14f0 0x7f59b8143c40 secure :-1 s=READY pgs=137 cs=0 l=1 rx=0x7f59b8130e40 tx=0x7f59a8007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:55.243 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.231+0000 7f59b7fff700 1 --2- 172.21.15.174:0/3186948627 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f59b80a14f0 0x7f59b8143c40 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7f59b8130e40 tx=0x7f59a8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:55.243 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.231+0000 7f59b57fa700 1 -- 172.21.15.174:0/3186948627 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59a8011e00 con 0x7f59b80a14f0 2020-04-02T23:21:55.244 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.231+0000 7f59b7fff700 1 --2- 172.21.15.174:0/3186948627 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f59b80a14f0 0x7f59b8143c40 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7f59b8130e40 tx=0x7f59a8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:55.244 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.231+0000 7f59b7fff700 1 --2- 172.21.15.174:0/3186948627 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f59b80a14f0 0x7f59b8143c40 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7f59b8130e40 tx=0x7f59a8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:55.244 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.231+0000 7f59b57fa700 1 -- 172.21.15.174:0/3186948627 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59a8007150 con 0x7f59b80a14f0 2020-04-02T23:21:55.244 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.231+0000 7f59be7d9700 1 -- 172.21.15.174:0/3186948627 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59b81349d0 con 0x7f59b80a14f0 2020-04-02T23:21:55.244 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.231+0000 7f59b57fa700 1 -- 172.21.15.174:0/3186948627 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59a80074b0 con 0x7f59b80a14f0 2020-04-02T23:21:55.244 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.231+0000 7f59be7d9700 1 -- 172.21.15.174:0/3186948627 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59b8135260 con 0x7f59b80a14f0 2020-04-02T23:21:55.244 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.232+0000 7f59b7fff700 1 --2- 172.21.15.174:0/3186948627 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f59b80a14f0 0x7f59b8143c40 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7f59b8130e40 tx=0x7f59a8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:55.244 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.232+0000 7f59be7d9700 1 -- 172.21.15.174:0/3186948627 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59b8056c50 con 0x7f59b80a14f0 2020-04-02T23:21:55.245 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.232+0000 7f59b57fa700 1 -- 172.21.15.174:0/3186948627 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f59a80056c0 con 0x7f59b80a14f0 2020-04-02T23:21:55.245 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.232+0000 7f59b7fff700 1 --2- 172.21.15.174:0/3186948627 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f59b80a14f0 0x7f59b8143c40 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7f59b8130e40 tx=0x7f59a8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:55.245 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.233+0000 7f59b57fa700 1 --2- 172.21.15.174:0/3186948627 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f599804d880 0x7f599804fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:55.245 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.233+0000 7f59b57fa700 1 -- 172.21.15.174:0/3186948627 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f59a8061340 con 0x7f59b80a14f0 2020-04-02T23:21:55.245 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.233+0000 7f59b77fe700 1 --2- 172.21.15.174:0/3186948627 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f599804d880 0x7f599804fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:55.245 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.233+0000 7f59b77fe700 1 --2- 172.21.15.174:0/3186948627 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f599804d880 0x7f599804fd40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f59ac002ef0 tx=0x7f59ac009370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:55.245 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.233+0000 7f59b77fe700 1 --2- 172.21.15.174:0/3186948627 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f599804d880 0x7f599804fd40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f59ac002ef0 tx=0x7f59ac009370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:55.246 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.233+0000 7f59b77fe700 1 --2- 172.21.15.174:0/3186948627 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f599804d880 0x7f599804fd40 secure :-1 s=READY pgs=95 cs=0 l=1 rx=0x7f59ac002ef0 tx=0x7f59ac009370).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:55.247 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.236+0000 7f59b7fff700 1 --2- 172.21.15.174:0/3186948627 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f59b80a14f0 0x7f59b8143c40 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7f59b8130e40 tx=0x7f59a8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:55.248 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.236+0000 7f59b57fa700 1 -- 172.21.15.174:0/3186948627 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f59a803cb00 con 0x7f59b80a14f0 2020-04-02T23:21:55.376 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.374+0000 7f59be7d9700 1 -- 172.21.15.174:0/3186948627 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f59b805a690 con 0x7f59b80a14f0 2020-04-02T23:21:55.377 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.375+0000 7f59b7fff700 1 --2- 172.21.15.174:0/3186948627 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f59b80a14f0 0x7f59b8143c40 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7f59b8130e40 tx=0x7f59a8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:55.377 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.375+0000 7f59b57fa700 1 -- 172.21.15.174:0/3186948627 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16134 (secure 0 0 0) 0x7f59a8040120 con 0x7f59b80a14f0 2020-04-02T23:21:55.378 INFO:teuthology.orchestra.run.smithi174.stdout: 2020-04-02T23:21:55.378 INFO:teuthology.orchestra.run.smithi174.stdout:{"epoch":23,"fsid":"06504ece-4284-40ba-b298-58864abc4224","created":"2020-04-02T23:21:19.153932+0000","modified":"2020-04-02T23:21:41.535533+0000","last_up_change":"2020-04-02T23:21:29.337390+0000","last_in_change":"2020-04-02T23:21:29.337390+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-02T23:21:22.199702+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-02T23:21:35.314601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-04-02T23:21:38.762876+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-04-02T23:21:39.474986+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c9d748ee-c52f-4f21-b8c9-2a53a937be1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":24590},{"type":"v1","addr":"172.21.15.174:6801","nonce":24590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":24590},{"type":"v1","addr":"172.21.15.174:6803","nonce":24590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":24590},{"type":"v1","addr":"172.21.15.174:6807","nonce":24590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":24590},{"type":"v1","addr":"172.21.15.174:6805","nonce":24590}]},"public_addr":"172.21.15.174:6801/24590","cluster_addr":"172.21.15.174:6803/24590","heartbeat_back_addr":"172.21.15.174:6807/24590","heartbeat_front_addr":"172.21.15.174:6805/24590","state":["exists","up"]},{"osd":1,"uuid":"27c05faf-11f5-4cef-9bde-1a6653a9e533","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":24754},{"type":"v1","addr":"172.21.15.174:6809","nonce":24754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":24754},{"type":"v1","addr":"172.21.15.174:6811","nonce":24754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":24754},{"type":"v1","addr":"172.21.15.174:6815","nonce":24754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":24754},{"type":"v1","addr":"172.21.15.174:6813","nonce":24754}]},"public_addr":"172.21.15.174:6809/24754","cluster_addr":"172.21.15.174:6811/24754","heartbeat_back_addr":"172.21.15.174:6815/24754","heartbeat_front_addr":"172.21.15.174:6813/24754","state":["exists","up"]},{"osd":2,"uuid":"02b1b455-b518-4393-b257-40c3a76af157","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":24781},{"type":"v1","addr":"172.21.15.174:6817","nonce":24781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":24781},{"type":"v1","addr":"172.21.15.174:6819","nonce":24781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":24781},{"type":"v1","addr":"172.21.15.174:6823","nonce":24781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":24781},{"type":"v1","addr":"172.21.15.174:6821","nonce":24781}]},"public_addr":"172.21.15.174:6817/24781","cluster_addr":"172.21.15.174:6819/24781","heartbeat_back_addr":"172.21.15.174:6823/24781","heartbeat_front_addr":"172.21.15.174:6821/24781","state":["exists","up"]},{"osd":3,"uuid":"d7fb3499-9e13-4076-b3cf-28f27eb62967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":24972},{"type":"v1","addr":"172.21.15.174:6825","nonce":24972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":24972},{"type":"v1","addr":"172.21.15.174:6827","nonce":24972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":24972},{"type":"v1","addr":"172.21.15.174:6831","nonce":24972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":24972},{"type":"v1","addr":"172.21.15.174:6829","nonce":24972}]},"public_addr":"172.21.15.174:6825/24972","cluster_addr":"172.21.15.174:6827/24972","heartbeat_back_addr":"172.21.15.174:6831/24972","heartbeat_front_addr":"172.21.15.174:6829/24972","state":["exists","up"]},{"osd":4,"uuid":"16923c47-2f21-43ea-9647-5ead4b1b2101","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":24034},{"type":"v1","addr":"172.21.15.196:6803","nonce":24034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":24034},{"type":"v1","addr":"172.21.15.196:6805","nonce":24034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":24034},{"type":"v1","addr":"172.21.15.196:6809","nonce":24034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":24034},{"type":"v1","addr":"172.21.15.196:6807","nonce":24034}]},"public_addr":"172.21.15.196:6803/24034","cluster_addr":"172.21.15.196:6805/24034","heartbeat_back_addr":"172.21.15.196:6809/24034","heartbeat_front_addr":"172.21.15.196:6807/24034","state":["exists","up"]},{"osd":5,"uuid":"7cf2859b-2226-4908-8d70-6e699d1acb0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":24190},{"type":"v1","addr":"172.21.15.196:6811","nonce":24190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":24190},{"type":"v1","addr":"172.21.15.196:6813","nonce":24190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":24190},{"type":"v1","addr":"172.21.15.196:6817","nonce":24190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":24190},{"type":"v1","addr":"172.21.15.196:6815","nonce":24190}]},"public_addr":"172.21.15.196:6811/24190","cluster_addr":"172.21.15.196:6813/24190","heartbeat_back_addr":"172.21.15.196:6817/24190","heartbeat_front_addr":"172.21.15.196:6815/24190","state":["exists","up"]},{"osd":6,"uuid":"441081ef-133a-41ec-8041-094e129707e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":24212},{"type":"v1","addr":"172.21.15.196:6819","nonce":24212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":24212},{"type":"v1","addr":"172.21.15.196:6821","nonce":24212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":24212},{"type":"v1","addr":"172.21.15.196:6825","nonce":24212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":24212},{"type":"v1","addr":"172.21.15.196:6823","nonce":24212}]},"public_addr":"172.21.15.196:6819/24212","cluster_addr":"172.21.15.196:6821/24212","heartbeat_back_addr":"172.21.15.196:6825/24212","heartbeat_front_addr":"172.21.15.196:6823/24212","state":["exists","up"]},{"osd":7,"uuid":"17ee8d46-46bf-4ef0-8d02-82cbc4ef5a5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":24408},{"type":"v1","addr":"172.21.15.196:6827","nonce":24408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":24408},{"type":"v1","addr":"172.21.15.196:6829","nonce":24408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":24408},{"type":"v1","addr":"172.21.15.196:6833","nonce":24408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":24408},{"type":"v1","addr":"172.21.15.196:6831","nonce":24408}]},"public_addr":"172.21.15.196:6827/24408","cluster_addr":"172.21.15.196:6829/24408","heartbeat_back_addr":"172.21.15.196:6833/24408","heartbeat_front_addr":"172.21.15.196:6831/24408","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.725574+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.732598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.775890+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.854998+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.545334+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.591623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.627501+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.614807+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-02T23:21:55.379 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.376+0000 7f59be7d9700 1 -- 172.21.15.174:0/3186948627 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f599804d880 msgr2=0x7f599804fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:55.379 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.376+0000 7f59be7d9700 1 --2- 172.21.15.174:0/3186948627 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f599804d880 0x7f599804fd40 secure :-1 s=READY pgs=95 cs=0 l=1 rx=0x7f59ac002ef0 tx=0x7f59ac009370).stop 2020-04-02T23:21:55.379 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.376+0000 7f59be7d9700 1 -- 172.21.15.174:0/3186948627 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f59b80a14f0 msgr2=0x7f59b8143c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:55.380 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.376+0000 7f59be7d9700 1 --2- 172.21.15.174:0/3186948627 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f59b80a14f0 0x7f59b8143c40 secure :-1 s=READY pgs=137 cs=0 l=1 rx=0x7f59b8130e40 tx=0x7f59a8007a40).stop 2020-04-02T23:21:55.380 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.376+0000 7f59be7d9700 1 -- 172.21.15.174:0/3186948627 shutdown_connections 2020-04-02T23:21:55.380 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.376+0000 7f59be7d9700 1 --2- 172.21.15.174:0/3186948627 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f59b80a14f0 0x7f59b8143c40 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:55.381 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.376+0000 7f59be7d9700 1 --2- 172.21.15.174:0/3186948627 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f599804d880 0x7f599804fd40 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:55.381 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.376+0000 7f59be7d9700 1 -- 172.21.15.174:0/3186948627 >> 172.21.15.174:0/3186948627 conn(0x7f59b80aaf80 msgr2=0x7f59b80695c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:55.381 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.376+0000 7f59be7d9700 1 -- 172.21.15.174:0/3186948627 shutdown_connections 2020-04-02T23:21:55.381 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.376+0000 7f59be7d9700 1 -- 172.21.15.174:0/3186948627 wait complete. 2020-04-02T23:21:55.389 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 1, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-02T23:21:22.199702+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 1, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 1, u'pg_num': 1, u'type': 1, u'grade_table': [], u'pool_name': u'device_health_metrics', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 1, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'mgr_devicehealth': {}}, u'options': {u'pg_num_min': 1}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'16', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-02T23:21:35.314601+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'19', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-02T23:21:38.762876+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 3, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'22', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-02T23:21:39.474986+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 4, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'23', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-04-02T23:21:55.390 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:55.403 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-04-02T23:21:55.550 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.548+0000 7f576aed8700 1 Processor -- start 2020-04-02T23:21:55.550 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.548+0000 7f576aed8700 1 -- start start 2020-04-02T23:21:55.556 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.548+0000 7f576aed8700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f57640a3b90 0x7f57640a4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:55.556 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.548+0000 7f576aed8700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f576412ea60 0x7f576412eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:55.556 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.548+0000 7f576aed8700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57640a3760 con 0x7f57640a7a60 2020-04-02T23:21:55.557 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.548+0000 7f576aed8700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57641357a0 con 0x7f576412ea60 2020-04-02T23:21:55.557 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.548+0000 7f576aed8700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5764135a40 con 0x7f57640a3b90 2020-04-02T23:21:55.557 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.548+0000 7f5769475700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f576412ea60 0x7f576412eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:55.557 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.549+0000 7f5768c74700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f57640a7a60 0x7f5764134c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:45296/0 (socket says 172.21.15.174:45296) 2020-04-02T23:21:55.557 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.549+0000 7f5769475700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f576412ea60 0x7f576412eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:40258/0 (socket says 172.21.15.174:40258) 2020-04-02T23:21:55.557 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.549+0000 7f5768c74700 1 -- 172.21.15.174:0/1449074732 learned_addr learned my addr 172.21.15.174:0/1449074732 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:21:55.557 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.549+0000 7f5763fff700 1 --2- 172.21.15.174:0/1449074732 >> v2:172.21.15.196:3300/0 conn(0x7f57640a3b90 0x7f57640a4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:55.558 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.549+0000 7f5769475700 1 -- 172.21.15.174:0/1449074732 >> v2:172.21.15.196:3300/0 conn(0x7f57640a3b90 msgr2=0x7f57640a4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:55.558 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.549+0000 7f5769475700 1 --2- 172.21.15.174:0/1449074732 >> v2:172.21.15.196:3300/0 conn(0x7f57640a3b90 0x7f57640a4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:55.558 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.549+0000 7f5769475700 1 -- 172.21.15.174:0/1449074732 >> v1:172.21.15.174:6789/0 conn(0x7f57640a7a60 legacy=0x7f5764134c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:55.558 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.549+0000 7f57637fe700 1 -- 172.21.15.174:0/1449074732 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1367068431 0 0) 0x7f57640a3760 con 0x7f57640a7a60 2020-04-02T23:21:55.558 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.549+0000 7f5769475700 1 -- 172.21.15.174:0/1449074732 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57640a23f0 con 0x7f576412ea60 2020-04-02T23:21:55.558 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.549+0000 7f5769475700 1 --2- 172.21.15.174:0/1449074732 >> v2:172.21.15.174:3300/0 conn(0x7f576412ea60 0x7f576412eeb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f575c0032b0 tx=0x7f575c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:55.558 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.549+0000 7f5769475700 1 --2- 172.21.15.174:0/1449074732 >> v2:172.21.15.174:3300/0 conn(0x7f576412ea60 0x7f576412eeb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f575c0032b0 tx=0x7f575c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:55.559 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.549+0000 7f5769475700 1 --2- 172.21.15.174:0/1449074732 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f576412ea60 0x7f576412eeb0 secure :-1 s=READY pgs=177 cs=0 l=1 rx=0x7f575c0032b0 tx=0x7f575c007dc0).ready entity=mon.0 client_cookie=c21382889572ec85 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:55.559 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.549+0000 7f5769475700 1 --2- 172.21.15.174:0/1449074732 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f576412ea60 0x7f576412eeb0 secure :-1 s=THROTTLE_DONE pgs=177 cs=0 l=1 rx=0x7f575c0032b0 tx=0x7f575c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:55.559 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.549+0000 7f57637fe700 1 -- 172.21.15.174:0/1449074732 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f575c010e60 con 0x7f576412ea60 2020-04-02T23:21:55.559 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.549+0000 7f5769475700 1 --2- 172.21.15.174:0/1449074732 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f576412ea60 0x7f576412eeb0 secure :-1 s=THROTTLE_DONE pgs=177 cs=0 l=1 rx=0x7f575c0032b0 tx=0x7f575c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:55.559 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.549+0000 7f5769475700 1 --2- 172.21.15.174:0/1449074732 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f576412ea60 0x7f576412eeb0 secure :-1 s=THROTTLE_DONE pgs=177 cs=0 l=1 rx=0x7f575c0032b0 tx=0x7f575c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:55.559 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.549+0000 7f57637fe700 1 -- 172.21.15.174:0/1449074732 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f575c0110c0 con 0x7f576412ea60 2020-04-02T23:21:55.559 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.549+0000 7f57637fe700 1 -- 172.21.15.174:0/1449074732 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f575c011420 con 0x7f576412ea60 2020-04-02T23:21:55.560 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.549+0000 7f576aed8700 1 -- 172.21.15.174:0/1449074732 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f576412ea60 msgr2=0x7f576412eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:55.560 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.549+0000 7f576aed8700 1 --2- 172.21.15.174:0/1449074732 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f576412ea60 0x7f576412eeb0 secure :-1 s=READY pgs=177 cs=0 l=1 rx=0x7f575c0032b0 tx=0x7f575c007dc0).stop 2020-04-02T23:21:55.560 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.550+0000 7f576aed8700 1 -- 172.21.15.174:0/1449074732 shutdown_connections 2020-04-02T23:21:55.560 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.550+0000 7f576aed8700 1 --2- 172.21.15.174:0/1449074732 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f576412ea60 0x7f576412eeb0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:55.560 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.550+0000 7f576aed8700 1 --2- 172.21.15.174:0/1449074732 >> v2:172.21.15.196:3300/0 conn(0x7f57640a3b90 0x7f57640a4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:55.560 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.550+0000 7f576aed8700 1 -- 172.21.15.174:0/1449074732 >> 172.21.15.174:0/1449074732 conn(0x7f57640aaf80 msgr2=0x7f57640a6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:55.560 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.550+0000 7f576aed8700 1 -- 172.21.15.174:0/1449074732 shutdown_connections 2020-04-02T23:21:55.561 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.550+0000 7f576aed8700 1 -- 172.21.15.174:0/1449074732 wait complete. 2020-04-02T23:21:55.561 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.550+0000 7f576aed8700 1 Processor -- start 2020-04-02T23:21:55.561 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.550+0000 7f576aed8700 1 -- start start 2020-04-02T23:21:55.561 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.551+0000 7f576aed8700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f57640a7a60 0x7f576409e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:55.561 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.551+0000 7f576aed8700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f576412ea60 0x7f57640a06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:55.561 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.551+0000 7f576aed8700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5764132050 con 0x7f57640a3b90 2020-04-02T23:21:55.561 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.551+0000 7f576aed8700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f576409e9f0 con 0x7f57640a7a60 2020-04-02T23:21:55.562 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.551+0000 7f576aed8700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f576409ec90 con 0x7f576412ea60 2020-04-02T23:21:55.562 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.551+0000 7f5768c74700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f57640a3b90 0x7f576409d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:45300/0 (socket says 172.21.15.174:45300) 2020-04-02T23:21:55.562 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.551+0000 7f5768c74700 1 -- 172.21.15.174:0/3100423319 learned_addr learned my addr 172.21.15.174:0/3100423319 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:21:55.562 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.551+0000 7f5769475700 1 --2- 172.21.15.174:0/3100423319 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f576412ea60 0x7f57640a06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:55.562 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.551+0000 7f5763fff700 1 --2- 172.21.15.174:0/3100423319 >> v2:172.21.15.196:3300/0 conn(0x7f57640a7a60 0x7f576409e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:55.562 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.551+0000 7f5761ffb700 1 -- 172.21.15.174:0/3100423319 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 105213596 0 0) 0x7f5764132050 con 0x7f57640a3b90 2020-04-02T23:21:55.562 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.551+0000 7f5761ffb700 1 -- 172.21.15.174:0/3100423319 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5744002fe0 con 0x7f57640a3b90 2020-04-02T23:21:55.563 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.552+0000 7f5761ffb700 1 -- 172.21.15.174:0/3100423319 <== mon.0 v1:172.21.15.174:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1632428673 0 0) 0x7f5744002fe0 con 0x7f57640a3b90 2020-04-02T23:21:55.563 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.552+0000 7f5769475700 1 -- 172.21.15.174:0/3100423319 >> v2:172.21.15.196:3300/0 conn(0x7f57640a7a60 msgr2=0x7f576409e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:55.563 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.552+0000 7f5769475700 1 --2- 172.21.15.174:0/3100423319 >> v2:172.21.15.196:3300/0 conn(0x7f57640a7a60 0x7f576409e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:55.563 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.552+0000 7f5769475700 1 -- 172.21.15.174:0/3100423319 >> v1:172.21.15.174:6789/0 conn(0x7f57640a3b90 legacy=0x7f576409d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:55.563 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.552+0000 7f5769475700 1 -- 172.21.15.174:0/3100423319 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f576409ef30 con 0x7f576412ea60 2020-04-02T23:21:55.563 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.552+0000 7f5769475700 1 --2- 172.21.15.174:0/3100423319 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f576412ea60 0x7f57640a06e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5754001a00 tx=0x7f575c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:55.564 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.552+0000 7f5769475700 1 --2- 172.21.15.174:0/3100423319 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f576412ea60 0x7f57640a06e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5754001a00 tx=0x7f575c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:55.564 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.552+0000 7f5769475700 1 --2- 172.21.15.174:0/3100423319 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f576412ea60 0x7f57640a06e0 secure :-1 s=READY pgs=38 cs=0 l=1 rx=0x7f5754001a00 tx=0x7f575c007dc0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:55.564 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.552+0000 7f5769475700 1 --2- 172.21.15.174:0/3100423319 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f576412ea60 0x7f57640a06e0 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f5754001a00 tx=0x7f575c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:55.564 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.552+0000 7f5761ffb700 1 -- 172.21.15.174:0/3100423319 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5754001860 con 0x7f576412ea60 2020-04-02T23:21:55.564 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.552+0000 7f5769475700 1 --2- 172.21.15.174:0/3100423319 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f576412ea60 0x7f57640a06e0 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f5754001a00 tx=0x7f575c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:55.564 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.552+0000 7f5761ffb700 1 -- 172.21.15.174:0/3100423319 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f575c005a40 con 0x7f576412ea60 2020-04-02T23:21:55.564 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.552+0000 7f5769475700 1 --2- 172.21.15.174:0/3100423319 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f576412ea60 0x7f57640a06e0 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f5754001a00 tx=0x7f575c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:55.565 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.552+0000 7f576aed8700 1 -- 172.21.15.174:0/3100423319 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57641402f0 con 0x7f576412ea60 2020-04-02T23:21:55.565 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.552+0000 7f5761ffb700 1 -- 172.21.15.174:0/3100423319 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f575c005da0 con 0x7f576412ea60 2020-04-02T23:21:55.565 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.552+0000 7f576aed8700 1 -- 172.21.15.174:0/3100423319 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f576409de80 con 0x7f576412ea60 2020-04-02T23:21:55.565 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.553+0000 7f5769475700 1 --2- 172.21.15.174:0/3100423319 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f576412ea60 0x7f57640a06e0 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f5754001a00 tx=0x7f575c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:55.565 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.553+0000 7f576aed8700 1 -- 172.21.15.174:0/3100423319 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5764056c50 con 0x7f576412ea60 2020-04-02T23:21:55.565 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.553+0000 7f5761ffb700 1 -- 172.21.15.174:0/3100423319 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f575c00f280 con 0x7f576412ea60 2020-04-02T23:21:55.565 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.553+0000 7f5769475700 1 --2- 172.21.15.174:0/3100423319 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f576412ea60 0x7f57640a06e0 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f5754001a00 tx=0x7f575c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:55.566 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.553+0000 7f5761ffb700 1 --2- 172.21.15.174:0/3100423319 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f574404d8a0 0x7f574404fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:55.566 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.553+0000 7f5761ffb700 1 -- 172.21.15.174:0/3100423319 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f575c00f0c0 con 0x7f576412ea60 2020-04-02T23:21:55.566 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.553+0000 7f5768c74700 1 --2- 172.21.15.174:0/3100423319 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f574404d8a0 0x7f574404fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:55.566 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.554+0000 7f5768c74700 1 --2- 172.21.15.174:0/3100423319 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f574404d8a0 0x7f574404fd60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5754001170 tx=0x7f5754009620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:55.566 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.554+0000 7f5768c74700 1 --2- 172.21.15.174:0/3100423319 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f574404d8a0 0x7f574404fd60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5754001170 tx=0x7f5754009620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:55.566 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.554+0000 7f5768c74700 1 --2- 172.21.15.174:0/3100423319 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f574404d8a0 0x7f574404fd60 secure :-1 s=READY pgs=96 cs=0 l=1 rx=0x7f5754001170 tx=0x7f5754009620).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:55.567 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.557+0000 7f5769475700 1 --2- 172.21.15.174:0/3100423319 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f576412ea60 0x7f57640a06e0 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f5754001a00 tx=0x7f575c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:55.567 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.557+0000 7f5761ffb700 1 -- 172.21.15.174:0/3100423319 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f575c03c970 con 0x7f576412ea60 2020-04-02T23:21:55.699 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.696+0000 7f576aed8700 1 -- 172.21.15.174:0/3100423319 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f57640a2dd0 con 0x7f576412ea60 2020-04-02T23:21:55.699 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.697+0000 7f5769475700 1 --2- 172.21.15.174:0/3100423319 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f576412ea60 0x7f57640a06e0 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f5754001a00 tx=0x7f575c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:55.699 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.697+0000 7f5761ffb700 1 -- 172.21.15.174:0/3100423319 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v23) v1 ==== 110+0+10 (secure 0 0 0) 0x7f575c03ff90 con 0x7f576412ea60 2020-04-02T23:21:55.700 INFO:teuthology.orchestra.run.smithi174.stdout:pg_num: 1 2020-04-02T23:21:55.701 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.698+0000 7f576aed8700 1 -- 172.21.15.174:0/3100423319 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f574404d8a0 msgr2=0x7f574404fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:55.701 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.698+0000 7f576aed8700 1 --2- 172.21.15.174:0/3100423319 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f574404d8a0 0x7f574404fd60 secure :-1 s=READY pgs=96 cs=0 l=1 rx=0x7f5754001170 tx=0x7f5754009620).stop 2020-04-02T23:21:55.701 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.698+0000 7f576aed8700 1 -- 172.21.15.174:0/3100423319 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f576412ea60 msgr2=0x7f57640a06e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:55.701 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.698+0000 7f576aed8700 1 --2- 172.21.15.174:0/3100423319 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f576412ea60 0x7f57640a06e0 secure :-1 s=READY pgs=38 cs=0 l=1 rx=0x7f5754001a00 tx=0x7f575c007dc0).stop 2020-04-02T23:21:55.702 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.698+0000 7f576aed8700 1 -- 172.21.15.174:0/3100423319 shutdown_connections 2020-04-02T23:21:55.702 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.698+0000 7f576aed8700 1 --2- 172.21.15.174:0/3100423319 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f574404d8a0 0x7f574404fd60 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:55.702 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.698+0000 7f576aed8700 1 --2- 172.21.15.174:0/3100423319 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f576412ea60 0x7f57640a06e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:55.702 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.698+0000 7f576aed8700 1 --2- 172.21.15.174:0/3100423319 >> v2:172.21.15.196:3300/0 conn(0x7f57640a7a60 0x7f576409e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:55.713 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.698+0000 7f576aed8700 1 -- 172.21.15.174:0/3100423319 >> 172.21.15.174:0/3100423319 conn(0x7f57640aaf80 msgr2=0x7f576412ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:55.713 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.698+0000 7f576aed8700 1 -- 172.21.15.174:0/3100423319 shutdown_connections 2020-04-02T23:21:55.713 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.698+0000 7f576aed8700 1 -- 172.21.15.174:0/3100423319 wait complete. 2020-04-02T23:21:55.714 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:55.727 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-04-02T23:21:55.874 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.872+0000 7f1f161f1700 1 Processor -- start 2020-04-02T23:21:55.875 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.872+0000 7f1f161f1700 1 -- start start 2020-04-02T23:21:55.882 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.872+0000 7f1f161f1700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f1f100a7a60 0x7f1f100a38f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:55.883 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.872+0000 7f1f161f1700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1f10138b90 0x7f1f10134d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:55.883 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.872+0000 7f1f161f1700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f100a40d0 con 0x7f1f100a1fe0 2020-04-02T23:21:55.883 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.872+0000 7f1f161f1700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f100a3ec0 con 0x7f1f10138b90 2020-04-02T23:21:55.883 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.872+0000 7f1f161f1700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f100a4370 con 0x7f1f100a7a60 2020-04-02T23:21:55.883 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.873+0000 7f1f0ffff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1f10138b90 0x7f1f10134d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:55.883 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.873+0000 7f1f0effd700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f1f100a1fe0 0x7f1f10138480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:45308/0 (socket says 172.21.15.174:45308) 2020-04-02T23:21:55.887 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.873+0000 7f1f0ffff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1f10138b90 0x7f1f10134d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:40270/0 (socket says 172.21.15.174:40270) 2020-04-02T23:21:55.887 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.873+0000 7f1f0effd700 1 -- 172.21.15.174:0/3597159098 learned_addr learned my addr 172.21.15.174:0/3597159098 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:21:55.887 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.873+0000 7f1f0f7fe700 1 --2- 172.21.15.174:0/3597159098 >> v2:172.21.15.196:3300/0 conn(0x7f1f100a7a60 0x7f1f100a38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:55.887 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.873+0000 7f1f0ffff700 1 -- 172.21.15.174:0/3597159098 >> v2:172.21.15.196:3300/0 conn(0x7f1f100a7a60 msgr2=0x7f1f100a38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:55.887 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.873+0000 7f1f0ffff700 1 --2- 172.21.15.174:0/3597159098 >> v2:172.21.15.196:3300/0 conn(0x7f1f100a7a60 0x7f1f100a38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:55.887 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.873+0000 7f1f0ffff700 1 -- 172.21.15.174:0/3597159098 >> v1:172.21.15.174:6789/0 conn(0x7f1f100a1fe0 legacy=0x7f1f10138480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:55.887 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.873+0000 7f1f0e7fc700 1 -- 172.21.15.174:0/3597159098 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2558649268 0 0) 0x7f1f100a40d0 con 0x7f1f100a1fe0 2020-04-02T23:21:55.888 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.873+0000 7f1f0ffff700 1 -- 172.21.15.174:0/3597159098 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f100a2470 con 0x7f1f10138b90 2020-04-02T23:21:55.888 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.873+0000 7f1f0ffff700 1 --2- 172.21.15.174:0/3597159098 >> v2:172.21.15.174:3300/0 conn(0x7f1f10138b90 0x7f1f10134d60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1f08002f30 tx=0x7f1f08007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:55.888 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.873+0000 7f1f0ffff700 1 --2- 172.21.15.174:0/3597159098 >> v2:172.21.15.174:3300/0 conn(0x7f1f10138b90 0x7f1f10134d60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1f08002f30 tx=0x7f1f08007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:55.888 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.873+0000 7f1f0ffff700 1 --2- 172.21.15.174:0/3597159098 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f10138b90 0x7f1f10134d60 secure :-1 s=READY pgs=180 cs=0 l=1 rx=0x7f1f08002f30 tx=0x7f1f08007a40).ready entity=mon.0 client_cookie=1942d5d580be6bc7 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:55.888 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.873+0000 7f1f0ffff700 1 --2- 172.21.15.174:0/3597159098 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f10138b90 0x7f1f10134d60 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7f1f08002f30 tx=0x7f1f08007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:55.888 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.873+0000 7f1f0e7fc700 1 -- 172.21.15.174:0/3597159098 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f08011470 con 0x7f1f10138b90 2020-04-02T23:21:55.888 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.873+0000 7f1f0ffff700 1 --2- 172.21.15.174:0/3597159098 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f10138b90 0x7f1f10134d60 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7f1f08002f30 tx=0x7f1f08007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:55.889 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.873+0000 7f1f0e7fc700 1 -- 172.21.15.174:0/3597159098 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f080115d0 con 0x7f1f10138b90 2020-04-02T23:21:55.889 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.873+0000 7f1f0ffff700 1 --2- 172.21.15.174:0/3597159098 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f10138b90 0x7f1f10134d60 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7f1f08002f30 tx=0x7f1f08007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:55.889 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.873+0000 7f1f0e7fc700 1 -- 172.21.15.174:0/3597159098 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f08011970 con 0x7f1f10138b90 2020-04-02T23:21:55.889 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.873+0000 7f1f161f1700 1 -- 172.21.15.174:0/3597159098 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f10138b90 msgr2=0x7f1f10134d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:55.889 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.873+0000 7f1f161f1700 1 --2- 172.21.15.174:0/3597159098 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f10138b90 0x7f1f10134d60 secure :-1 s=READY pgs=180 cs=0 l=1 rx=0x7f1f08002f30 tx=0x7f1f08007a40).stop 2020-04-02T23:21:55.889 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.874+0000 7f1f161f1700 1 -- 172.21.15.174:0/3597159098 shutdown_connections 2020-04-02T23:21:55.889 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.874+0000 7f1f161f1700 1 --2- 172.21.15.174:0/3597159098 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f10138b90 0x7f1f10134d60 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:55.889 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.874+0000 7f1f161f1700 1 --2- 172.21.15.174:0/3597159098 >> v2:172.21.15.196:3300/0 conn(0x7f1f100a7a60 0x7f1f100a38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:55.890 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.874+0000 7f1f161f1700 1 -- 172.21.15.174:0/3597159098 >> 172.21.15.174:0/3597159098 conn(0x7f1f100aaf80 msgr2=0x7f1f100a6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:55.890 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.874+0000 7f1f161f1700 1 -- 172.21.15.174:0/3597159098 shutdown_connections 2020-04-02T23:21:55.890 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.874+0000 7f1f161f1700 1 -- 172.21.15.174:0/3597159098 wait complete. 2020-04-02T23:21:55.890 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.875+0000 7f1f161f1700 1 Processor -- start 2020-04-02T23:21:55.890 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.875+0000 7f1f161f1700 1 -- start start 2020-04-02T23:21:55.890 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.875+0000 7f1f161f1700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1f100a7a60 0x7f1f10131ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:55.890 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.875+0000 7f1f161f1700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f10138b90 0x7f1f1012d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:55.891 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.875+0000 7f1f161f1700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f101342b0 con 0x7f1f100a1fe0 2020-04-02T23:21:55.891 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.875+0000 7f1f161f1700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f10135ef0 con 0x7f1f100a7a60 2020-04-02T23:21:55.891 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.875+0000 7f1f161f1700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f10131130 con 0x7f1f10138b90 2020-04-02T23:21:55.891 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.875+0000 7f1f0f7fe700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f1f100a1fe0 0x7f1f1012fc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:45314/0 (socket says 172.21.15.174:45314) 2020-04-02T23:21:55.891 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.875+0000 7f1f0f7fe700 1 -- 172.21.15.174:0/1401470586 learned_addr learned my addr 172.21.15.174:0/1401470586 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:21:55.891 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.875+0000 7f1f0effd700 1 --2- 172.21.15.174:0/1401470586 >> v2:172.21.15.174:3300/0 conn(0x7f1f100a7a60 0x7f1f10131ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:55.891 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.876+0000 7f1f0ffff700 1 --2- 172.21.15.174:0/1401470586 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f10138b90 0x7f1f1012d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:55.892 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.876+0000 7f1f0effd700 1 -- 172.21.15.174:0/1401470586 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f10138b90 msgr2=0x7f1f1012d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:55.892 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.876+0000 7f1f0effd700 1 --2- 172.21.15.174:0/1401470586 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f10138b90 0x7f1f1012d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:55.892 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.876+0000 7f1f0cff9700 1 -- 172.21.15.174:0/1401470586 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 173954477 0 0) 0x7f1f101342b0 con 0x7f1f100a1fe0 2020-04-02T23:21:55.892 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.876+0000 7f1f0effd700 1 -- 172.21.15.174:0/1401470586 >> v1:172.21.15.174:6789/0 conn(0x7f1f100a1fe0 legacy=0x7f1f1012fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:55.892 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.876+0000 7f1f0effd700 1 -- 172.21.15.174:0/1401470586 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f10133d70 con 0x7f1f100a7a60 2020-04-02T23:21:55.892 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.876+0000 7f1f0effd700 1 --2- 172.21.15.174:0/1401470586 >> v2:172.21.15.174:3300/0 conn(0x7f1f100a7a60 0x7f1f10131ae0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1ef8000b80 tx=0x7f1ef80108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:55.892 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.876+0000 7f1f0effd700 1 --2- 172.21.15.174:0/1401470586 >> v2:172.21.15.174:3300/0 conn(0x7f1f100a7a60 0x7f1f10131ae0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1ef8000b80 tx=0x7f1ef80108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:55.893 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.876+0000 7f1f0effd700 1 --2- 172.21.15.174:0/1401470586 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f100a7a60 0x7f1f10131ae0 secure :-1 s=READY pgs=182 cs=0 l=1 rx=0x7f1ef8000b80 tx=0x7f1ef80108c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:55.893 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.876+0000 7f1f0effd700 1 --2- 172.21.15.174:0/1401470586 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f100a7a60 0x7f1f10131ae0 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7f1ef8000b80 tx=0x7f1ef80108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:55.893 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.876+0000 7f1f0cff9700 1 -- 172.21.15.174:0/1401470586 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ef8005ca0 con 0x7f1f100a7a60 2020-04-02T23:21:55.893 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.876+0000 7f1f0effd700 1 --2- 172.21.15.174:0/1401470586 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f100a7a60 0x7f1f10131ae0 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7f1ef8000b80 tx=0x7f1ef80108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:55.893 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.876+0000 7f1f0effd700 1 --2- 172.21.15.174:0/1401470586 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f100a7a60 0x7f1f10131ae0 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7f1ef8000b80 tx=0x7f1ef80108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:55.893 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.876+0000 7f1f0cff9700 1 -- 172.21.15.174:0/1401470586 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ef8005e00 con 0x7f1f100a7a60 2020-04-02T23:21:55.893 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.876+0000 7f1f0cff9700 1 -- 172.21.15.174:0/1401470586 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ef80062b0 con 0x7f1f100a7a60 2020-04-02T23:21:55.894 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.876+0000 7f1f161f1700 1 -- 172.21.15.174:0/1401470586 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f10134010 con 0x7f1f100a7a60 2020-04-02T23:21:55.894 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.876+0000 7f1f161f1700 1 -- 172.21.15.174:0/1401470586 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f10132580 con 0x7f1f100a7a60 2020-04-02T23:21:55.894 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.877+0000 7f1f0effd700 1 --2- 172.21.15.174:0/1401470586 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f100a7a60 0x7f1f10131ae0 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7f1ef8000b80 tx=0x7f1ef80108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:55.894 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.877+0000 7f1f161f1700 1 -- 172.21.15.174:0/1401470586 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f1012f900 con 0x7f1f100a7a60 2020-04-02T23:21:55.894 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.877+0000 7f1f0cff9700 1 -- 172.21.15.174:0/1401470586 <== mon.0 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f1ef8006520 con 0x7f1f100a7a60 2020-04-02T23:21:55.894 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.877+0000 7f1f0effd700 1 --2- 172.21.15.174:0/1401470586 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f100a7a60 0x7f1f10131ae0 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7f1ef8000b80 tx=0x7f1ef80108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:55.894 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.877+0000 7f1f0cff9700 1 --2- 172.21.15.174:0/1401470586 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f1ef404d380 0x7f1ef404f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:55.894 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.877+0000 7f1f0cff9700 1 -- 172.21.15.174:0/1401470586 <== mon.0 v2:172.21.15.174:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1ef8060f20 con 0x7f1f100a7a60 2020-04-02T23:21:55.895 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.878+0000 7f1f0f7fe700 1 --2- 172.21.15.174:0/1401470586 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f1ef404d380 0x7f1ef404f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:55.895 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.878+0000 7f1f0f7fe700 1 --2- 172.21.15.174:0/1401470586 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f1ef404d380 0x7f1ef404f840 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1f00007dc0 tx=0x7f1f000026e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:55.895 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.878+0000 7f1f0f7fe700 1 --2- 172.21.15.174:0/1401470586 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f1ef404d380 0x7f1ef404f840 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1f00007dc0 tx=0x7f1f000026e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:55.895 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.878+0000 7f1f0f7fe700 1 --2- 172.21.15.174:0/1401470586 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f1ef404d380 0x7f1ef404f840 secure :-1 s=READY pgs=97 cs=0 l=1 rx=0x7f1f00007dc0 tx=0x7f1f000026e0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:55.896 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.881+0000 7f1f0effd700 1 --2- 172.21.15.174:0/1401470586 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f100a7a60 0x7f1f10131ae0 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7f1ef8000b80 tx=0x7f1ef80108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:55.896 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:55.881+0000 7f1f0cff9700 1 -- 172.21.15.174:0/1401470586 <== mon.0 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f1ef803c5c0 con 0x7f1f100a7a60 2020-04-02T23:21:56.021 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.019+0000 7f1f161f1700 1 -- 172.21.15.174:0/1401470586 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1f10056c50 con 0x7f1f100a7a60 2020-04-02T23:21:56.022 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.019+0000 7f1f0effd700 1 --2- 172.21.15.174:0/1401470586 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f100a7a60 0x7f1f10131ae0 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7f1ef8000b80 tx=0x7f1ef80108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:56.022 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.019+0000 7f1f0cff9700 1 -- 172.21.15.174:0/1401470586 <== mon.0 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1ef803fbe0 con 0x7f1f100a7a60 2020-04-02T23:21:56.022 INFO:teuthology.orchestra.run.smithi174.stdout:pg_num: 8 2020-04-02T23:21:56.023 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.020+0000 7f1f161f1700 1 -- 172.21.15.174:0/1401470586 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f1ef404d380 msgr2=0x7f1ef404f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:56.023 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.020+0000 7f1f161f1700 1 --2- 172.21.15.174:0/1401470586 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f1ef404d380 0x7f1ef404f840 secure :-1 s=READY pgs=97 cs=0 l=1 rx=0x7f1f00007dc0 tx=0x7f1f000026e0).stop 2020-04-02T23:21:56.023 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.020+0000 7f1f161f1700 1 -- 172.21.15.174:0/1401470586 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f100a7a60 msgr2=0x7f1f10131ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:56.023 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.020+0000 7f1f161f1700 1 --2- 172.21.15.174:0/1401470586 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f100a7a60 0x7f1f10131ae0 secure :-1 s=READY pgs=182 cs=0 l=1 rx=0x7f1ef8000b80 tx=0x7f1ef80108c0).stop 2020-04-02T23:21:56.024 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.020+0000 7f1f161f1700 1 -- 172.21.15.174:0/1401470586 shutdown_connections 2020-04-02T23:21:56.024 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.020+0000 7f1f161f1700 1 --2- 172.21.15.174:0/1401470586 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f1ef404d380 0x7f1ef404f840 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:56.024 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.020+0000 7f1f161f1700 1 --2- 172.21.15.174:0/1401470586 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f10138b90 0x7f1f1012d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:56.024 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.020+0000 7f1f161f1700 1 --2- 172.21.15.174:0/1401470586 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f100a7a60 0x7f1f10131ae0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:56.024 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.020+0000 7f1f161f1700 1 -- 172.21.15.174:0/1401470586 >> 172.21.15.174:0/1401470586 conn(0x7f1f100aaf80 msgr2=0x7f1f1009da20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:56.024 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.020+0000 7f1f161f1700 1 -- 172.21.15.174:0/1401470586 shutdown_connections 2020-04-02T23:21:56.025 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.020+0000 7f1f161f1700 1 -- 172.21.15.174:0/1401470586 wait complete. 2020-04-02T23:21:56.037 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:56.051 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-04-02T23:21:56.199 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.196+0000 7fafcb59e700 1 Processor -- start 2020-04-02T23:21:56.199 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.196+0000 7fafcb59e700 1 -- start start 2020-04-02T23:21:56.219 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.197+0000 7fafcb59e700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fafcc0a63d0 0x7fafcc0a21d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:56.220 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.197+0000 7fafcb59e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafcc05caa0 con 0x7fafcc05c6c0 2020-04-02T23:21:56.220 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.197+0000 7fafcb59e700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafcc0a4eb0 con 0x7fafcc0a3310 2020-04-02T23:21:56.220 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.197+0000 7fafcb59e700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafcc066ff0 con 0x7fafcc0a63d0 2020-04-02T23:21:56.220 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.197+0000 7fafca59c700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fafcc05c6c0 0x7fafcc0a2c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:45322/0 (socket says 172.21.15.174:45322) 2020-04-02T23:21:56.220 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.197+0000 7fafca59c700 1 -- 172.21.15.174:0/3765245488 learned_addr learned my addr 172.21.15.174:0/3765245488 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:21:56.220 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.197+0000 7fafcad9d700 1 --2- 172.21.15.174:0/3765245488 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fafcc0a63d0 0x7fafcc0a21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:56.221 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.197+0000 7fafc959a700 1 -- 172.21.15.174:0/3765245488 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3873489283 0 0) 0x7fafcc05caa0 con 0x7fafcc05c6c0 2020-04-02T23:21:56.221 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.197+0000 7fafc959a700 1 -- 172.21.15.174:0/3765245488 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafac003230 con 0x7fafcc05c6c0 2020-04-02T23:21:56.221 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.197+0000 7fafc959a700 1 -- 172.21.15.174:0/3765245488 <== mon.0 v1:172.21.15.174:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4054407643 0 0) 0x7fafac003230 con 0x7fafcc05c6c0 2020-04-02T23:21:56.221 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.197+0000 7fafc959a700 1 -- 172.21.15.174:0/3765245488 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fafcc0a63d0 msgr2=0x7fafcc0a21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:56.221 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.197+0000 7fafc959a700 1 --2- 172.21.15.174:0/3765245488 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fafcc0a63d0 0x7fafcc0a21d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:56.221 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.197+0000 7fafc959a700 1 -- 172.21.15.174:0/3765245488 >> v1:172.21.15.196:6789/0 conn(0x7fafcc0a3310 legacy=0x7fafcc0a1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:56.221 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.197+0000 7fafc959a700 1 -- 172.21.15.174:0/3765245488 --> v1:172.21.15.174:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafcc067290 con 0x7fafcc05c6c0 2020-04-02T23:21:56.221 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.198+0000 7fafc959a700 1 -- 172.21.15.174:0/3765245488 <== mon.0 v1:172.21.15.174:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2811762909 0 0) 0x7fafbc001850 con 0x7fafcc05c6c0 2020-04-02T23:21:56.222 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.198+0000 7fafc959a700 1 -- 172.21.15.174:0/3765245488 >> v1:172.21.15.174:6789/0 conn(0x7fafcc05c6c0 legacy=0x7fafcc0a2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:56.230 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.198+0000 7fafc959a700 1 --2- 172.21.15.174:0/3765245488 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fafac003750 0x7fafac003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:56.231 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.198+0000 7fafc959a700 1 --2- 172.21.15.174:0/3765245488 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fafcc0a63d0 0x7fafac0044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:56.231 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.198+0000 7fafc959a700 1 --2- 172.21.15.174:0/3765245488 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fafac004930 0x7fafac004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:56.231 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.198+0000 7fafc959a700 1 -- 172.21.15.174:0/3765245488 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafcc066ff0 con 0x7fafac004930 2020-04-02T23:21:56.231 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.198+0000 7fafc959a700 1 -- 172.21.15.174:0/3765245488 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafac005300 con 0x7fafac003750 2020-04-02T23:21:56.231 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.198+0000 7fafc959a700 1 -- 172.21.15.174:0/3765245488 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafac0040e0 con 0x7fafcc0a63d0 2020-04-02T23:21:56.231 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.198+0000 7fafcad9d700 1 --2- 172.21.15.174:0/3765245488 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fafac004930 0x7fafac004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:56.231 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.198+0000 7fafca59c700 1 --2- 172.21.15.174:0/3765245488 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fafac003750 0x7fafac003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:56.232 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.198+0000 7fafc9d9b700 1 --2- 172.21.15.174:0/3765245488 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fafcc0a63d0 0x7fafac0044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:56.232 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.198+0000 7fafcad9d700 1 -- 172.21.15.174:0/3765245488 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fafcc0a63d0 msgr2=0x7fafac0044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:56.232 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.198+0000 7fafcad9d700 1 --2- 172.21.15.174:0/3765245488 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fafcc0a63d0 0x7fafac0044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:56.232 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.198+0000 7fafcad9d700 1 -- 172.21.15.174:0/3765245488 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fafac003750 msgr2=0x7fafac003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:56.232 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.198+0000 7fafcad9d700 1 --2- 172.21.15.174:0/3765245488 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fafac003750 0x7fafac003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:56.232 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.198+0000 7fafcad9d700 1 -- 172.21.15.174:0/3765245488 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafac003230 con 0x7fafac004930 2020-04-02T23:21:56.232 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.198+0000 7fafcad9d700 1 --2- 172.21.15.174:0/3765245488 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fafac004930 0x7fafac004db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fafc40032b0 tx=0x7fafc40103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:56.233 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.198+0000 7fafcad9d700 1 --2- 172.21.15.174:0/3765245488 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fafac004930 0x7fafac004db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fafc40032b0 tx=0x7fafc40103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:56.233 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.198+0000 7fafcad9d700 1 --2- 172.21.15.174:0/3765245488 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fafac004930 0x7fafac004db0 secure :-1 s=READY pgs=184 cs=0 l=1 rx=0x7fafc40032b0 tx=0x7fafc40103a0).ready entity=mon.0 client_cookie=d1af89016fdcc682 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:56.233 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.198+0000 7fafcad9d700 1 --2- 172.21.15.174:0/3765245488 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fafac004930 0x7fafac004db0 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7fafc40032b0 tx=0x7fafc40103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:56.233 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.198+0000 7fafc959a700 1 -- 172.21.15.174:0/3765245488 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fafc4005a40 con 0x7fafac004930 2020-04-02T23:21:56.233 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.198+0000 7fafcad9d700 1 --2- 172.21.15.174:0/3765245488 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fafac004930 0x7fafac004db0 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7fafc40032b0 tx=0x7fafc40103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:56.233 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.198+0000 7fafc959a700 1 -- 172.21.15.174:0/3765245488 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafc4005ba0 con 0x7fafac004930 2020-04-02T23:21:56.233 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.198+0000 7fafcad9d700 1 --2- 172.21.15.174:0/3765245488 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fafac004930 0x7fafac004db0 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7fafc40032b0 tx=0x7fafc40103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:56.234 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.198+0000 7fafc959a700 1 -- 172.21.15.174:0/3765245488 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fafc40110c0 con 0x7fafac004930 2020-04-02T23:21:56.234 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.198+0000 7fafcb59e700 1 -- 172.21.15.174:0/3765245488 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fafac004930 msgr2=0x7fafac004db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:56.234 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.198+0000 7fafcb59e700 1 --2- 172.21.15.174:0/3765245488 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fafac004930 0x7fafac004db0 secure :-1 s=READY pgs=184 cs=0 l=1 rx=0x7fafc40032b0 tx=0x7fafc40103a0).stop 2020-04-02T23:21:56.234 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.198+0000 7fafcad9d700 1 -- 172.21.15.174:0/3765245488 reap_dead start 2020-04-02T23:21:56.234 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.199+0000 7fafcb59e700 1 -- 172.21.15.174:0/3765245488 shutdown_connections 2020-04-02T23:21:56.234 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.199+0000 7fafcb59e700 1 -- 172.21.15.174:0/3765245488 >> 172.21.15.174:0/3765245488 conn(0x7fafcc0a7590 msgr2=0x7fafcc0a79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:56.234 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.199+0000 7fafcb59e700 1 -- 172.21.15.174:0/3765245488 shutdown_connections 2020-04-02T23:21:56.234 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.199+0000 7fafcb59e700 1 -- 172.21.15.174:0/3765245488 wait complete. 2020-04-02T23:21:56.235 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.200+0000 7fafcb59e700 1 Processor -- start 2020-04-02T23:21:56.235 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.200+0000 7fafcb59e700 1 -- start start 2020-04-02T23:21:56.235 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.200+0000 7fafcb59e700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fafcc09e970 0x7fafcc0a16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:56.235 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.200+0000 7fafcb59e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fafcc145b10 0x7fafcc145f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:56.235 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.200+0000 7fafcb59e700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafcc09b600 con 0x7fafcc09bcd0 2020-04-02T23:21:56.235 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.200+0000 7fafcb59e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafcc138f90 con 0x7fafcc145b10 2020-04-02T23:21:56.235 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.200+0000 7fafcb59e700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafcc09ed50 con 0x7fafcc09e970 2020-04-02T23:21:56.236 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.200+0000 7fafcad9d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fafcc145b10 0x7fafcc145f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:56.236 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.200+0000 7fafcad9d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fafcc145b10 0x7fafcc145f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:40300/0 (socket says 172.21.15.174:40300) 2020-04-02T23:21:56.236 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.200+0000 7fafcad9d700 1 -- 172.21.15.174:0/3896389748 learned_addr learned my addr 172.21.15.174:0/3896389748 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:21:56.236 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.200+0000 7fafca59c700 1 --2- 172.21.15.174:0/3896389748 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fafcc09e970 0x7fafcc0a16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:56.236 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.201+0000 7fafcad9d700 1 -- 172.21.15.174:0/3896389748 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fafcc09e970 msgr2=0x7fafcc0a16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:56.236 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.201+0000 7fafcad9d700 1 --2- 172.21.15.174:0/3896389748 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fafcc09e970 0x7fafcc0a16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:56.236 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.201+0000 7fafcad9d700 1 -- 172.21.15.174:0/3896389748 >> v1:172.21.15.196:6789/0 conn(0x7fafcc09bcd0 legacy=0x7fafcc145400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:56.237 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.201+0000 7fafcad9d700 1 -- 172.21.15.174:0/3896389748 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafcc09d020 con 0x7fafcc145b10 2020-04-02T23:21:56.237 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.201+0000 7fafcad9d700 1 --2- 172.21.15.174:0/3896389748 >> v2:172.21.15.174:3300/0 conn(0x7fafcc145b10 0x7fafcc145f40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fafcc0675d0 tx=0x7fafc40103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:56.237 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.201+0000 7fafcad9d700 1 --2- 172.21.15.174:0/3896389748 >> v2:172.21.15.174:3300/0 conn(0x7fafcc145b10 0x7fafcc145f40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fafcc0675d0 tx=0x7fafc40103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:56.237 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.201+0000 7fafcad9d700 1 --2- 172.21.15.174:0/3896389748 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fafcc145b10 0x7fafcc145f40 secure :-1 s=READY pgs=185 cs=0 l=1 rx=0x7fafcc0675d0 tx=0x7fafc40103a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:56.237 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.201+0000 7fafcad9d700 1 --2- 172.21.15.174:0/3896389748 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fafcc145b10 0x7fafcc145f40 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7fafcc0675d0 tx=0x7fafc40103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:56.237 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.201+0000 7fafc37fe700 1 -- 172.21.15.174:0/3896389748 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fafc40077f0 con 0x7fafcc145b10 2020-04-02T23:21:56.237 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.201+0000 7fafcad9d700 1 --2- 172.21.15.174:0/3896389748 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fafcc145b10 0x7fafcc145f40 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7fafcc0675d0 tx=0x7fafc40103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:56.237 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.201+0000 7fafcad9d700 1 --2- 172.21.15.174:0/3896389748 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fafcc145b10 0x7fafcc145f40 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7fafcc0675d0 tx=0x7fafc40103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:56.238 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.201+0000 7fafc37fe700 1 -- 172.21.15.174:0/3896389748 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafc4007950 con 0x7fafcc145b10 2020-04-02T23:21:56.238 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.201+0000 7fafcb59e700 1 -- 172.21.15.174:0/3896389748 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafcc09b830 con 0x7fafcc145b10 2020-04-02T23:21:56.238 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.201+0000 7fafc37fe700 1 -- 172.21.15.174:0/3896389748 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fafc400f3e0 con 0x7fafcc145b10 2020-04-02T23:21:56.238 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.201+0000 7fafcb59e700 1 -- 172.21.15.174:0/3896389748 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafcc09cbf0 con 0x7fafcc145b10 2020-04-02T23:21:56.238 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.202+0000 7fafcad9d700 1 --2- 172.21.15.174:0/3896389748 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fafcc145b10 0x7fafcc145f40 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7fafcc0675d0 tx=0x7fafc40103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:56.238 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.202+0000 7fafcad9d700 1 --2- 172.21.15.174:0/3896389748 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fafcc145b10 0x7fafcc145f40 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7fafcc0675d0 tx=0x7fafc40103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:56.238 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.202+0000 7fafc37fe700 1 -- 172.21.15.174:0/3896389748 <== mon.0 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fafc400f540 con 0x7fafcc145b10 2020-04-02T23:21:56.239 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.202+0000 7fafcb59e700 1 -- 172.21.15.174:0/3896389748 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafcc0a8330 con 0x7fafcc145b10 2020-04-02T23:21:56.239 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.202+0000 7fafc37fe700 1 --2- 172.21.15.174:0/3896389748 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fafb004d560 0x7fafb004fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:56.239 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.202+0000 7fafc37fe700 1 -- 172.21.15.174:0/3896389748 <== mon.0 v2:172.21.15.174:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fafc40611b0 con 0x7fafcc145b10 2020-04-02T23:21:56.239 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.202+0000 7fafca59c700 1 --2- 172.21.15.174:0/3896389748 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fafb004d560 0x7fafb004fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:56.239 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.203+0000 7fafca59c700 1 --2- 172.21.15.174:0/3896389748 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fafb004d560 0x7fafb004fa20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fafbc001560 tx=0x7fafcc060080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:56.239 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.203+0000 7fafca59c700 1 --2- 172.21.15.174:0/3896389748 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fafb004d560 0x7fafb004fa20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fafbc001560 tx=0x7fafcc060080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:56.239 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.203+0000 7fafca59c700 1 --2- 172.21.15.174:0/3896389748 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fafb004d560 0x7fafb004fa20 secure :-1 s=READY pgs=98 cs=0 l=1 rx=0x7fafbc001560 tx=0x7fafcc060080).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:56.240 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.205+0000 7fafcad9d700 1 --2- 172.21.15.174:0/3896389748 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fafcc145b10 0x7fafcc145f40 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7fafcc0675d0 tx=0x7fafc40103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:56.240 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.205+0000 7fafc37fe700 1 -- 172.21.15.174:0/3896389748 <== mon.0 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fafcc0a8330 con 0x7fafcc145b10 2020-04-02T23:21:56.343 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.341+0000 7fafcb59e700 1 -- 172.21.15.174:0/3896389748 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fafcc0a8330 con 0x7fafcc145b10 2020-04-02T23:21:56.344 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.341+0000 7fafcad9d700 1 --2- 172.21.15.174:0/3896389748 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fafcc145b10 0x7fafcc145f40 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7fafcc0675d0 tx=0x7fafc40103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:56.344 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.341+0000 7fafc37fe700 1 -- 172.21.15.174:0/3896389748 <== mon.0 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+10 (secure 0 0 0) 0x7fafcc0a8330 con 0x7fafcc145b10 2020-04-02T23:21:56.344 INFO:teuthology.orchestra.run.smithi174.stdout:pg_num: 8 2020-04-02T23:21:56.345 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.342+0000 7fafcb59e700 1 -- 172.21.15.174:0/3896389748 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fafb004d560 msgr2=0x7fafb004fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:56.345 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.342+0000 7fafcb59e700 1 --2- 172.21.15.174:0/3896389748 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fafb004d560 0x7fafb004fa20 secure :-1 s=READY pgs=98 cs=0 l=1 rx=0x7fafbc001560 tx=0x7fafcc060080).stop 2020-04-02T23:21:56.345 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.342+0000 7fafcb59e700 1 -- 172.21.15.174:0/3896389748 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fafcc145b10 msgr2=0x7fafcc145f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:56.345 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.342+0000 7fafcb59e700 1 --2- 172.21.15.174:0/3896389748 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fafcc145b10 0x7fafcc145f40 secure :-1 s=READY pgs=185 cs=0 l=1 rx=0x7fafcc0675d0 tx=0x7fafc40103a0).stop 2020-04-02T23:21:56.346 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.342+0000 7fafcb59e700 1 -- 172.21.15.174:0/3896389748 shutdown_connections 2020-04-02T23:21:56.346 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.342+0000 7fafcb59e700 1 --2- 172.21.15.174:0/3896389748 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fafcc145b10 0x7fafcc145f40 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:56.346 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.342+0000 7fafcb59e700 1 --2- 172.21.15.174:0/3896389748 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fafcc09e970 0x7fafcc0a16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:56.346 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.342+0000 7fafcb59e700 1 --2- 172.21.15.174:0/3896389748 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fafb004d560 0x7fafb004fa20 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:56.346 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.342+0000 7fafcb59e700 1 -- 172.21.15.174:0/3896389748 >> 172.21.15.174:0/3896389748 conn(0x7fafcc0a7590 msgr2=0x7fafcc0695c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:56.346 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.342+0000 7fafcb59e700 1 -- 172.21.15.174:0/3896389748 shutdown_connections 2020-04-02T23:21:56.346 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.342+0000 7fafcb59e700 1 -- 172.21.15.174:0/3896389748 wait complete. 2020-04-02T23:21:56.355 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:56.369 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-04-02T23:21:56.525 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.514+0000 7fc353f54700 1 Processor -- start 2020-04-02T23:21:56.525 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.515+0000 7fc353f54700 1 -- start start 2020-04-02T23:21:56.528 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.515+0000 7fc353f54700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fc34c0a7a60 0x7fc34c0a22b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:56.528 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.515+0000 7fc353f54700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc34c0a4330 0x7fc34c1384a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:56.529 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.515+0000 7fc353f54700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc34c0a3ae0 con 0x7fc34c138900 2020-04-02T23:21:56.529 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.515+0000 7fc353f54700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc34c0a3d80 con 0x7fc34c0a7a60 2020-04-02T23:21:56.529 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.515+0000 7fc353f54700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc34c0a4020 con 0x7fc34c0a4330 2020-04-02T23:21:56.529 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.515+0000 7fc3524f1700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fc34c138900 0x7fc34c12e750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:45342/0 (socket says 172.21.15.174:45342) 2020-04-02T23:21:56.529 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.515+0000 7fc3524f1700 1 -- 172.21.15.174:0/1210381867 learned_addr learned my addr 172.21.15.174:0/1210381867 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:21:56.529 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.515+0000 7fc351cf0700 1 --2- 172.21.15.174:0/1210381867 >> v2:172.21.15.196:3300/0 conn(0x7fc34c0a7a60 0x7fc34c0a22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:56.529 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.515+0000 7fc3514ef700 1 --2- 172.21.15.174:0/1210381867 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc34c0a4330 0x7fc34c1384a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:56.530 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.516+0000 7fc350cee700 1 -- 172.21.15.174:0/1210381867 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1781703253 0 0) 0x7fc34c0a3ae0 con 0x7fc34c138900 2020-04-02T23:21:56.530 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.516+0000 7fc350cee700 1 -- 172.21.15.174:0/1210381867 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc334003230 con 0x7fc34c138900 2020-04-02T23:21:56.530 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.516+0000 7fc350cee700 1 -- 172.21.15.174:0/1210381867 <== mon.0 v1:172.21.15.174:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4146990270 0 0) 0x7fc334003230 con 0x7fc34c138900 2020-04-02T23:21:56.530 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.516+0000 7fc350cee700 1 -- 172.21.15.174:0/1210381867 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc34c0a4330 msgr2=0x7fc34c1384a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:56.530 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.516+0000 7fc350cee700 1 --2- 172.21.15.174:0/1210381867 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc34c0a4330 0x7fc34c1384a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:56.530 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.516+0000 7fc350cee700 1 -- 172.21.15.174:0/1210381867 >> v2:172.21.15.196:3300/0 conn(0x7fc34c0a7a60 msgr2=0x7fc34c0a22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:56.530 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.516+0000 7fc350cee700 1 --2- 172.21.15.174:0/1210381867 >> v2:172.21.15.196:3300/0 conn(0x7fc34c0a7a60 0x7fc34c0a22b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:56.530 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.516+0000 7fc350cee700 1 -- 172.21.15.174:0/1210381867 --> v1:172.21.15.174:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc34c0a1a60 con 0x7fc34c138900 2020-04-02T23:21:56.531 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.516+0000 7fc350cee700 1 -- 172.21.15.174:0/1210381867 <== mon.0 v1:172.21.15.174:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2811762909 0 0) 0x7fc344001a50 con 0x7fc34c138900 2020-04-02T23:21:56.531 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.516+0000 7fc350cee700 1 -- 172.21.15.174:0/1210381867 >> v1:172.21.15.174:6789/0 conn(0x7fc34c138900 legacy=0x7fc34c12e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:56.531 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.516+0000 7fc350cee700 1 --2- 172.21.15.174:0/1210381867 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc34c0a4330 0x7fc334003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:56.531 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.516+0000 7fc350cee700 1 --2- 172.21.15.174:0/1210381867 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc334003b80 0x7fc334003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:56.532 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.516+0000 7fc350cee700 1 --2- 172.21.15.174:0/1210381867 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc3340045c0 0x7fc334004a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:56.532 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.516+0000 7fc350cee700 1 -- 172.21.15.174:0/1210381867 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc34c0a3d80 con 0x7fc334003b80 2020-04-02T23:21:56.532 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.516+0000 7fc350cee700 1 -- 172.21.15.174:0/1210381867 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc34c0a4020 con 0x7fc3340045c0 2020-04-02T23:21:56.532 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.516+0000 7fc350cee700 1 -- 172.21.15.174:0/1210381867 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc334005050 con 0x7fc34c0a4330 2020-04-02T23:21:56.532 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.516+0000 7fc3514ef700 1 --2- 172.21.15.174:0/1210381867 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc334003b80 0x7fc334003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:56.532 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.516+0000 7fc351cf0700 1 --2- 172.21.15.174:0/1210381867 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc34c0a4330 0x7fc334003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:56.532 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.516+0000 7fc3524f1700 1 --2- 172.21.15.174:0/1210381867 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc3340045c0 0x7fc334004a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:56.533 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.516+0000 7fc3514ef700 1 -- 172.21.15.174:0/1210381867 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc34c0a4330 msgr2=0x7fc334003720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:56.533 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.516+0000 7fc3514ef700 1 --2- 172.21.15.174:0/1210381867 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc34c0a4330 0x7fc334003720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:56.533 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.516+0000 7fc3514ef700 1 -- 172.21.15.174:0/1210381867 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc3340045c0 msgr2=0x7fc334004a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:56.533 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.516+0000 7fc3514ef700 1 --2- 172.21.15.174:0/1210381867 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc3340045c0 0x7fc334004a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:56.533 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.516+0000 7fc3514ef700 1 -- 172.21.15.174:0/1210381867 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc334003230 con 0x7fc334003b80 2020-04-02T23:21:56.533 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.516+0000 7fc3514ef700 1 --2- 172.21.15.174:0/1210381867 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc334003b80 0x7fc334003fe0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc348008910 tx=0x7fc348010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:56.533 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.516+0000 7fc3514ef700 1 --2- 172.21.15.174:0/1210381867 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc334003b80 0x7fc334003fe0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc348008910 tx=0x7fc348010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:56.533 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.516+0000 7fc3514ef700 1 --2- 172.21.15.174:0/1210381867 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc334003b80 0x7fc334003fe0 secure :-1 s=READY pgs=187 cs=0 l=1 rx=0x7fc348008910 tx=0x7fc348010050).ready entity=mon.0 client_cookie=3517152c28825c79 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:56.534 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.516+0000 7fc3514ef700 1 --2- 172.21.15.174:0/1210381867 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc334003b80 0x7fc334003fe0 secure :-1 s=THROTTLE_DONE pgs=187 cs=0 l=1 rx=0x7fc348008910 tx=0x7fc348010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:56.534 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.516+0000 7fc350cee700 1 -- 172.21.15.174:0/1210381867 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc348008d30 con 0x7fc334003b80 2020-04-02T23:21:56.534 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.516+0000 7fc3514ef700 1 --2- 172.21.15.174:0/1210381867 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc334003b80 0x7fc334003fe0 secure :-1 s=THROTTLE_DONE pgs=187 cs=0 l=1 rx=0x7fc348008910 tx=0x7fc348010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:56.534 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.516+0000 7fc3514ef700 1 --2- 172.21.15.174:0/1210381867 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc334003b80 0x7fc334003fe0 secure :-1 s=THROTTLE_DONE pgs=187 cs=0 l=1 rx=0x7fc348008910 tx=0x7fc348010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:56.534 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.516+0000 7fc350cee700 1 -- 172.21.15.174:0/1210381867 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc348008e90 con 0x7fc334003b80 2020-04-02T23:21:56.534 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.516+0000 7fc350cee700 1 -- 172.21.15.174:0/1210381867 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc348010a80 con 0x7fc334003b80 2020-04-02T23:21:56.534 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.516+0000 7fc353f54700 1 -- 172.21.15.174:0/1210381867 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc334003b80 msgr2=0x7fc334003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:56.535 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.516+0000 7fc353f54700 1 --2- 172.21.15.174:0/1210381867 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc334003b80 0x7fc334003fe0 secure :-1 s=READY pgs=187 cs=0 l=1 rx=0x7fc348008910 tx=0x7fc348010050).stop 2020-04-02T23:21:56.535 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.517+0000 7fc3524f1700 1 -- 172.21.15.174:0/1210381867 reap_dead start 2020-04-02T23:21:56.535 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.517+0000 7fc353f54700 1 -- 172.21.15.174:0/1210381867 shutdown_connections 2020-04-02T23:21:56.535 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.517+0000 7fc353f54700 1 -- 172.21.15.174:0/1210381867 >> 172.21.15.174:0/1210381867 conn(0x7fc34c0aaf80 msgr2=0x7fc34c0a6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:56.535 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.517+0000 7fc353f54700 1 -- 172.21.15.174:0/1210381867 shutdown_connections 2020-04-02T23:21:56.535 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.517+0000 7fc353f54700 1 -- 172.21.15.174:0/1210381867 wait complete. 2020-04-02T23:21:56.535 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.518+0000 7fc353f54700 1 Processor -- start 2020-04-02T23:21:56.535 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.518+0000 7fc353f54700 1 -- start start 2020-04-02T23:21:56.536 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.518+0000 7fc353f54700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fc34c14b770 0x7fc34c14db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:56.536 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.518+0000 7fc353f54700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc34c0a4bf0 con 0x7fc34c14dfc0 2020-04-02T23:21:56.536 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.518+0000 7fc353f54700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc34c05f2b0 con 0x7fc34c133440 2020-04-02T23:21:56.536 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.518+0000 7fc353f54700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc34c065a60 con 0x7fc34c14b770 2020-04-02T23:21:56.536 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.519+0000 7fc3524f1700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fc34c14dfc0 0x7fc34c1503b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:45358/0 (socket says 172.21.15.174:45358) 2020-04-02T23:21:56.536 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.519+0000 7fc3524f1700 1 -- 172.21.15.174:0/2228030683 learned_addr learned my addr 172.21.15.174:0/2228030683 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:21:56.536 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.519+0000 7fc3514ef700 1 --2- 172.21.15.174:0/2228030683 >> v2:172.21.15.196:3300/0 conn(0x7fc34c14b770 0x7fc34c14db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:56.537 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.519+0000 7fc33affd700 1 -- 172.21.15.174:0/2228030683 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2055309904 0 0) 0x7fc34c0a4bf0 con 0x7fc34c14dfc0 2020-04-02T23:21:56.537 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.519+0000 7fc33affd700 1 -- 172.21.15.174:0/2228030683 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc32c002fe0 con 0x7fc34c14dfc0 2020-04-02T23:21:56.537 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.519+0000 7fc33affd700 1 -- 172.21.15.174:0/2228030683 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3382898104 0 0) 0x7fc34c05f2b0 con 0x7fc34c133440 2020-04-02T23:21:56.537 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.519+0000 7fc33affd700 1 -- 172.21.15.174:0/2228030683 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc34c0a4bf0 con 0x7fc34c133440 2020-04-02T23:21:56.537 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.519+0000 7fc33affd700 1 -- 172.21.15.174:0/2228030683 <== mon.0 v1:172.21.15.174:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 263458029 0 0) 0x7fc32c002fe0 con 0x7fc34c14dfc0 2020-04-02T23:21:56.537 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.519+0000 7fc3514ef700 1 -- 172.21.15.174:0/2228030683 >> v1:172.21.15.196:6789/0 conn(0x7fc34c133440 legacy=0x7fc34c134680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:56.537 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.519+0000 7fc3514ef700 1 -- 172.21.15.174:0/2228030683 >> v1:172.21.15.174:6789/0 conn(0x7fc34c14dfc0 legacy=0x7fc34c1503b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:56.537 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.519+0000 7fc3514ef700 1 -- 172.21.15.174:0/2228030683 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc34c133ce0 con 0x7fc34c14b770 2020-04-02T23:21:56.547 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.519+0000 7fc3514ef700 1 --2- 172.21.15.174:0/2228030683 >> v2:172.21.15.196:3300/0 conn(0x7fc34c14b770 0x7fc34c14db60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc344001cb0 tx=0x7fc348010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:56.547 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.519+0000 7fc3514ef700 1 --2- 172.21.15.174:0/2228030683 >> v2:172.21.15.196:3300/0 conn(0x7fc34c14b770 0x7fc34c14db60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc344001cb0 tx=0x7fc348010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:56.547 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.519+0000 7fc3514ef700 1 --2- 172.21.15.174:0/2228030683 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc34c14b770 0x7fc34c14db60 secure :-1 s=READY pgs=141 cs=0 l=1 rx=0x7fc344001cb0 tx=0x7fc348010050).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:56.548 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.519+0000 7fc3514ef700 1 --2- 172.21.15.174:0/2228030683 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc34c14b770 0x7fc34c14db60 secure :-1 s=THROTTLE_DONE pgs=141 cs=0 l=1 rx=0x7fc344001cb0 tx=0x7fc348010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:56.548 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.519+0000 7fc33affd700 1 -- 172.21.15.174:0/2228030683 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc34400eeb0 con 0x7fc34c14b770 2020-04-02T23:21:56.548 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.519+0000 7fc3514ef700 1 --2- 172.21.15.174:0/2228030683 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc34c14b770 0x7fc34c14db60 secure :-1 s=THROTTLE_DONE pgs=141 cs=0 l=1 rx=0x7fc344001cb0 tx=0x7fc348010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:56.548 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.519+0000 7fc33affd700 1 -- 172.21.15.174:0/2228030683 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc348010ba0 con 0x7fc34c14b770 2020-04-02T23:21:56.548 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.519+0000 7fc3514ef700 1 --2- 172.21.15.174:0/2228030683 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc34c14b770 0x7fc34c14db60 secure :-1 s=THROTTLE_DONE pgs=141 cs=0 l=1 rx=0x7fc344001cb0 tx=0x7fc348010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:56.548 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.519+0000 7fc353f54700 1 -- 172.21.15.174:0/2228030683 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc34c125bc0 con 0x7fc34c14b770 2020-04-02T23:21:56.548 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.519+0000 7fc33affd700 1 -- 172.21.15.174:0/2228030683 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc3480056c0 con 0x7fc34c14b770 2020-04-02T23:21:56.548 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.519+0000 7fc353f54700 1 -- 172.21.15.174:0/2228030683 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc34c133820 con 0x7fc34c14b770 2020-04-02T23:21:56.549 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.520+0000 7fc3514ef700 1 --2- 172.21.15.174:0/2228030683 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc34c14b770 0x7fc34c14db60 secure :-1 s=THROTTLE_DONE pgs=141 cs=0 l=1 rx=0x7fc344001cb0 tx=0x7fc348010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:56.549 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.520+0000 7fc353f54700 1 -- 172.21.15.174:0/2228030683 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc34c126020 con 0x7fc34c14b770 2020-04-02T23:21:56.549 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.520+0000 7fc33affd700 1 -- 172.21.15.174:0/2228030683 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fc3480058c0 con 0x7fc34c14b770 2020-04-02T23:21:56.549 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.520+0000 7fc3514ef700 1 --2- 172.21.15.174:0/2228030683 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc34c14b770 0x7fc34c14db60 secure :-1 s=THROTTLE_DONE pgs=141 cs=0 l=1 rx=0x7fc344001cb0 tx=0x7fc348010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:56.549 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.521+0000 7fc33affd700 1 --2- 172.21.15.174:0/2228030683 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fc32c04d9c0 0x7fc32c04fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:56.549 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.521+0000 7fc33affd700 1 -- 172.21.15.174:0/2228030683 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc348060710 con 0x7fc34c14b770 2020-04-02T23:21:56.549 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.521+0000 7fc351cf0700 1 --2- 172.21.15.174:0/2228030683 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fc32c04d9c0 0x7fc32c04fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:56.550 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.521+0000 7fc351cf0700 1 --2- 172.21.15.174:0/2228030683 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fc32c04d9c0 0x7fc32c04fe80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc33c003070 tx=0x7fc33c00c970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:56.550 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.521+0000 7fc351cf0700 1 --2- 172.21.15.174:0/2228030683 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fc32c04d9c0 0x7fc32c04fe80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc33c003070 tx=0x7fc33c00c970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:56.550 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.521+0000 7fc351cf0700 1 --2- 172.21.15.174:0/2228030683 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fc32c04d9c0 0x7fc32c04fe80 secure :-1 s=READY pgs=99 cs=0 l=1 rx=0x7fc33c003070 tx=0x7fc33c00c970).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:56.550 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.524+0000 7fc3514ef700 1 --2- 172.21.15.174:0/2228030683 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc34c14b770 0x7fc34c14db60 secure :-1 s=THROTTLE_DONE pgs=141 cs=0 l=1 rx=0x7fc344001cb0 tx=0x7fc348010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:56.551 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.524+0000 7fc33affd700 1 -- 172.21.15.174:0/2228030683 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fc34803beb0 con 0x7fc34c14b770 2020-04-02T23:21:56.665 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.663+0000 7fc353f54700 1 -- 172.21.15.174:0/2228030683 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc34c056c50 con 0x7fc34c14b770 2020-04-02T23:21:56.666 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.664+0000 7fc3514ef700 1 --2- 172.21.15.174:0/2228030683 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc34c14b770 0x7fc34c14db60 secure :-1 s=THROTTLE_DONE pgs=141 cs=0 l=1 rx=0x7fc344001cb0 tx=0x7fc348010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:56.667 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.664+0000 7fc33affd700 1 -- 172.21.15.174:0/2228030683 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+10 (secure 0 0 0) 0x7fc34803f4d0 con 0x7fc34c14b770 2020-04-02T23:21:56.667 INFO:teuthology.orchestra.run.smithi174.stdout:pg_num: 8 2020-04-02T23:21:56.669 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.665+0000 7fc353f54700 1 -- 172.21.15.174:0/2228030683 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fc32c04d9c0 msgr2=0x7fc32c04fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:56.669 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.665+0000 7fc353f54700 1 --2- 172.21.15.174:0/2228030683 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fc32c04d9c0 0x7fc32c04fe80 secure :-1 s=READY pgs=99 cs=0 l=1 rx=0x7fc33c003070 tx=0x7fc33c00c970).stop 2020-04-02T23:21:56.669 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.665+0000 7fc353f54700 1 -- 172.21.15.174:0/2228030683 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc34c14b770 msgr2=0x7fc34c14db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:56.669 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.665+0000 7fc353f54700 1 --2- 172.21.15.174:0/2228030683 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc34c14b770 0x7fc34c14db60 secure :-1 s=READY pgs=141 cs=0 l=1 rx=0x7fc344001cb0 tx=0x7fc348010050).stop 2020-04-02T23:21:56.669 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.665+0000 7fc353f54700 1 -- 172.21.15.174:0/2228030683 shutdown_connections 2020-04-02T23:21:56.669 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.665+0000 7fc353f54700 1 --2- 172.21.15.174:0/2228030683 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fc32c04d9c0 0x7fc32c04fe80 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:56.670 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.665+0000 7fc353f54700 1 --2- 172.21.15.174:0/2228030683 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc34c14b770 0x7fc34c14db60 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:56.670 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.665+0000 7fc353f54700 1 -- 172.21.15.174:0/2228030683 >> 172.21.15.174:0/2228030683 conn(0x7fc34c0aaf80 msgr2=0x7fc34c05ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:56.670 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.665+0000 7fc353f54700 1 -- 172.21.15.174:0/2228030683 shutdown_connections 2020-04-02T23:21:56.670 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.665+0000 7fc353f54700 1 -- 172.21.15.174:0/2228030683 wait complete. 2020-04-02T23:21:56.679 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-04-02T23:21:56.679 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:56.693 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-02T23:21:56.842 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.840+0000 7fe0524db700 1 Processor -- start 2020-04-02T23:21:56.842 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.840+0000 7fe0524db700 1 -- start start 2020-04-02T23:21:56.854 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.840+0000 7fe0524db700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fe04c05f600 0x7fe04c0601a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:56.854 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.840+0000 7fe0524db700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe04c060600 0x7fe04c05b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:21:56.854 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.840+0000 7fe0524db700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe04c132880 con 0x7fe04c05b4f0 2020-04-02T23:21:56.854 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.840+0000 7fe0524db700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe04c0a9460 con 0x7fe04c060600 2020-04-02T23:21:56.855 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.840+0000 7fe0524db700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe04c0a9700 con 0x7fe04c05f600 2020-04-02T23:21:56.855 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.841+0000 7fe050cd8700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe04c060600 0x7fe04c05b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:56.855 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.841+0000 7fe050cd8700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe04c060600 0x7fe04c05b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:40326/0 (socket says 172.21.15.174:40326) 2020-04-02T23:21:56.855 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.841+0000 7fe050cd8700 1 -- 172.21.15.174:0/3739737716 learned_addr learned my addr 172.21.15.174:0/3739737716 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:21:56.855 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.841+0000 7fe0514d9700 1 --2- 172.21.15.174:0/3739737716 >> v2:172.21.15.196:3300/0 conn(0x7fe04c05f600 0x7fe04c0601a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:56.855 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.841+0000 7fe050cd8700 1 -- 172.21.15.174:0/3739737716 >> v2:172.21.15.196:3300/0 conn(0x7fe04c05f600 msgr2=0x7fe04c0601a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:56.855 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.841+0000 7fe050cd8700 1 --2- 172.21.15.174:0/3739737716 >> v2:172.21.15.196:3300/0 conn(0x7fe04c05f600 0x7fe04c0601a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:56.856 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.841+0000 7fe050cd8700 1 -- 172.21.15.174:0/3739737716 >> v1:172.21.15.196:6789/0 conn(0x7fe04c05b4f0 legacy=0x7fe04c09d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:21:56.856 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.841+0000 7fe050cd8700 1 -- 172.21.15.174:0/3739737716 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe04c0a9230 con 0x7fe04c060600 2020-04-02T23:21:56.856 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.841+0000 7fe050cd8700 1 --2- 172.21.15.174:0/3739737716 >> v2:172.21.15.174:3300/0 conn(0x7fe04c060600 0x7fe04c05b090 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe04c0aa3b0 tx=0x7fe048007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:56.856 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.841+0000 7fe050cd8700 1 --2- 172.21.15.174:0/3739737716 >> v2:172.21.15.174:3300/0 conn(0x7fe04c060600 0x7fe04c05b090 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe04c0aa3b0 tx=0x7fe048007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:56.856 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.841+0000 7fe050cd8700 1 --2- 172.21.15.174:0/3739737716 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe04c060600 0x7fe04c05b090 secure :-1 s=READY pgs=189 cs=0 l=1 rx=0x7fe04c0aa3b0 tx=0x7fe048007a40).ready entity=mon.0 client_cookie=594b8a48f79ab64b server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:56.856 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.841+0000 7fe050cd8700 1 --2- 172.21.15.174:0/3739737716 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe04c060600 0x7fe04c05b090 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7fe04c0aa3b0 tx=0x7fe048007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:56.856 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.841+0000 7fe03ffff700 1 -- 172.21.15.174:0/3739737716 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0480116e0 con 0x7fe04c060600 2020-04-02T23:21:56.858 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.841+0000 7fe050cd8700 1 --2- 172.21.15.174:0/3739737716 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe04c060600 0x7fe04c05b090 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7fe04c0aa3b0 tx=0x7fe048007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:56.858 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.841+0000 7fe050cd8700 1 --2- 172.21.15.174:0/3739737716 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe04c060600 0x7fe04c05b090 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7fe04c0aa3b0 tx=0x7fe048007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:56.858 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.841+0000 7fe03ffff700 1 -- 172.21.15.174:0/3739737716 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe048011840 con 0x7fe04c060600 2020-04-02T23:21:56.858 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.841+0000 7fe03ffff700 1 -- 172.21.15.174:0/3739737716 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe048011c20 con 0x7fe04c060600 2020-04-02T23:21:56.859 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.841+0000 7fe0524db700 1 -- 172.21.15.174:0/3739737716 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe04c060600 msgr2=0x7fe04c05b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:56.859 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.841+0000 7fe0524db700 1 --2- 172.21.15.174:0/3739737716 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe04c060600 0x7fe04c05b090 secure :-1 s=READY pgs=189 cs=0 l=1 rx=0x7fe04c0aa3b0 tx=0x7fe048007a40).stop 2020-04-02T23:21:56.859 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.842+0000 7fe0524db700 1 -- 172.21.15.174:0/3739737716 shutdown_connections 2020-04-02T23:21:56.859 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.842+0000 7fe0524db700 1 --2- 172.21.15.174:0/3739737716 >> v2:172.21.15.196:3300/0 conn(0x7fe04c05f600 0x7fe04c0601a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:21:56.859 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.842+0000 7fe0524db700 1 --2- 172.21.15.174:0/3739737716 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe04c060600 0x7fe04c05b090 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:56.859 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.842+0000 7fe0524db700 1 -- 172.21.15.174:0/3739737716 >> 172.21.15.174:0/3739737716 conn(0x7fe04c0ae840 msgr2=0x7fe04c0aec20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:56.859 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.842+0000 7fe0524db700 1 -- 172.21.15.174:0/3739737716 shutdown_connections 2020-04-02T23:21:56.860 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.842+0000 7fe0524db700 1 -- 172.21.15.174:0/3739737716 wait complete. 2020-04-02T23:21:56.860 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.842+0000 7fe0524db700 1 Processor -- start 2020-04-02T23:21:56.860 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.843+0000 7fe0524db700 1 -- start start 2020-04-02T23:21:56.861 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.843+0000 7fe0524db700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fe04c05f600 0x7fe04c13ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:56.861 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.843+0000 7fe0524db700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe04c136390 con 0x7fe04c05b4f0 2020-04-02T23:21:56.861 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.843+0000 7fe0524db700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe04c137b40 con 0x7fe04c135ef0 2020-04-02T23:21:56.861 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.843+0000 7fe0524db700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe04c13b2e0 con 0x7fe04c05f600 2020-04-02T23:21:56.861 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.843+0000 7fe0514d9700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fe04c05b4f0 0x7fe04c12ba40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:45368/0 (socket says 172.21.15.174:45368) 2020-04-02T23:21:56.861 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.843+0000 7fe0514d9700 1 -- 172.21.15.174:0/573473586 learned_addr learned my addr 172.21.15.174:0/573473586 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:21:56.862 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.843+0000 7fe03e7fc700 1 -- 172.21.15.174:0/573473586 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 604987053 0 0) 0x7fe04c136390 con 0x7fe04c05b4f0 2020-04-02T23:21:56.862 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.843+0000 7fe03e7fc700 1 -- 172.21.15.174:0/573473586 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe02c002fe0 con 0x7fe04c05b4f0 2020-04-02T23:21:56.862 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.843+0000 7fe050cd8700 1 --2- 172.21.15.174:0/573473586 >> v2:172.21.15.196:3300/0 conn(0x7fe04c05f600 0x7fe04c13ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:56.862 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.844+0000 7fe03e7fc700 1 -- 172.21.15.174:0/573473586 <== mon.0 v1:172.21.15.174:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3558067059 0 0) 0x7fe02c002fe0 con 0x7fe04c05b4f0 2020-04-02T23:21:56.862 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.844+0000 7fe03e7fc700 1 -- 172.21.15.174:0/573473586 --> v1:172.21.15.174:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe04c136390 con 0x7fe04c05b4f0 2020-04-02T23:21:56.862 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.844+0000 7fe03e7fc700 1 -- 172.21.15.174:0/573473586 <== mon.0 v1:172.21.15.174:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2811762909 0 0) 0x7fe040002710 con 0x7fe04c05b4f0 2020-04-02T23:21:56.862 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.844+0000 7fe03e7fc700 1 -- 172.21.15.174:0/573473586 >> v2:172.21.15.196:3300/0 conn(0x7fe04c05f600 msgr2=0x7fe04c13ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:56.862 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.844+0000 7fe03e7fc700 1 --2- 172.21.15.174:0/573473586 >> v2:172.21.15.196:3300/0 conn(0x7fe04c05f600 0x7fe04c13ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:56.863 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.844+0000 7fe03e7fc700 1 -- 172.21.15.174:0/573473586 >> v1:172.21.15.196:6789/0 conn(0x7fe04c135ef0 legacy=0x7fe04c137fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:56.863 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.844+0000 7fe03e7fc700 1 -- 172.21.15.174:0/573473586 >> v1:172.21.15.174:6789/0 conn(0x7fe04c05b4f0 legacy=0x7fe04c12ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:56.863 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.844+0000 7fe03e7fc700 1 --2- 172.21.15.174:0/573473586 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe02c0049b0 0x7fe02c004d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:56.863 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.844+0000 7fe03e7fc700 1 --2- 172.21.15.174:0/573473586 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe02c003920 0x7fe02c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:56.863 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.844+0000 7fe03e7fc700 1 --2- 172.21.15.174:0/573473586 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe02c004200 0x7fe02c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:56.863 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.844+0000 7fe03e7fc700 1 -- 172.21.15.174:0/573473586 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe04c13b2e0 con 0x7fe02c0049b0 2020-04-02T23:21:56.863 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.844+0000 7fe03e7fc700 1 -- 172.21.15.174:0/573473586 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe02c004770 con 0x7fe02c003920 2020-04-02T23:21:56.864 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.844+0000 7fe03e7fc700 1 -- 172.21.15.174:0/573473586 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe02c00bbb0 con 0x7fe02c004200 2020-04-02T23:21:56.864 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.844+0000 7fe0514d9700 1 --2- 172.21.15.174:0/573473586 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe02c0049b0 0x7fe02c004d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:56.864 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.844+0000 7fe050cd8700 1 --2- 172.21.15.174:0/573473586 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe02c003920 0x7fe02c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:56.864 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.844+0000 7fe051cda700 1 --2- 172.21.15.174:0/573473586 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe02c004200 0x7fe02c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:56.864 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.844+0000 7fe0514d9700 1 -- 172.21.15.174:0/573473586 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe02c004200 msgr2=0x7fe02c00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:56.864 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.844+0000 7fe0514d9700 1 --2- 172.21.15.174:0/573473586 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe02c004200 0x7fe02c00b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:56.864 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.844+0000 7fe0514d9700 1 -- 172.21.15.174:0/573473586 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe02c003920 msgr2=0x7fe02c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:56.865 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.844+0000 7fe0514d9700 1 --2- 172.21.15.174:0/573473586 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe02c003920 0x7fe02c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:56.865 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.844+0000 7fe0514d9700 1 -- 172.21.15.174:0/573473586 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe04c12c150 con 0x7fe02c0049b0 2020-04-02T23:21:56.865 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.844+0000 7fe051cda700 1 -- 172.21.15.174:0/573473586 reap_dead start 2020-04-02T23:21:56.865 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.844+0000 7fe0524db700 1 -- 172.21.15.174:0/573473586 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe04c0adb30 con 0x7fe02c0049b0 2020-04-02T23:21:56.865 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.844+0000 7fe0514d9700 1 --2- 172.21.15.174:0/573473586 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe02c0049b0 0x7fe02c004d90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe0400024a0 tx=0x7fe04c06a960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:56.865 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.844+0000 7fe0514d9700 1 --2- 172.21.15.174:0/573473586 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe02c0049b0 0x7fe02c004d90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe0400024a0 tx=0x7fe04c06a960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:56.865 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.844+0000 7fe0514d9700 1 --2- 172.21.15.174:0/573473586 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe02c0049b0 0x7fe02c004d90 secure :-1 s=READY pgs=191 cs=0 l=1 rx=0x7fe0400024a0 tx=0x7fe04c06a960).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:56.865 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.844+0000 7fe0514d9700 1 --2- 172.21.15.174:0/573473586 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe02c0049b0 0x7fe02c004d90 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7fe0400024a0 tx=0x7fe04c06a960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:56.866 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.844+0000 7fe03e7fc700 1 -- 172.21.15.174:0/573473586 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe040011e00 con 0x7fe02c0049b0 2020-04-02T23:21:56.866 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.844+0000 7fe0514d9700 1 --2- 172.21.15.174:0/573473586 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe02c0049b0 0x7fe02c004d90 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7fe0400024a0 tx=0x7fe04c06a960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:56.866 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.844+0000 7fe0514d9700 1 --2- 172.21.15.174:0/573473586 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe02c0049b0 0x7fe02c004d90 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7fe0400024a0 tx=0x7fe04c06a960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:56.866 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.844+0000 7fe03e7fc700 1 -- 172.21.15.174:0/573473586 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe04000c9d0 con 0x7fe02c0049b0 2020-04-02T23:21:56.866 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.844+0000 7fe0524db700 1 -- 172.21.15.174:0/573473586 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe04c13ae80 con 0x7fe02c0049b0 2020-04-02T23:21:56.866 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.844+0000 7fe03e7fc700 1 -- 172.21.15.174:0/573473586 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe04000cdb0 con 0x7fe02c0049b0 2020-04-02T23:21:56.866 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.845+0000 7fe0514d9700 1 --2- 172.21.15.174:0/573473586 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe02c0049b0 0x7fe02c004d90 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7fe0400024a0 tx=0x7fe04c06a960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:56.867 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.845+0000 7fe0524db700 1 -- 172.21.15.174:0/573473586 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe04c13b130 con 0x7fe02c0049b0 2020-04-02T23:21:56.867 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.845+0000 7fe03e7fc700 1 -- 172.21.15.174:0/573473586 <== mon.0 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fe0400056c0 con 0x7fe02c0049b0 2020-04-02T23:21:56.867 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.846+0000 7fe0514d9700 1 --2- 172.21.15.174:0/573473586 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe02c0049b0 0x7fe02c004d90 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7fe0400024a0 tx=0x7fe04c06a960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:56.867 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.846+0000 7fe03e7fc700 1 --2- 172.21.15.174:0/573473586 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fe02c0514f0 0x7fe02c0539b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:21:56.867 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.846+0000 7fe03e7fc700 1 -- 172.21.15.174:0/573473586 <== mon.0 v2:172.21.15.174:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe040061170 con 0x7fe02c0049b0 2020-04-02T23:21:56.867 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.846+0000 7fe050cd8700 1 --2- 172.21.15.174:0/573473586 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fe02c0514f0 0x7fe02c0539b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:21:56.867 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.846+0000 7fe050cd8700 1 --2- 172.21.15.174:0/573473586 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fe02c0514f0 0x7fe02c0539b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe04c0aa3b0 tx=0x7fe048007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:56.868 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.846+0000 7fe050cd8700 1 --2- 172.21.15.174:0/573473586 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fe02c0514f0 0x7fe02c0539b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe04c0aa3b0 tx=0x7fe048007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:56.868 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.846+0000 7fe050cd8700 1 --2- 172.21.15.174:0/573473586 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fe02c0514f0 0x7fe02c0539b0 secure :-1 s=READY pgs=100 cs=0 l=1 rx=0x7fe04c0aa3b0 tx=0x7fe048007a40).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:21:56.868 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.849+0000 7fe0514d9700 1 --2- 172.21.15.174:0/573473586 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe02c0049b0 0x7fe02c004d90 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7fe0400024a0 tx=0x7fe04c06a960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:56.868 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:56.849+0000 7fe03e7fc700 1 -- 172.21.15.174:0/573473586 <== mon.0 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fe04003c910 con 0x7fe02c0049b0 2020-04-02T23:21:57.032 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:57.029+0000 7fe0524db700 1 -- 172.21.15.174:0/573473586 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe04c056c50 con 0x7fe02c0049b0 2020-04-02T23:21:57.032 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:57.030+0000 7fe0514d9700 1 --2- 172.21.15.174:0/573473586 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe02c0049b0 0x7fe02c004d90 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7fe0400024a0 tx=0x7fe04c06a960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:21:57.033 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:57.030+0000 7fe03e7fc700 1 -- 172.21.15.174:0/573473586 <== mon.0 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2140 (secure 0 0 0) 0x7fe04003ff30 con 0x7fe02c0049b0 2020-04-02T23:21:57.033 INFO:teuthology.orchestra.run.smithi174.stdout: 2020-04-02T23:21:57.033 INFO:teuthology.orchestra.run.smithi174.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4354,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.174:6833/2321559941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":2321559941},{"type":"v1","addr":"172.21.15.174:6833","nonce":2321559941}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":6}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-02T23:21:40.534377+0000","modified":"2020-04-02T23:21:45.125652+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4374},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4374":{"gid":4374,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.196:6835/4070765568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":4070765568},{"type":"v1","addr":"172.21.15.196:6835","nonce":4070765568}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-04-02T23:21:57.034 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:57.031+0000 7fe0524db700 1 -- 172.21.15.174:0/573473586 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fe02c0514f0 msgr2=0x7fe02c0539b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:57.034 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:57.031+0000 7fe0524db700 1 --2- 172.21.15.174:0/573473586 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fe02c0514f0 0x7fe02c0539b0 secure :-1 s=READY pgs=100 cs=0 l=1 rx=0x7fe04c0aa3b0 tx=0x7fe048007a40).stop 2020-04-02T23:21:57.034 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:57.031+0000 7fe0524db700 1 -- 172.21.15.174:0/573473586 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe02c0049b0 msgr2=0x7fe02c004d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:21:57.034 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:57.031+0000 7fe0524db700 1 --2- 172.21.15.174:0/573473586 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe02c0049b0 0x7fe02c004d90 secure :-1 s=READY pgs=191 cs=0 l=1 rx=0x7fe0400024a0 tx=0x7fe04c06a960).stop 2020-04-02T23:21:57.035 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:57.031+0000 7fe0524db700 1 -- 172.21.15.174:0/573473586 shutdown_connections 2020-04-02T23:21:57.035 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:57.031+0000 7fe0524db700 1 --2- 172.21.15.174:0/573473586 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fe02c0514f0 0x7fe02c0539b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:57.035 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:57.031+0000 7fe0524db700 1 --2- 172.21.15.174:0/573473586 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe02c0049b0 0x7fe02c004d90 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:21:57.035 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:57.031+0000 7fe0524db700 1 -- 172.21.15.174:0/573473586 >> 172.21.15.174:0/573473586 conn(0x7fe04c0ae840 msgr2=0x7fe04c12ed50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:21:57.035 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:57.031+0000 7fe0524db700 1 -- 172.21.15.174:0/573473586 shutdown_connections 2020-04-02T23:21:57.035 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:21:57.031+0000 7fe0524db700 1 -- 172.21.15.174:0/573473586 wait complete. 2020-04-02T23:21:57.036 INFO:teuthology.orchestra.run.smithi174.stderr:dumped fsmap epoch 6 2020-04-02T23:21:57.246 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 4374}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 3, u'failed': [], u'epoch': 5, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [4], u'info': {u'gid_4374': {u'export_targets': [], u'name': u'b', u'incarnation': 4, u'state_seq': 2, u'state': u'up:active', u'gid': 4374, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'join_fscid': -1, u'addrs': {u'addrvec': [{u'nonce': 4070765568, u'type': u'v2', u'addr': u'172.21.15.196:6834'}, {u'nonce': 4070765568, u'type': u'v1', u'addr': u'172.21.15.196:6835'}]}, u'addr': u'172.21.15.196:6835/4070765568'}}, u'fs_name': u'cephfs', u'created': u'2020-04-02T23:21:40.534377+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-04-02T23:21:45.125652+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-04-02T23:21:57.246 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-04-02T23:21:57.247 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:21:57.263 INFO:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok status 2020-04-02T23:21:57.431 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2020-04-02T23:21:57.432 INFO:teuthology.orchestra.run.smithi196.stdout: "cluster_fsid": "06504ece-4284-40ba-b298-58864abc4224", 2020-04-02T23:21:57.432 INFO:teuthology.orchestra.run.smithi196.stdout: "whoami": 0, 2020-04-02T23:21:57.432 INFO:teuthology.orchestra.run.smithi196.stdout: "id": 4374, 2020-04-02T23:21:57.432 INFO:teuthology.orchestra.run.smithi196.stdout: "want_state": "up:active", 2020-04-02T23:21:57.432 INFO:teuthology.orchestra.run.smithi196.stdout: "state": "up:active", 2020-04-02T23:21:57.432 INFO:teuthology.orchestra.run.smithi196.stdout: "rank_uptime": 13.312425825, 2020-04-02T23:21:57.432 INFO:teuthology.orchestra.run.smithi196.stdout: "mdsmap_epoch": 5, 2020-04-02T23:21:57.433 INFO:teuthology.orchestra.run.smithi196.stdout: "osdmap_epoch": 23, 2020-04-02T23:21:57.433 INFO:teuthology.orchestra.run.smithi196.stdout: "osdmap_epoch_barrier": 23, 2020-04-02T23:21:57.433 INFO:teuthology.orchestra.run.smithi196.stdout: "uptime": 14.036286223999999 2020-04-02T23:21:57.433 INFO:teuthology.orchestra.run.smithi196.stdout:} 2020-04-02T23:21:57.445 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "06504ece-4284-40ba-b298-58864abc4224", "whoami": 0, "id": 4374, "want_state": "up:active", "state": "up:active", "rank_uptime": 13.312425825, "mdsmap_epoch": 5, "osdmap_epoch": 23, "osdmap_epoch_barrier": 23, "uptime": 14.036286223999999 } 2020-04-02T23:21:57.446 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-04-02T23:21:57.446 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2020-04-02T23:21:57.446 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi174.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2020-04-02T23:21:57.446 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:57.460 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-02T23:21:57.460 INFO:teuthology.orchestra.run.smithi174:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.0) 2020-04-02T23:21:57.538 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:57.583 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-02T23:21:57.584 INFO:teuthology.orchestra.run.smithi174:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-02T23:21:57.651 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-02T23:21:57.659 INFO:teuthology.orchestra.run.smithi174.stderr:mount: /sys/fs/fuse/connections: mount point does not exist. 2020-04-02T23:21:57.660 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:57.705 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-02T23:21:57.706 INFO:teuthology.orchestra.run.smithi174:> ls /sys/fs/fuse/connections 2020-04-02T23:21:57.759 DEBUG:teuthology.orchestra.run:got remote process result: 2 2020-04-02T23:21:57.766 INFO:teuthology.orchestra.run.smithi174.stderr:ls: cannot access '/sys/fs/fuse/connections': No such file or directory 2020-04-02T23:21:57.766 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-04-02T23:21:57.766 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:57.817 INFO:teuthology.orchestra.run.smithi174:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2020-04-02T23:21:57.859 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:57.872 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-02T23:21:57.873 INFO:teuthology.orchestra.run.smithi174:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-02T23:21:57.933 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi174.stderr:2020-04-02T23:21:57.930+0000 7fdbb39401c0 -1 init, newargv = 0x55691284aca0 newargc=7 2020-04-02T23:21:57.933 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi174.stderr:ceph-fuse[28612]: starting ceph client 2020-04-02T23:21:57.940 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-02T23:21:57.947 INFO:teuthology.orchestra.run.smithi174.stderr:mount: /sys/fs/fuse/connections: mount point does not exist. 2020-04-02T23:21:57.947 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:57.981 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi174.stderr:ceph-fuse[28612]: starting fuse 2020-04-02T23:21:57.994 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-02T23:21:57.995 INFO:teuthology.orchestra.run.smithi174:> ls /sys/fs/fuse/connections 2020-04-02T23:21:59.158 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:59.175 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-02T23:21:59.175 INFO:teuthology.orchestra.run.smithi174:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-02T23:21:59.251 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:59.306 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-02T23:21:59.306 INFO:teuthology.orchestra.run.smithi174:> ls /sys/fs/fuse/connections 2020-04-02T23:21:59.365 INFO:teuthology.orchestra.run.smithi174.stdout:45 2020-04-02T23:21:59.366 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2020-04-02T23:21:59.366 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:59.418 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-02T23:21:59.418 INFO:teuthology.orchestra.run.smithi174:> sudo python3 -c ' 2020-04-02T23:21:59.418 INFO:teuthology.orchestra.run.smithi174:> import glob 2020-04-02T23:21:59.419 INFO:teuthology.orchestra.run.smithi174:> import re 2020-04-02T23:21:59.419 INFO:teuthology.orchestra.run.smithi174:> import os 2020-04-02T23:21:59.419 INFO:teuthology.orchestra.run.smithi174:> import subprocess 2020-04-02T23:21:59.419 INFO:teuthology.orchestra.run.smithi174:> 2020-04-02T23:21:59.419 INFO:teuthology.orchestra.run.smithi174:> def find_socket(client_name): 2020-04-02T23:21:59.419 INFO:teuthology.orchestra.run.smithi174:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2020-04-02T23:21:59.419 INFO:teuthology.orchestra.run.smithi174:> files = glob.glob(asok_path) 2020-04-02T23:21:59.420 INFO:teuthology.orchestra.run.smithi174:> 2020-04-02T23:21:59.420 INFO:teuthology.orchestra.run.smithi174:> # Given a non-glob path, it better be there 2020-04-02T23:21:59.420 INFO:teuthology.orchestra.run.smithi174:> if "*" not in asok_path: 2020-04-02T23:21:59.420 INFO:teuthology.orchestra.run.smithi174:> assert(len(files) == 1) 2020-04-02T23:21:59.420 INFO:teuthology.orchestra.run.smithi174:> return files[0] 2020-04-02T23:21:59.420 INFO:teuthology.orchestra.run.smithi174:> 2020-04-02T23:21:59.420 INFO:teuthology.orchestra.run.smithi174:> for f in files: 2020-04-02T23:21:59.420 INFO:teuthology.orchestra.run.smithi174:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-04-02T23:21:59.421 INFO:teuthology.orchestra.run.smithi174:> if os.path.exists("/proc/{0}".format(pid)): 2020-04-02T23:21:59.421 INFO:teuthology.orchestra.run.smithi174:> return f 2020-04-02T23:21:59.421 INFO:teuthology.orchestra.run.smithi174:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-04-02T23:21:59.421 INFO:teuthology.orchestra.run.smithi174:> 2020-04-02T23:21:59.421 INFO:teuthology.orchestra.run.smithi174:> print(find_socket("client.0")) 2020-04-02T23:21:59.421 INFO:teuthology.orchestra.run.smithi174:> ' 2020-04-02T23:21:59.535 INFO:teuthology.orchestra.run.smithi174.stdout:/var/run/ceph/ceph-client.0.28612.asok 2020-04-02T23:21:59.535 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.28612.asok 2020-04-02T23:21:59.536 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:59.551 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-02T23:21:59.551 INFO:teuthology.orchestra.run.smithi174:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.28612.asok status 2020-04-02T23:21:59.711 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2020-04-02T23:21:59.711 INFO:teuthology.orchestra.run.smithi174.stdout: "metadata": { 2020-04-02T23:21:59.711 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_sha1": "cbb84f71d70460f911296715ab61ac09c6962b17", 2020-04-02T23:21:59.711 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_version": "ceph version 16.0.0-316-gcbb84f7 (cbb84f71d70460f911296715ab61ac09c6962b17) octopus (rc)", 2020-04-02T23:21:59.712 INFO:teuthology.orchestra.run.smithi174.stdout: "entity_id": "0", 2020-04-02T23:21:59.712 INFO:teuthology.orchestra.run.smithi174.stdout: "hostname": "smithi174", 2020-04-02T23:21:59.712 INFO:teuthology.orchestra.run.smithi174.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-04-02T23:21:59.712 INFO:teuthology.orchestra.run.smithi174.stdout: "pid": "28612", 2020-04-02T23:21:59.712 INFO:teuthology.orchestra.run.smithi174.stdout: "root": "/" 2020-04-02T23:21:59.712 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2020-04-02T23:21:59.712 INFO:teuthology.orchestra.run.smithi174.stdout: "dentry_count": 0, 2020-04-02T23:21:59.713 INFO:teuthology.orchestra.run.smithi174.stdout: "dentry_pinned_count": 0, 2020-04-02T23:21:59.713 INFO:teuthology.orchestra.run.smithi174.stdout: "id": 4397, 2020-04-02T23:21:59.713 INFO:teuthology.orchestra.run.smithi174.stdout: "inst": { 2020-04-02T23:21:59.713 INFO:teuthology.orchestra.run.smithi174.stdout: "name": { 2020-04-02T23:21:59.713 INFO:teuthology.orchestra.run.smithi174.stdout: "type": "client", 2020-04-02T23:21:59.713 INFO:teuthology.orchestra.run.smithi174.stdout: "num": 4397 2020-04-02T23:21:59.713 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2020-04-02T23:21:59.714 INFO:teuthology.orchestra.run.smithi174.stdout: "addr": { 2020-04-02T23:21:59.714 INFO:teuthology.orchestra.run.smithi174.stdout: "type": "v1", 2020-04-02T23:21:59.714 INFO:teuthology.orchestra.run.smithi174.stdout: "addr": "172.21.15.174:0", 2020-04-02T23:21:59.714 INFO:teuthology.orchestra.run.smithi174.stdout: "nonce": 1285485410 2020-04-02T23:21:59.714 INFO:teuthology.orchestra.run.smithi174.stdout: } 2020-04-02T23:21:59.714 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2020-04-02T23:21:59.714 INFO:teuthology.orchestra.run.smithi174.stdout: "addr": { 2020-04-02T23:21:59.714 INFO:teuthology.orchestra.run.smithi174.stdout: "type": "v1", 2020-04-02T23:21:59.715 INFO:teuthology.orchestra.run.smithi174.stdout: "addr": "172.21.15.174:0", 2020-04-02T23:21:59.715 INFO:teuthology.orchestra.run.smithi174.stdout: "nonce": 1285485410 2020-04-02T23:21:59.715 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2020-04-02T23:21:59.715 INFO:teuthology.orchestra.run.smithi174.stdout: "inst_str": "client.4397 172.21.15.174:0/1285485410", 2020-04-02T23:21:59.715 INFO:teuthology.orchestra.run.smithi174.stdout: "addr_str": "172.21.15.174:0/1285485410", 2020-04-02T23:21:59.715 INFO:teuthology.orchestra.run.smithi174.stdout: "inode_count": 1, 2020-04-02T23:21:59.715 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_epoch": 5, 2020-04-02T23:21:59.716 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_epoch": 23, 2020-04-02T23:21:59.716 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_epoch_barrier": 0, 2020-04-02T23:21:59.716 INFO:teuthology.orchestra.run.smithi174.stdout: "blacklisted": false 2020-04-02T23:21:59.716 INFO:teuthology.orchestra.run.smithi174.stdout:} 2020-04-02T23:21:59.716 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:59.731 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-02T23:21:59.731 INFO:teuthology.orchestra.run.smithi174:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-04-02T23:21:59.731 INFO:teuthology.orchestra.run.smithi174:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-04-02T23:21:59.791 INFO:teuthology.orchestra.run.smithi174.stdout:fuseblk 2020-04-02T23:21:59.791 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-04-02T23:21:59.792 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:59.841 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-02T23:21:59.841 INFO:teuthology.orchestra.run.smithi174:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2020-04-02T23:21:59.926 INFO:teuthology.run_tasks:Running task workunit... 2020-04-02T23:21:59.950 INFO:tasks.workunit:Pulling workunits from ref cbb84f71d70460f911296715ab61ac09c6962b17 2020-04-02T23:21:59.951 INFO:tasks.workunit:Making a separate scratch dir for every client... 2020-04-02T23:21:59.951 INFO:tasks.workunit:timeout=3h 2020-04-02T23:21:59.951 INFO:tasks.workunit:cleanup=True 2020-04-02T23:21:59.951 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:21:59.969 INFO:teuthology.orchestra.run.smithi174:> stat -- /home/ubuntu/cephtest/mnt.0 2020-04-02T23:22:00.026 INFO:teuthology.orchestra.run.smithi174.stdout: File: /home/ubuntu/cephtest/mnt.0 2020-04-02T23:22:00.026 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2020-04-02T23:22:00.026 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 2dh/45d Inode: 1 Links: 2 2020-04-02T23:22:00.027 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2020-04-02T23:22:00.027 INFO:teuthology.orchestra.run.smithi174.stdout:Context: system_u:object_r:fusefs_t:s0 2020-04-02T23:22:00.027 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2020-04-02T23:22:00.027 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2020-04-02 23:21:44.118419564 +0000 2020-04-02T23:22:00.027 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2020-04-02 23:21:59.906090983 +0000 2020-04-02T23:22:00.027 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: - 2020-04-02T23:22:00.027 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2020-04-02T23:22:00.028 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:22:00.080 INFO:teuthology.orchestra.run.smithi174:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2020-04-02T23:22:00.155 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:22:00.209 INFO:teuthology.orchestra.run.smithi174:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout cbb84f71d70460f911296715ab61ac09c6962b17 2020-04-02T23:22:00.335 INFO:tasks.workunit.client.0.smithi174.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2020-04-02T23:22:23.982 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:22:23.997 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:22:24.039 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:22:24.056 INFO:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:22:35.576 INFO:tasks.workunit.client.0.smithi174.stderr:Note: checking out 'cbb84f71d70460f911296715ab61ac09c6962b17'. 2020-04-02T23:22:35.576 INFO:tasks.workunit.client.0.smithi174.stderr: 2020-04-02T23:22:35.576 INFO:tasks.workunit.client.0.smithi174.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2020-04-02T23:22:35.577 INFO:tasks.workunit.client.0.smithi174.stderr:changes and commit them, and you can discard any commits you make in this 2020-04-02T23:22:35.577 INFO:tasks.workunit.client.0.smithi174.stderr:state without impacting any branches by performing another checkout. 2020-04-02T23:22:35.577 INFO:tasks.workunit.client.0.smithi174.stderr: 2020-04-02T23:22:35.577 INFO:tasks.workunit.client.0.smithi174.stderr:If you want to create a new branch to retain commits you create, you may 2020-04-02T23:22:35.577 INFO:tasks.workunit.client.0.smithi174.stderr:do so (now or later) by using -b with the checkout command again. Example: 2020-04-02T23:22:35.577 INFO:tasks.workunit.client.0.smithi174.stderr: 2020-04-02T23:22:35.578 INFO:tasks.workunit.client.0.smithi174.stderr: git checkout -b 2020-04-02T23:22:35.578 INFO:tasks.workunit.client.0.smithi174.stderr: 2020-04-02T23:22:35.578 INFO:tasks.workunit.client.0.smithi174.stderr:HEAD is now at cbb84f71d7 Merge branch 'fs-qa-vstart_runner.LocalRemote.sh' of https://github.com/rishabh-d-dave/ceph into wip-greg-testing-42 2020-04-02T23:22:35.581 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:22:35.594 INFO:teuthology.orchestra.run.smithi174:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2020-04-02T23:22:35.655 INFO:tasks.workunit.client.0.smithi174.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2020-04-02T23:22:35.657 INFO:tasks.workunit.client.0.smithi174.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2020-04-02T23:22:35.657 INFO:tasks.workunit.client.0.smithi174.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2020-04-02T23:22:36.307 INFO:tasks.workunit.client.0.smithi174.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2020-04-02T23:22:36.373 INFO:tasks.workunit.client.0.smithi174.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2020-04-02T23:22:36.406 INFO:tasks.workunit.client.0.smithi174.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2020-04-02T23:22:36.408 INFO:tasks.workunit.client.0.smithi174.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2020-04-02T23:22:36.408 INFO:tasks.workunit.client.0.smithi174.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2020-04-02T23:22:36.444 INFO:tasks.workunit.client.0.smithi174.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2020-04-02T23:22:36.504 DEBUG:teuthology.orchestra.remote:smithi174:/home/ubuntu/cephtest/workunits.list.client.0 is 4KB 2020-04-02T23:22:36.552 INFO:tasks.workunit:Running workunits matching suites/dbench.sh on client.0... 2020-04-02T23:22:36.552 INFO:tasks.workunit:Running workunit suites/dbench.sh... 2020-04-02T23:22:36.552 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:22:36.565 INFO:teuthology.orchestra.run.smithi174:workunit test suites/dbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=cbb84f71d70460f911296715ab61ac09c6962b17 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh 2020-04-02T23:22:36.638 INFO:tasks.workunit.client.0.smithi174.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2020-04-02T23:22:36.638 INFO:tasks.workunit.client.0.smithi174.stdout: 2020-04-02T23:22:36.638 INFO:tasks.workunit.client.0.smithi174.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2020-04-02T23:22:36.647 INFO:tasks.workunit.client.0.smithi174.stdout:0 of 1 processes prepared for launch 0 sec 2020-04-02T23:22:36.748 INFO:tasks.workunit.client.0.smithi174.stdout:1 of 1 processes prepared for launch 0 sec 2020-04-02T23:22:36.748 INFO:tasks.workunit.client.0.smithi174.stdout:releasing clients 2020-04-02T23:22:37.748 INFO:tasks.workunit.client.0.smithi174.stdout: 1 1082 22.93 MB/sec warmup 1 sec latency 7.833 ms 2020-04-02T23:22:38.748 INFO:tasks.workunit.client.0.smithi174.stdout: 1 2556 14.45 MB/sec warmup 2 sec latency 7.849 ms 2020-04-02T23:22:39.748 INFO:tasks.workunit.client.0.smithi174.stdout: 1 3942 13.36 MB/sec warmup 3 sec latency 7.947 ms 2020-04-02T23:22:40.748 INFO:tasks.workunit.client.0.smithi174.stdout: 1 5065 11.29 MB/sec warmup 4 sec latency 6.893 ms 2020-04-02T23:22:41.748 INFO:tasks.workunit.client.0.smithi174.stdout: 1 6567 10.53 MB/sec warmup 5 sec latency 8.817 ms 2020-04-02T23:22:42.748 INFO:tasks.workunit.client.0.smithi174.stdout: 1 7654 9.87 MB/sec warmup 6 sec latency 8.840 ms 2020-04-02T23:22:43.748 INFO:tasks.workunit.client.0.smithi174.stdout: 1 8913 9.22 MB/sec warmup 7 sec latency 10.288 ms 2020-04-02T23:22:44.748 INFO:tasks.workunit.client.0.smithi174.stdout: 1 10471 9.21 MB/sec warmup 8 sec latency 8.237 ms 2020-04-02T23:22:45.748 INFO:tasks.workunit.client.0.smithi174.stdout: 1 11398 8.74 MB/sec warmup 9 sec latency 8.964 ms 2020-04-02T23:22:46.750 INFO:tasks.workunit.client.0.smithi174.stdout: 1 12811 8.41 MB/sec warmup 10 sec latency 15.970 ms 2020-04-02T23:22:47.748 INFO:tasks.workunit.client.0.smithi174.stdout: 1 14333 8.74 MB/sec warmup 11 sec latency 8.664 ms 2020-04-02T23:22:48.748 INFO:tasks.workunit.client.0.smithi174.stdout: 1 15188 8.20 MB/sec warmup 12 sec latency 10.094 ms 2020-04-02T23:22:49.748 INFO:tasks.workunit.client.0.smithi174.stdout: 1 16630 8.05 MB/sec warmup 13 sec latency 7.846 ms 2020-04-02T23:22:50.748 INFO:tasks.workunit.client.0.smithi174.stdout: 1 18034 8.30 MB/sec warmup 14 sec latency 7.901 ms 2020-04-02T23:22:51.748 INFO:tasks.workunit.client.0.smithi174.stdout: 1 18961 7.91 MB/sec warmup 15 sec latency 9.243 ms 2020-04-02T23:22:52.748 INFO:tasks.workunit.client.0.smithi174.stdout: 1 20392 7.79 MB/sec warmup 16 sec latency 7.953 ms 2020-04-02T23:22:53.748 INFO:tasks.workunit.client.0.smithi174.stdout: 1 21729 7.98 MB/sec warmup 17 sec latency 10.160 ms 2020-04-02T23:22:54.161 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:22:54.175 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:22:54.218 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:22:54.232 INFO:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:22:54.748 INFO:tasks.workunit.client.0.smithi174.stdout: 1 22830 7.82 MB/sec warmup 18 sec latency 13.024 ms 2020-04-02T23:22:55.748 INFO:tasks.workunit.client.0.smithi174.stdout: 1 24312 7.81 MB/sec warmup 19 sec latency 16.992 ms 2020-04-02T23:22:56.748 INFO:tasks.workunit.client.0.smithi174.stdout: 1 25406 7.74 MB/sec warmup 20 sec latency 8.980 ms 2020-04-02T23:22:57.748 INFO:tasks.workunit.client.0.smithi174.stdout: 1 26617 7.63 MB/sec warmup 21 sec latency 8.722 ms 2020-04-02T23:22:58.748 INFO:tasks.workunit.client.0.smithi174.stdout: 1 28182 7.69 MB/sec warmup 22 sec latency 8.667 ms 2020-04-02T23:22:59.748 INFO:tasks.workunit.client.0.smithi174.stdout: 1 29083 7.57 MB/sec warmup 23 sec latency 11.968 ms 2020-04-02T23:23:00.748 INFO:tasks.workunit.client.0.smithi174.stdout: 1 30402 7.48 MB/sec warmup 24 sec latency 9.684 ms 2020-04-02T23:23:01.748 INFO:tasks.workunit.client.0.smithi174.stdout: 1 31989 7.66 MB/sec warmup 25 sec latency 11.706 ms 2020-04-02T23:23:02.748 INFO:tasks.workunit.client.0.smithi174.stdout: 1 32791 7.45 MB/sec warmup 26 sec latency 9.366 ms 2020-04-02T23:23:03.749 INFO:tasks.workunit.client.0.smithi174.stdout: 1 34189 7.37 MB/sec warmup 27 sec latency 8.115 ms 2020-04-02T23:23:04.748 INFO:tasks.workunit.client.0.smithi174.stdout: 1 35621 7.53 MB/sec warmup 28 sec latency 62.243 ms 2020-04-02T23:23:05.748 INFO:tasks.workunit.client.0.smithi174.stdout: 1 36429 7.35 MB/sec warmup 29 sec latency 10.912 ms 2020-04-02T23:23:06.749 INFO:tasks.workunit.client.0.smithi174.stdout: 1 37862 7.31 MB/sec warmup 30 sec latency 8.942 ms 2020-04-02T23:23:07.749 INFO:tasks.workunit.client.0.smithi174.stdout: 1 39275 7.45 MB/sec warmup 31 sec latency 13.282 ms 2020-04-02T23:23:08.749 INFO:tasks.workunit.client.0.smithi174.stdout: 1 40124 7.29 MB/sec warmup 32 sec latency 9.706 ms 2020-04-02T23:23:09.749 INFO:tasks.workunit.client.0.smithi174.stdout: 1 41522 7.24 MB/sec warmup 33 sec latency 8.356 ms 2020-04-02T23:23:10.749 INFO:tasks.workunit.client.0.smithi174.stdout: 1 42932 7.36 MB/sec warmup 34 sec latency 11.240 ms 2020-04-02T23:23:11.749 INFO:tasks.workunit.client.0.smithi174.stdout: 1 44003 7.30 MB/sec warmup 35 sec latency 8.376 ms 2020-04-02T23:23:12.749 INFO:tasks.workunit.client.0.smithi174.stdout: 1 45512 7.30 MB/sec warmup 36 sec latency 10.290 ms 2020-04-02T23:23:13.749 INFO:tasks.workunit.client.0.smithi174.stdout: 1 46616 7.29 MB/sec warmup 37 sec latency 6.556 ms 2020-04-02T23:23:14.749 INFO:tasks.workunit.client.0.smithi174.stdout: 1 47845 7.23 MB/sec warmup 38 sec latency 8.120 ms 2020-04-02T23:23:15.749 INFO:tasks.workunit.client.0.smithi174.stdout: 1 49467 7.28 MB/sec warmup 39 sec latency 8.373 ms 2020-04-02T23:23:16.749 INFO:tasks.workunit.client.0.smithi174.stdout: 1 50352 7.22 MB/sec warmup 40 sec latency 9.755 ms 2020-04-02T23:23:17.749 INFO:tasks.workunit.client.0.smithi174.stdout: 1 51701 7.18 MB/sec warmup 41 sec latency 9.128 ms 2020-04-02T23:23:18.749 INFO:tasks.workunit.client.0.smithi174.stdout: 1 53306 7.29 MB/sec warmup 42 sec latency 8.371 ms 2020-04-02T23:23:19.749 INFO:tasks.workunit.client.0.smithi174.stdout: 1 54117 7.17 MB/sec warmup 43 sec latency 21.932 ms 2020-04-02T23:23:20.749 INFO:tasks.workunit.client.0.smithi174.stdout: 1 55585 7.15 MB/sec warmup 44 sec latency 8.265 ms 2020-04-02T23:23:21.749 INFO:tasks.workunit.client.0.smithi174.stdout: 1 57005 7.26 MB/sec warmup 45 sec latency 14.398 ms 2020-04-02T23:23:22.749 INFO:tasks.workunit.client.0.smithi174.stdout: 1 57922 7.15 MB/sec warmup 46 sec latency 9.492 ms 2020-04-02T23:23:23.749 INFO:tasks.workunit.client.0.smithi174.stdout: 1 59350 7.13 MB/sec warmup 47 sec latency 7.812 ms 2020-04-02T23:23:24.339 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:23:24.353 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:23:24.395 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:23:24.409 INFO:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:23:24.749 INFO:tasks.workunit.client.0.smithi174.stdout: 1 60682 7.21 MB/sec warmup 48 sec latency 10.320 ms 2020-04-02T23:23:25.749 INFO:tasks.workunit.client.0.smithi174.stdout: 1 61732 7.17 MB/sec warmup 49 sec latency 8.218 ms 2020-04-02T23:23:26.749 INFO:tasks.workunit.client.0.smithi174.stdout: 1 63224 7.16 MB/sec warmup 50 sec latency 13.707 ms 2020-04-02T23:23:27.749 INFO:tasks.workunit.client.0.smithi174.stdout: 1 64326 7.16 MB/sec warmup 51 sec latency 9.462 ms 2020-04-02T23:23:28.749 INFO:tasks.workunit.client.0.smithi174.stdout: 1 65492 7.12 MB/sec warmup 52 sec latency 10.432 ms 2020-04-02T23:23:29.749 INFO:tasks.workunit.client.0.smithi174.stdout: 1 67077 7.14 MB/sec warmup 53 sec latency 9.226 ms 2020-04-02T23:23:30.749 INFO:tasks.workunit.client.0.smithi174.stdout: 1 68021 7.12 MB/sec warmup 54 sec latency 10.520 ms 2020-04-02T23:23:31.749 INFO:tasks.workunit.client.0.smithi174.stdout: 1 69376 7.09 MB/sec warmup 55 sec latency 10.854 ms 2020-04-02T23:23:32.749 INFO:tasks.workunit.client.0.smithi174.stdout: 1 70975 7.17 MB/sec warmup 56 sec latency 8.736 ms 2020-04-02T23:23:33.749 INFO:tasks.workunit.client.0.smithi174.stdout: 1 71829 7.09 MB/sec warmup 57 sec latency 8.519 ms 2020-04-02T23:23:34.749 INFO:tasks.workunit.client.0.smithi174.stdout: 1 73287 7.07 MB/sec warmup 58 sec latency 8.784 ms 2020-04-02T23:23:35.749 INFO:tasks.workunit.client.0.smithi174.stdout: 1 74752 7.16 MB/sec warmup 59 sec latency 8.599 ms 2020-04-02T23:23:36.749 INFO:tasks.workunit.client.0.smithi174.stdout: 1 75638 7.08 MB/sec warmup 60 sec latency 9.776 ms 2020-04-02T23:23:37.749 INFO:tasks.workunit.client.0.smithi174.stdout: 1 77034 7.06 MB/sec warmup 61 sec latency 8.172 ms 2020-04-02T23:23:38.749 INFO:tasks.workunit.client.0.smithi174.stdout: 1 78414 7.12 MB/sec warmup 62 sec latency 8.521 ms 2020-04-02T23:23:39.753 INFO:tasks.workunit.client.0.smithi174.stdout: 1 79289 7.04 MB/sec warmup 63 sec latency 41.319 ms 2020-04-02T23:23:40.750 INFO:tasks.workunit.client.0.smithi174.stdout: 1 80694 7.03 MB/sec warmup 64 sec latency 9.186 ms 2020-04-02T23:23:41.749 INFO:tasks.workunit.client.0.smithi174.stdout: 1 82026 7.09 MB/sec warmup 65 sec latency 8.220 ms 2020-04-02T23:23:42.750 INFO:tasks.workunit.client.0.smithi174.stdout: 1 83128 7.06 MB/sec warmup 66 sec latency 21.395 ms 2020-04-02T23:23:43.750 INFO:tasks.workunit.client.0.smithi174.stdout: 1 84574 7.07 MB/sec warmup 67 sec latency 56.486 ms 2020-04-02T23:23:44.750 INFO:tasks.workunit.client.0.smithi174.stdout: 1 85660 7.06 MB/sec warmup 68 sec latency 6.802 ms 2020-04-02T23:23:45.750 INFO:tasks.workunit.client.0.smithi174.stdout: 1 86880 7.03 MB/sec warmup 69 sec latency 14.294 ms 2020-04-02T23:23:46.750 INFO:tasks.workunit.client.0.smithi174.stdout: 1 88489 7.06 MB/sec warmup 70 sec latency 9.765 ms 2020-04-02T23:23:47.750 INFO:tasks.workunit.client.0.smithi174.stdout: 1 89394 7.03 MB/sec warmup 71 sec latency 9.702 ms 2020-04-02T23:23:48.750 INFO:tasks.workunit.client.0.smithi174.stdout: 1 90780 7.01 MB/sec warmup 72 sec latency 8.803 ms 2020-04-02T23:23:49.750 INFO:tasks.workunit.client.0.smithi174.stdout: 1 92333 7.08 MB/sec warmup 73 sec latency 9.684 ms 2020-04-02T23:23:50.750 INFO:tasks.workunit.client.0.smithi174.stdout: 1 93179 7.01 MB/sec warmup 74 sec latency 10.984 ms 2020-04-02T23:23:51.750 INFO:tasks.workunit.client.0.smithi174.stdout: 1 94625 7.00 MB/sec warmup 75 sec latency 9.912 ms 2020-04-02T23:23:52.750 INFO:tasks.workunit.client.0.smithi174.stdout: 1 96039 7.07 MB/sec warmup 76 sec latency 14.523 ms 2020-04-02T23:23:53.751 INFO:tasks.workunit.client.0.smithi174.stdout: 1 96909 7.00 MB/sec warmup 77 sec latency 7.840 ms 2020-04-02T23:23:54.510 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:23:54.536 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:23:54.589 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:23:54.614 INFO:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:23:54.750 INFO:tasks.workunit.client.0.smithi174.stdout: 1 98307 6.99 MB/sec warmup 78 sec latency 10.145 ms 2020-04-02T23:23:55.752 INFO:tasks.workunit.client.0.smithi174.stdout: 1 99676 7.04 MB/sec warmup 79 sec latency 11.432 ms 2020-04-02T23:23:56.750 INFO:tasks.workunit.client.0.smithi174.stdout: 1 100619 6.98 MB/sec warmup 80 sec latency 9.751 ms 2020-04-02T23:23:57.750 INFO:tasks.workunit.client.0.smithi174.stdout: 1 102126 7.01 MB/sec warmup 81 sec latency 8.667 ms 2020-04-02T23:23:58.750 INFO:tasks.workunit.client.0.smithi174.stdout: 1 103314 7.02 MB/sec warmup 82 sec latency 10.829 ms 2020-04-02T23:23:59.752 INFO:tasks.workunit.client.0.smithi174.stdout: 1 104416 7.00 MB/sec warmup 83 sec latency 9.833 ms 2020-04-02T23:24:00.750 INFO:tasks.workunit.client.0.smithi174.stdout: 1 105882 7.00 MB/sec warmup 84 sec latency 10.867 ms 2020-04-02T23:24:01.750 INFO:tasks.workunit.client.0.smithi174.stdout: 1 106923 7.00 MB/sec warmup 85 sec latency 8.910 ms 2020-04-02T23:24:02.750 INFO:tasks.workunit.client.0.smithi174.stdout: 1 108073 6.98 MB/sec warmup 86 sec latency 8.151 ms 2020-04-02T23:24:03.750 INFO:tasks.workunit.client.0.smithi174.stdout: 1 109475 6.98 MB/sec warmup 87 sec latency 8.937 ms 2020-04-02T23:24:04.750 INFO:tasks.workunit.client.0.smithi174.stdout: 1 110550 6.98 MB/sec warmup 88 sec latency 26.052 ms 2020-04-02T23:24:05.750 INFO:tasks.workunit.client.0.smithi174.stdout: 1 111795 6.96 MB/sec warmup 89 sec latency 14.318 ms 2020-04-02T23:24:06.750 INFO:tasks.workunit.client.0.smithi174.stdout: 1 113367 6.98 MB/sec warmup 90 sec latency 7.813 ms 2020-04-02T23:24:07.750 INFO:tasks.workunit.client.0.smithi174.stdout: 1 114276 6.96 MB/sec warmup 91 sec latency 8.457 ms 2020-04-02T23:24:08.752 INFO:tasks.workunit.client.0.smithi174.stdout: 1 115685 6.94 MB/sec warmup 92 sec latency 11.048 ms 2020-04-02T23:24:09.750 INFO:tasks.workunit.client.0.smithi174.stdout: 1 117208 7.00 MB/sec warmup 93 sec latency 9.260 ms 2020-04-02T23:24:10.750 INFO:tasks.workunit.client.0.smithi174.stdout: 1 118068 6.95 MB/sec warmup 94 sec latency 9.715 ms 2020-04-02T23:24:11.750 INFO:tasks.workunit.client.0.smithi174.stdout: 1 119504 6.94 MB/sec warmup 95 sec latency 9.184 ms 2020-04-02T23:24:12.750 INFO:tasks.workunit.client.0.smithi174.stdout: 1 120897 6.99 MB/sec warmup 96 sec latency 8.465 ms 2020-04-02T23:24:13.750 INFO:tasks.workunit.client.0.smithi174.stdout: 1 121812 6.94 MB/sec warmup 97 sec latency 9.123 ms 2020-04-02T23:24:14.750 INFO:tasks.workunit.client.0.smithi174.stdout: 1 123123 6.93 MB/sec warmup 98 sec latency 36.328 ms 2020-04-02T23:24:15.750 INFO:tasks.workunit.client.0.smithi174.stdout: 1 124481 6.97 MB/sec warmup 99 sec latency 10.978 ms 2020-04-02T23:24:16.750 INFO:tasks.workunit.client.0.smithi174.stdout: 1 125404 6.92 MB/sec warmup 100 sec latency 9.146 ms 2020-04-02T23:24:17.751 INFO:tasks.workunit.client.0.smithi174.stdout: 1 126782 6.91 MB/sec warmup 101 sec latency 9.273 ms 2020-04-02T23:24:18.750 INFO:tasks.workunit.client.0.smithi174.stdout: 1 128103 6.96 MB/sec warmup 102 sec latency 9.135 ms 2020-04-02T23:24:19.750 INFO:tasks.workunit.client.0.smithi174.stdout: 1 129137 6.94 MB/sec warmup 103 sec latency 9.252 ms 2020-04-02T23:24:20.751 INFO:tasks.workunit.client.0.smithi174.stdout: 1 130606 6.93 MB/sec warmup 104 sec latency 9.132 ms 2020-04-02T23:24:21.751 INFO:tasks.workunit.client.0.smithi174.stdout: 1 131692 6.94 MB/sec warmup 105 sec latency 10.354 ms 2020-04-02T23:24:22.751 INFO:tasks.workunit.client.0.smithi174.stdout: 1 132782 6.92 MB/sec warmup 106 sec latency 12.575 ms 2020-04-02T23:24:23.751 INFO:tasks.workunit.client.0.smithi174.stdout: 1 134202 6.93 MB/sec warmup 107 sec latency 9.953 ms 2020-04-02T23:24:24.723 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:24:24.736 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:24:24.751 INFO:tasks.workunit.client.0.smithi174.stdout: 1 135277 6.92 MB/sec warmup 108 sec latency 8.791 ms 2020-04-02T23:24:24.752 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:24:24.766 INFO:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:24:25.751 INFO:tasks.workunit.client.0.smithi174.stdout: 1 136379 6.91 MB/sec warmup 109 sec latency 11.128 ms 2020-04-02T23:24:26.751 INFO:tasks.workunit.client.0.smithi174.stdout: 1 137841 6.91 MB/sec warmup 110 sec latency 7.660 ms 2020-04-02T23:24:27.751 INFO:tasks.workunit.client.0.smithi174.stdout: 1 138916 6.91 MB/sec warmup 111 sec latency 9.240 ms 2020-04-02T23:24:28.751 INFO:tasks.workunit.client.0.smithi174.stdout: 1 140142 6.89 MB/sec warmup 112 sec latency 13.965 ms 2020-04-02T23:24:29.753 INFO:tasks.workunit.client.0.smithi174.stdout: 1 141696 6.91 MB/sec warmup 113 sec latency 7.110 ms 2020-04-02T23:24:30.751 INFO:tasks.workunit.client.0.smithi174.stdout: 1 142537 6.89 MB/sec warmup 114 sec latency 7.693 ms 2020-04-02T23:24:31.751 INFO:tasks.workunit.client.0.smithi174.stdout: 1 143868 6.88 MB/sec warmup 115 sec latency 11.054 ms 2020-04-02T23:24:32.751 INFO:tasks.workunit.client.0.smithi174.stdout: 1 145435 6.93 MB/sec warmup 116 sec latency 9.110 ms 2020-04-02T23:24:33.751 INFO:tasks.workunit.client.0.smithi174.stdout: 1 146260 6.88 MB/sec warmup 117 sec latency 8.718 ms 2020-04-02T23:24:34.751 INFO:tasks.workunit.client.0.smithi174.stdout: 1 147648 6.87 MB/sec warmup 118 sec latency 7.723 ms 2020-04-02T23:24:35.751 INFO:tasks.workunit.client.0.smithi174.stdout: 1 149110 6.91 MB/sec warmup 119 sec latency 11.620 ms 2020-04-02T23:24:37.751 INFO:tasks.workunit.client.0.smithi174.stdout: 1 151390 6.19 MB/sec execute 1 sec latency 9.050 ms 2020-04-02T23:24:38.751 INFO:tasks.workunit.client.0.smithi174.stdout: 1 152792 8.99 MB/sec execute 2 sec latency 16.191 ms 2020-04-02T23:24:39.751 INFO:tasks.workunit.client.0.smithi174.stdout: 1 153701 6.78 MB/sec execute 3 sec latency 9.185 ms 2020-04-02T23:24:40.751 INFO:tasks.workunit.client.0.smithi174.stdout: 1 155024 6.49 MB/sec execute 4 sec latency 42.572 ms 2020-04-02T23:24:41.751 INFO:tasks.workunit.client.0.smithi174.stdout: 1 156393 7.42 MB/sec execute 5 sec latency 32.369 ms 2020-04-02T23:24:42.751 INFO:tasks.workunit.client.0.smithi174.stdout: 1 157305 6.59 MB/sec execute 6 sec latency 77.260 ms 2020-04-02T23:24:43.751 INFO:tasks.workunit.client.0.smithi174.stdout: 1 158689 6.49 MB/sec execute 7 sec latency 10.915 ms 2020-04-02T23:24:44.751 INFO:tasks.workunit.client.0.smithi174.stdout: 1 160013 7.07 MB/sec execute 8 sec latency 10.091 ms 2020-04-02T23:24:45.751 INFO:tasks.workunit.client.0.smithi174.stdout: 1 161089 6.84 MB/sec execute 9 sec latency 9.326 ms 2020-04-02T23:24:46.751 INFO:tasks.workunit.client.0.smithi174.stdout: 1 162549 6.87 MB/sec execute 10 sec latency 14.624 ms 2020-04-02T23:24:47.751 INFO:tasks.workunit.client.0.smithi174.stdout: 1 163622 6.88 MB/sec execute 11 sec latency 8.115 ms 2020-04-02T23:24:48.751 INFO:tasks.workunit.client.0.smithi174.stdout: 1 164706 6.73 MB/sec execute 12 sec latency 11.361 ms 2020-04-02T23:24:49.751 INFO:tasks.workunit.client.0.smithi174.stdout: 1 166164 6.79 MB/sec execute 13 sec latency 9.544 ms 2020-04-02T23:24:50.751 INFO:tasks.workunit.client.0.smithi174.stdout: 1 167199 6.77 MB/sec execute 14 sec latency 7.118 ms 2020-04-02T23:24:51.751 INFO:tasks.workunit.client.0.smithi174.stdout: 1 168296 6.66 MB/sec execute 15 sec latency 10.462 ms 2020-04-02T23:24:52.751 INFO:tasks.workunit.client.0.smithi174.stdout: 1 169729 6.71 MB/sec execute 16 sec latency 10.235 ms 2020-04-02T23:24:53.752 INFO:tasks.workunit.client.0.smithi174.stdout: 1 170751 6.70 MB/sec execute 17 sec latency 8.447 ms 2020-04-02T23:24:54.752 INFO:tasks.workunit.client.0.smithi174.stdout: 1 171868 6.62 MB/sec execute 18 sec latency 10.345 ms 2020-04-02T23:24:54.877 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:24:54.891 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:24:54.933 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:24:54.946 INFO:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:24:55.752 INFO:tasks.workunit.client.0.smithi174.stdout: 1 173175 6.62 MB/sec execute 19 sec latency 26.829 ms 2020-04-02T23:24:56.752 INFO:tasks.workunit.client.0.smithi174.stdout: 1 174231 6.65 MB/sec execute 20 sec latency 11.278 ms 2020-04-02T23:24:57.751 INFO:tasks.workunit.client.0.smithi174.stdout: 1 175277 6.58 MB/sec execute 21 sec latency 10.738 ms 2020-04-02T23:24:58.752 INFO:tasks.workunit.client.0.smithi174.stdout: 1 176699 6.56 MB/sec execute 22 sec latency 16.352 ms 2020-04-02T23:24:59.752 INFO:tasks.workunit.client.0.smithi174.stdout: 1 177789 6.61 MB/sec execute 23 sec latency 9.833 ms 2020-04-02T23:25:00.752 INFO:tasks.workunit.client.0.smithi174.stdout: 1 178886 6.55 MB/sec execute 24 sec latency 13.525 ms 2020-04-02T23:25:01.752 INFO:tasks.workunit.client.0.smithi174.stdout: 1 180351 6.59 MB/sec execute 25 sec latency 9.156 ms 2020-04-02T23:25:02.752 INFO:tasks.workunit.client.0.smithi174.stdout: 1 181448 6.59 MB/sec execute 26 sec latency 7.517 ms 2020-04-02T23:25:03.752 INFO:tasks.workunit.client.0.smithi174.stdout: 1 182618 6.54 MB/sec execute 27 sec latency 10.223 ms 2020-04-02T23:25:04.752 INFO:tasks.workunit.client.0.smithi174.stdout: 1 184181 6.63 MB/sec execute 28 sec latency 10.085 ms 2020-04-02T23:25:05.752 INFO:tasks.workunit.client.0.smithi174.stdout: 1 185035 6.57 MB/sec execute 29 sec latency 9.334 ms 2020-04-02T23:25:06.752 INFO:tasks.workunit.client.0.smithi174.stdout: 1 186282 6.53 MB/sec execute 30 sec latency 13.954 ms 2020-04-02T23:25:07.752 INFO:tasks.workunit.client.0.smithi174.stdout: 1 187789 6.61 MB/sec execute 31 sec latency 15.791 ms 2020-04-02T23:25:08.752 INFO:tasks.workunit.client.0.smithi174.stdout: 1 188632 6.55 MB/sec execute 32 sec latency 8.482 ms 2020-04-02T23:25:09.752 INFO:tasks.workunit.client.0.smithi174.stdout: 1 189889 6.51 MB/sec execute 33 sec latency 9.543 ms 2020-04-02T23:25:10.752 INFO:tasks.workunit.client.0.smithi174.stdout: 1 191384 6.59 MB/sec execute 34 sec latency 9.709 ms 2020-04-02T23:25:11.752 INFO:tasks.workunit.client.0.smithi174.stdout: 1 192263 6.54 MB/sec execute 35 sec latency 8.217 ms 2020-04-02T23:25:12.752 INFO:tasks.workunit.client.0.smithi174.stdout: 1 193561 6.50 MB/sec execute 36 sec latency 12.249 ms 2020-04-02T23:25:13.752 INFO:tasks.workunit.client.0.smithi174.stdout: 1 195077 6.65 MB/sec execute 37 sec latency 9.899 ms 2020-04-02T23:25:14.752 INFO:tasks.workunit.client.0.smithi174.stdout: 1 195851 6.53 MB/sec execute 38 sec latency 8.031 ms 2020-04-02T23:25:15.752 INFO:tasks.workunit.client.0.smithi174.stdout: 1 197075 6.49 MB/sec execute 39 sec latency 57.755 ms 2020-04-02T23:25:16.752 INFO:tasks.workunit.client.0.smithi174.stdout: 1 198591 6.63 MB/sec execute 40 sec latency 10.220 ms 2020-04-02T23:25:17.752 INFO:tasks.workunit.client.0.smithi174.stdout: 1 199360 6.51 MB/sec execute 41 sec latency 8.401 ms 2020-04-02T23:25:18.752 INFO:tasks.workunit.client.0.smithi174.stdout: 1 200600 6.48 MB/sec execute 42 sec latency 35.714 ms 2020-04-02T23:25:19.752 INFO:tasks.workunit.client.0.smithi174.stdout: 1 202026 6.54 MB/sec execute 43 sec latency 10.281 ms 2020-04-02T23:25:20.752 INFO:tasks.workunit.client.0.smithi174.stdout: 1 202903 6.51 MB/sec execute 44 sec latency 9.263 ms 2020-04-02T23:25:21.761 INFO:tasks.workunit.client.0.smithi174.stdout: 1 204143 6.48 MB/sec execute 45 sec latency 10.378 ms 2020-04-02T23:25:22.752 INFO:tasks.workunit.client.0.smithi174.stdout: 1 205698 6.60 MB/sec execute 46 sec latency 8.562 ms 2020-04-02T23:25:23.757 INFO:tasks.workunit.client.0.smithi174.stdout: 1 206519 6.50 MB/sec execute 47 sec latency 8.106 ms 2020-04-02T23:25:24.752 INFO:tasks.workunit.client.0.smithi174.stdout: 1 207900 6.48 MB/sec execute 48 sec latency 7.477 ms 2020-04-02T23:25:25.142 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:25:25.157 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:25:25.198 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:25:25.212 INFO:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:25:25.752 INFO:tasks.workunit.client.0.smithi174.stdout: 1 209347 6.59 MB/sec execute 49 sec latency 9.833 ms 2020-04-02T23:25:26.752 INFO:tasks.workunit.client.0.smithi174.stdout: 1 210162 6.50 MB/sec execute 50 sec latency 10.448 ms 2020-04-02T23:25:27.752 INFO:tasks.workunit.client.0.smithi174.stdout: 1 211576 6.49 MB/sec execute 51 sec latency 10.909 ms 2020-04-02T23:25:28.752 INFO:tasks.workunit.client.0.smithi174.stdout: 1 212998 6.58 MB/sec execute 52 sec latency 16.857 ms 2020-04-02T23:25:29.752 INFO:tasks.workunit.client.0.smithi174.stdout: 1 213813 6.50 MB/sec execute 53 sec latency 9.293 ms 2020-04-02T23:25:30.753 INFO:tasks.workunit.client.0.smithi174.stdout: 1 215197 6.49 MB/sec execute 54 sec latency 53.998 ms 2020-04-02T23:25:31.752 INFO:tasks.workunit.client.0.smithi174.stdout: 1 216584 6.57 MB/sec execute 55 sec latency 14.812 ms 2020-04-02T23:25:32.753 INFO:tasks.workunit.client.0.smithi174.stdout: 1 217399 6.49 MB/sec execute 56 sec latency 9.674 ms 2020-04-02T23:25:33.753 INFO:tasks.workunit.client.0.smithi174.stdout: 1 218812 6.48 MB/sec execute 57 sec latency 10.919 ms 2020-04-02T23:25:34.753 INFO:tasks.workunit.client.0.smithi174.stdout: 1 220200 6.57 MB/sec execute 58 sec latency 21.177 ms 2020-04-02T23:25:35.753 INFO:tasks.workunit.client.0.smithi174.stdout: 1 221080 6.50 MB/sec execute 59 sec latency 9.198 ms 2020-04-02T23:25:36.753 INFO:tasks.workunit.client.0.smithi174.stdout: 1 222433 6.49 MB/sec execute 60 sec latency 13.740 ms 2020-04-02T23:25:37.753 INFO:tasks.workunit.client.0.smithi174.stdout: 1 223806 6.56 MB/sec execute 61 sec latency 10.026 ms 2020-04-02T23:25:38.753 INFO:tasks.workunit.client.0.smithi174.stdout: 1 224724 6.50 MB/sec execute 62 sec latency 9.983 ms 2020-04-02T23:25:39.753 INFO:tasks.workunit.client.0.smithi174.stdout: 1 226103 6.49 MB/sec execute 63 sec latency 12.583 ms 2020-04-02T23:25:40.753 INFO:tasks.workunit.client.0.smithi174.stdout: 1 227422 6.56 MB/sec execute 64 sec latency 8.508 ms 2020-04-02T23:25:41.753 INFO:tasks.workunit.client.0.smithi174.stdout: 1 228447 6.54 MB/sec execute 65 sec latency 9.725 ms 2020-04-02T23:25:42.753 INFO:tasks.workunit.client.0.smithi174.stdout: 1 229824 6.53 MB/sec execute 66 sec latency 9.778 ms 2020-04-02T23:25:43.753 INFO:tasks.workunit.client.0.smithi174.stdout: 1 231003 6.55 MB/sec execute 67 sec latency 9.490 ms 2020-04-02T23:25:44.753 INFO:tasks.workunit.client.0.smithi174.stdout: 1 232032 6.53 MB/sec execute 68 sec latency 13.565 ms 2020-04-02T23:25:45.753 INFO:tasks.workunit.client.0.smithi174.stdout: 1 233364 6.52 MB/sec execute 69 sec latency 28.415 ms 2020-04-02T23:25:46.753 INFO:tasks.workunit.client.0.smithi174.stdout: 1 234529 6.54 MB/sec execute 70 sec latency 8.105 ms 2020-04-02T23:25:47.753 INFO:tasks.workunit.client.0.smithi174.stdout: 1 235532 6.52 MB/sec execute 71 sec latency 10.992 ms 2020-04-02T23:25:48.753 INFO:tasks.workunit.client.0.smithi174.stdout: 1 236898 6.52 MB/sec execute 72 sec latency 11.974 ms 2020-04-02T23:25:49.753 INFO:tasks.workunit.client.0.smithi174.stdout: 1 238065 6.54 MB/sec execute 73 sec latency 15.474 ms 2020-04-02T23:25:50.753 INFO:tasks.workunit.client.0.smithi174.stdout: 1 238954 6.48 MB/sec execute 74 sec latency 11.151 ms 2020-04-02T23:25:51.757 INFO:tasks.workunit.client.0.smithi174.stdout: 1 240285 6.47 MB/sec execute 75 sec latency 11.847 ms 2020-04-02T23:25:52.753 INFO:tasks.workunit.client.0.smithi174.stdout: 1 241545 6.53 MB/sec execute 76 sec latency 9.518 ms 2020-04-02T23:25:53.753 INFO:tasks.workunit.client.0.smithi174.stdout: 1 242413 6.47 MB/sec execute 77 sec latency 11.153 ms 2020-04-02T23:25:54.753 INFO:tasks.workunit.client.0.smithi174.stdout: 1 243715 6.46 MB/sec execute 78 sec latency 11.646 ms 2020-04-02T23:25:55.303 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:25:55.318 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:25:55.359 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:25:55.373 INFO:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:25:55.753 INFO:tasks.workunit.client.0.smithi174.stdout: 1 245010 6.52 MB/sec execute 79 sec latency 52.807 ms 2020-04-02T23:25:56.753 INFO:tasks.workunit.client.0.smithi174.stdout: 1 245862 6.47 MB/sec execute 80 sec latency 9.028 ms 2020-04-02T23:25:57.753 INFO:tasks.workunit.client.0.smithi174.stdout: 1 247265 6.46 MB/sec execute 81 sec latency 9.946 ms 2020-04-02T23:25:58.753 INFO:tasks.workunit.client.0.smithi174.stdout: 1 248642 6.52 MB/sec execute 82 sec latency 8.958 ms 2020-04-02T23:25:59.753 INFO:tasks.workunit.client.0.smithi174.stdout: 1 249590 6.47 MB/sec execute 83 sec latency 10.355 ms 2020-04-02T23:26:00.753 INFO:tasks.workunit.client.0.smithi174.stdout: 1 251079 6.50 MB/sec execute 84 sec latency 9.117 ms 2020-04-02T23:26:01.753 INFO:tasks.workunit.client.0.smithi174.stdout: 1 252271 6.51 MB/sec execute 85 sec latency 10.907 ms 2020-04-02T23:26:02.753 INFO:tasks.workunit.client.0.smithi174.stdout: 1 253329 6.50 MB/sec execute 86 sec latency 10.171 ms 2020-04-02T23:26:03.753 INFO:tasks.workunit.client.0.smithi174.stdout: 1 254793 6.51 MB/sec execute 87 sec latency 12.095 ms 2020-04-02T23:26:04.753 INFO:tasks.workunit.client.0.smithi174.stdout: 1 255870 6.51 MB/sec execute 88 sec latency 9.975 ms 2020-04-02T23:26:05.753 INFO:tasks.workunit.client.0.smithi174.stdout: 1 256896 6.49 MB/sec execute 89 sec latency 87.309 ms 2020-04-02T23:26:06.753 INFO:tasks.workunit.client.0.smithi174.stdout: 1 258388 6.50 MB/sec execute 90 sec latency 8.587 ms 2020-04-02T23:26:07.753 INFO:tasks.workunit.client.0.smithi174.stdout: 1 259438 6.50 MB/sec execute 91 sec latency 7.914 ms 2020-04-02T23:26:08.753 INFO:tasks.workunit.client.0.smithi174.stdout: 1 260615 6.49 MB/sec execute 92 sec latency 14.264 ms 2020-04-02T23:26:09.753 INFO:tasks.workunit.client.0.smithi174.stdout: 1 262176 6.51 MB/sec execute 93 sec latency 8.979 ms 2020-04-02T23:26:10.753 INFO:tasks.workunit.client.0.smithi174.stdout: 1 263098 6.50 MB/sec execute 94 sec latency 10.031 ms 2020-04-02T23:26:11.753 INFO:tasks.workunit.client.0.smithi174.stdout: 1 264359 6.49 MB/sec execute 95 sec latency 11.214 ms 2020-04-02T23:26:12.754 INFO:tasks.workunit.client.0.smithi174.stdout: 1 265881 6.52 MB/sec execute 96 sec latency 8.974 ms 2020-04-02T23:26:13.754 INFO:tasks.workunit.client.0.smithi174.stdout: 1 266783 6.50 MB/sec execute 97 sec latency 9.013 ms 2020-04-02T23:26:14.754 INFO:tasks.workunit.client.0.smithi174.stdout: 1 268150 6.49 MB/sec execute 98 sec latency 13.305 ms 2020-04-02T23:26:15.754 INFO:tasks.workunit.client.0.smithi174.stdout: 1 269677 6.54 MB/sec execute 99 sec latency 8.866 ms 2020-04-02T23:26:16.754 INFO:tasks.workunit.client.0.smithi174.stdout: 1 270486 6.50 MB/sec execute 100 sec latency 9.759 ms 2020-04-02T23:26:17.754 INFO:tasks.workunit.client.0.smithi174.stdout: 1 271933 6.50 MB/sec execute 101 sec latency 8.901 ms 2020-04-02T23:26:18.754 INFO:tasks.workunit.client.0.smithi174.stdout: 1 273307 6.54 MB/sec execute 102 sec latency 11.794 ms 2020-04-02T23:26:19.754 INFO:tasks.workunit.client.0.smithi174.stdout: 1 274130 6.50 MB/sec execute 103 sec latency 9.595 ms 2020-04-02T23:26:20.754 INFO:tasks.workunit.client.0.smithi174.stdout: 1 275526 6.49 MB/sec execute 104 sec latency 11.879 ms 2020-04-02T23:26:21.754 INFO:tasks.workunit.client.0.smithi174.stdout: 1 276905 6.55 MB/sec execute 105 sec latency 15.716 ms 2020-04-02T23:26:22.754 INFO:tasks.workunit.client.0.smithi174.stdout: 1 277673 6.49 MB/sec execute 106 sec latency 11.949 ms 2020-04-02T23:26:23.754 INFO:tasks.workunit.client.0.smithi174.stdout: 1 279078 6.49 MB/sec execute 107 sec latency 9.241 ms 2020-04-02T23:26:24.754 INFO:tasks.workunit.client.0.smithi174.stdout: 1 280463 6.54 MB/sec execute 108 sec latency 9.947 ms 2020-04-02T23:26:25.700 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:26:25.715 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:26:25.754 INFO:tasks.workunit.client.0.smithi174.stdout: 1 281302 6.50 MB/sec execute 109 sec latency 9.829 ms 2020-04-02T23:26:25.755 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:26:25.770 INFO:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:26:26.754 INFO:tasks.workunit.client.0.smithi174.stdout: 1 282649 6.49 MB/sec execute 110 sec latency 9.731 ms 2020-04-02T23:26:27.754 INFO:tasks.workunit.client.0.smithi174.stdout: 1 284027 6.54 MB/sec execute 111 sec latency 9.300 ms 2020-04-02T23:26:28.754 INFO:tasks.workunit.client.0.smithi174.stdout: 1 284853 6.50 MB/sec execute 112 sec latency 10.202 ms 2020-04-02T23:26:29.754 INFO:tasks.workunit.client.0.smithi174.stdout: 1 286220 6.49 MB/sec execute 113 sec latency 10.664 ms 2020-04-02T23:26:30.754 INFO:tasks.workunit.client.0.smithi174.stdout: 1 287617 6.53 MB/sec execute 114 sec latency 11.151 ms 2020-04-02T23:26:31.754 INFO:tasks.workunit.client.0.smithi174.stdout: 1 288519 6.50 MB/sec execute 115 sec latency 46.065 ms 2020-04-02T23:26:32.754 INFO:tasks.workunit.client.0.smithi174.stdout: 1 289908 6.49 MB/sec execute 116 sec latency 13.458 ms 2020-04-02T23:26:33.754 INFO:tasks.workunit.client.0.smithi174.stdout: 1 291240 6.53 MB/sec execute 117 sec latency 9.172 ms 2020-04-02T23:26:34.754 INFO:tasks.workunit.client.0.smithi174.stdout: 1 292278 6.52 MB/sec execute 118 sec latency 10.252 ms 2020-04-02T23:26:35.754 INFO:tasks.workunit.client.0.smithi174.stdout: 1 293748 6.51 MB/sec execute 119 sec latency 9.940 ms 2020-04-02T23:26:36.754 INFO:tasks.workunit.client.0.smithi174.stdout: 1 294834 6.53 MB/sec execute 120 sec latency 10.912 ms 2020-04-02T23:26:37.754 INFO:tasks.workunit.client.0.smithi174.stdout: 1 295923 6.51 MB/sec execute 121 sec latency 9.547 ms 2020-04-02T23:26:38.754 INFO:tasks.workunit.client.0.smithi174.stdout: 1 297400 6.52 MB/sec execute 122 sec latency 12.077 ms 2020-04-02T23:26:39.754 INFO:tasks.workunit.client.0.smithi174.stdout: 1 298475 6.52 MB/sec execute 123 sec latency 8.808 ms 2020-04-02T23:26:40.754 INFO:tasks.workunit.client.0.smithi174.stdout: 1 299622 6.51 MB/sec execute 124 sec latency 9.508 ms 2020-04-02T23:26:41.754 INFO:tasks.workunit.client.0.smithi174.stdout: 1 301148 6.52 MB/sec execute 125 sec latency 9.166 ms 2020-04-02T23:26:42.754 INFO:tasks.workunit.client.0.smithi174.stdout: 1 302078 6.52 MB/sec execute 126 sec latency 9.419 ms 2020-04-02T23:26:43.754 INFO:tasks.workunit.client.0.smithi174.stdout: 1 303243 6.51 MB/sec execute 127 sec latency 9.578 ms 2020-04-02T23:26:44.754 INFO:tasks.workunit.client.0.smithi174.stdout: 1 304762 6.52 MB/sec execute 128 sec latency 10.436 ms 2020-04-02T23:26:45.754 INFO:tasks.workunit.client.0.smithi174.stdout: 1 305623 6.52 MB/sec execute 129 sec latency 27.820 ms 2020-04-02T23:26:46.754 INFO:tasks.workunit.client.0.smithi174.stdout: 1 306717 6.51 MB/sec execute 130 sec latency 47.893 ms 2020-04-02T23:26:47.754 INFO:tasks.workunit.client.0.smithi174.stdout: 1 308238 6.52 MB/sec execute 131 sec latency 9.888 ms 2020-04-02T23:26:48.754 INFO:tasks.workunit.client.0.smithi174.stdout: 1 309170 6.51 MB/sec execute 132 sec latency 7.671 ms 2020-04-02T23:26:49.755 INFO:tasks.workunit.client.0.smithi174.stdout: 1 310315 6.50 MB/sec execute 133 sec latency 9.867 ms 2020-04-02T23:26:50.756 INFO:tasks.workunit.client.0.smithi174.stdout: 1 311843 6.52 MB/sec execute 134 sec latency 9.837 ms 2020-04-02T23:26:51.755 INFO:tasks.workunit.client.0.smithi174.stdout: 1 312730 6.51 MB/sec execute 135 sec latency 9.192 ms 2020-04-02T23:26:52.755 INFO:tasks.workunit.client.0.smithi174.stdout: 1 313923 6.50 MB/sec execute 136 sec latency 10.866 ms 2020-04-02T23:26:53.755 INFO:tasks.workunit.client.0.smithi174.stdout: 1 315440 6.52 MB/sec execute 137 sec latency 13.951 ms 2020-04-02T23:26:54.755 INFO:tasks.workunit.client.0.smithi174.stdout: 1 316274 6.51 MB/sec execute 138 sec latency 8.296 ms 2020-04-02T23:26:55.755 INFO:tasks.workunit.client.0.smithi174.stdout: 1 317419 6.50 MB/sec execute 139 sec latency 11.356 ms 2020-04-02T23:26:55.871 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:26:55.886 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:26:55.929 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:26:55.943 INFO:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:26:56.755 INFO:tasks.workunit.client.0.smithi174.stdout: 1 318925 6.51 MB/sec execute 140 sec latency 13.979 ms 2020-04-02T23:26:57.755 INFO:tasks.workunit.client.0.smithi174.stdout: 1 319820 6.50 MB/sec execute 141 sec latency 9.181 ms 2020-04-02T23:26:58.755 INFO:tasks.workunit.client.0.smithi174.stdout: 1 320969 6.50 MB/sec execute 142 sec latency 10.536 ms 2020-04-02T23:26:59.755 INFO:tasks.workunit.client.0.smithi174.stdout: 1 322453 6.51 MB/sec execute 143 sec latency 9.987 ms 2020-04-02T23:27:00.755 INFO:tasks.workunit.client.0.smithi174.stdout: 1 323341 6.50 MB/sec execute 144 sec latency 8.678 ms 2020-04-02T23:27:01.755 INFO:tasks.workunit.client.0.smithi174.stdout: 1 324456 6.49 MB/sec execute 145 sec latency 15.476 ms 2020-04-02T23:27:02.755 INFO:tasks.workunit.client.0.smithi174.stdout: 1 325961 6.50 MB/sec execute 146 sec latency 11.604 ms 2020-04-02T23:27:03.755 INFO:tasks.workunit.client.0.smithi174.stdout: 1 326827 6.50 MB/sec execute 147 sec latency 9.455 ms 2020-04-02T23:27:04.755 INFO:tasks.workunit.client.0.smithi174.stdout: 1 327946 6.49 MB/sec execute 148 sec latency 12.990 ms 2020-04-02T23:27:05.757 INFO:tasks.workunit.client.0.smithi174.stdout: 1 329342 6.50 MB/sec execute 149 sec latency 9.566 ms 2020-04-02T23:27:06.755 INFO:tasks.workunit.client.0.smithi174.stdout: 1 330316 6.50 MB/sec execute 150 sec latency 51.339 ms 2020-04-02T23:27:07.755 INFO:tasks.workunit.client.0.smithi174.stdout: 1 331341 6.49 MB/sec execute 151 sec latency 14.835 ms 2020-04-02T23:27:08.755 INFO:tasks.workunit.client.0.smithi174.stdout: 1 332767 6.48 MB/sec execute 152 sec latency 10.413 ms 2020-04-02T23:27:09.764 INFO:tasks.workunit.client.0.smithi174.stdout: 1 333816 6.49 MB/sec execute 153 sec latency 10.708 ms 2020-04-02T23:27:10.755 INFO:tasks.workunit.client.0.smithi174.stdout: 1 334719 6.47 MB/sec execute 154 sec latency 10.201 ms 2020-04-02T23:27:11.755 INFO:tasks.workunit.client.0.smithi174.stdout: 1 336035 6.46 MB/sec execute 155 sec latency 10.167 ms 2020-04-02T23:27:12.755 INFO:tasks.workunit.client.0.smithi174.stdout: 1 337315 6.49 MB/sec execute 156 sec latency 10.691 ms 2020-04-02T23:27:13.755 INFO:tasks.workunit.client.0.smithi174.stdout: 1 338156 6.46 MB/sec execute 157 sec latency 11.782 ms 2020-04-02T23:27:14.755 INFO:tasks.workunit.client.0.smithi174.stdout: 1 339464 6.46 MB/sec execute 158 sec latency 9.836 ms 2020-04-02T23:27:15.755 INFO:tasks.workunit.client.0.smithi174.stdout: 1 340797 6.49 MB/sec execute 159 sec latency 9.994 ms 2020-04-02T23:27:16.755 INFO:tasks.workunit.client.0.smithi174.stdout: 1 341683 6.46 MB/sec execute 160 sec latency 9.529 ms 2020-04-02T23:27:17.755 INFO:tasks.workunit.client.0.smithi174.stdout: 1 343077 6.46 MB/sec execute 161 sec latency 9.440 ms 2020-04-02T23:27:18.756 INFO:tasks.workunit.client.0.smithi174.stdout: 1 344392 6.48 MB/sec execute 162 sec latency 10.391 ms 2020-04-02T23:27:19.756 INFO:tasks.workunit.client.0.smithi174.stdout: 1 345307 6.46 MB/sec execute 163 sec latency 11.092 ms 2020-04-02T23:27:20.755 INFO:tasks.workunit.client.0.smithi174.stdout: 1 346673 6.46 MB/sec execute 164 sec latency 9.337 ms 2020-04-02T23:27:21.755 INFO:tasks.workunit.client.0.smithi174.stdout: 1 347972 6.48 MB/sec execute 165 sec latency 24.498 ms 2020-04-02T23:27:22.755 INFO:tasks.workunit.client.0.smithi174.stdout: 1 348859 6.46 MB/sec execute 166 sec latency 10.335 ms 2020-04-02T23:27:23.755 INFO:tasks.workunit.client.0.smithi174.stdout: 1 350201 6.46 MB/sec execute 167 sec latency 8.951 ms 2020-04-02T23:27:24.755 INFO:tasks.workunit.client.0.smithi174.stdout: 1 351495 6.48 MB/sec execute 168 sec latency 8.973 ms 2020-04-02T23:27:25.755 INFO:tasks.workunit.client.0.smithi174.stdout: 1 352412 6.46 MB/sec execute 169 sec latency 9.201 ms 2020-04-02T23:27:26.077 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:27:26.090 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:27:26.132 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:27:26.146 INFO:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:27:26.755 INFO:tasks.workunit.client.0.smithi174.stdout: 1 353762 6.45 MB/sec execute 170 sec latency 9.507 ms 2020-04-02T23:27:27.755 INFO:tasks.workunit.client.0.smithi174.stdout: 1 355092 6.48 MB/sec execute 171 sec latency 8.971 ms 2020-04-02T23:27:28.755 INFO:tasks.workunit.client.0.smithi174.stdout: 1 356148 6.47 MB/sec execute 172 sec latency 8.836 ms 2020-04-02T23:27:29.755 INFO:tasks.workunit.client.0.smithi174.stdout: 1 357601 6.47 MB/sec execute 173 sec latency 10.358 ms 2020-04-02T23:27:30.755 INFO:tasks.workunit.client.0.smithi174.stdout: 1 358695 6.48 MB/sec execute 174 sec latency 7.790 ms 2020-04-02T23:27:31.756 INFO:tasks.workunit.client.0.smithi174.stdout: 1 359842 6.47 MB/sec execute 175 sec latency 9.121 ms 2020-04-02T23:27:32.756 INFO:tasks.workunit.client.0.smithi174.stdout: 1 361277 6.48 MB/sec execute 176 sec latency 8.915 ms 2020-04-02T23:27:33.755 INFO:tasks.workunit.client.0.smithi174.stdout: 1 362340 6.48 MB/sec execute 177 sec latency 12.189 ms 2020-04-02T23:27:34.756 INFO:tasks.workunit.client.0.smithi174.stdout: 1 363567 6.47 MB/sec execute 178 sec latency 9.637 ms 2020-04-02T23:27:35.756 INFO:tasks.workunit.client.0.smithi174.stdout: 1 365096 6.49 MB/sec execute 179 sec latency 15.105 ms 2020-04-02T23:27:36.756 INFO:tasks.workunit.client.0.smithi174.stdout: 1 365945 6.48 MB/sec execute 180 sec latency 8.713 ms 2020-04-02T23:27:37.756 INFO:tasks.workunit.client.0.smithi174.stdout: 1 367190 6.47 MB/sec execute 181 sec latency 10.057 ms 2020-04-02T23:27:38.756 INFO:tasks.workunit.client.0.smithi174.stdout: 1 368703 6.48 MB/sec execute 182 sec latency 12.136 ms 2020-04-02T23:27:39.756 INFO:tasks.workunit.client.0.smithi174.stdout: 1 369581 6.47 MB/sec execute 183 sec latency 8.694 ms 2020-04-02T23:27:40.756 INFO:tasks.workunit.client.0.smithi174.stdout: 1 370860 6.47 MB/sec execute 184 sec latency 13.081 ms 2020-04-02T23:27:41.756 INFO:tasks.workunit.client.0.smithi174.stdout: 1 372393 6.50 MB/sec execute 185 sec latency 9.563 ms 2020-04-02T23:27:42.756 INFO:tasks.workunit.client.0.smithi174.stdout: 1 373142 6.47 MB/sec execute 186 sec latency 60.885 ms 2020-04-02T23:27:43.756 INFO:tasks.workunit.client.0.smithi174.stdout: 1 374432 6.47 MB/sec execute 187 sec latency 11.895 ms 2020-04-02T23:27:44.756 INFO:tasks.workunit.client.0.smithi174.stdout: 1 375965 6.50 MB/sec execute 188 sec latency 12.091 ms 2020-04-02T23:27:45.756 INFO:tasks.workunit.client.0.smithi174.stdout: 1 376755 6.47 MB/sec execute 189 sec latency 9.568 ms 2020-04-02T23:27:46.756 INFO:tasks.workunit.client.0.smithi174.stdout: 1 378097 6.47 MB/sec execute 190 sec latency 7.922 ms 2020-04-02T23:27:47.756 INFO:tasks.workunit.client.0.smithi174.stdout: 1 379571 6.49 MB/sec execute 191 sec latency 10.538 ms 2020-04-02T23:27:48.756 INFO:tasks.workunit.client.0.smithi174.stdout: 1 380368 6.47 MB/sec execute 192 sec latency 10.008 ms 2020-04-02T23:27:49.756 INFO:tasks.workunit.client.0.smithi174.stdout: 1 381705 6.47 MB/sec execute 193 sec latency 10.191 ms 2020-04-02T23:27:50.756 INFO:tasks.workunit.client.0.smithi174.stdout: 1 383111 6.49 MB/sec execute 194 sec latency 17.665 ms 2020-04-02T23:27:51.756 INFO:tasks.workunit.client.0.smithi174.stdout: 1 383859 6.47 MB/sec execute 195 sec latency 40.395 ms 2020-04-02T23:27:52.756 INFO:tasks.workunit.client.0.smithi174.stdout: 1 385112 6.46 MB/sec execute 196 sec latency 10.352 ms 2020-04-02T23:27:53.756 INFO:tasks.workunit.client.0.smithi174.stdout: 1 386618 6.49 MB/sec execute 197 sec latency 10.787 ms 2020-04-02T23:27:54.756 INFO:tasks.workunit.client.0.smithi174.stdout: 1 387365 6.47 MB/sec execute 198 sec latency 9.375 ms 2020-04-02T23:27:55.756 INFO:tasks.workunit.client.0.smithi174.stdout: 1 388563 6.46 MB/sec execute 199 sec latency 10.996 ms 2020-04-02T23:27:56.247 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:27:56.264 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:27:56.306 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:27:56.320 INFO:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:27:56.756 INFO:tasks.workunit.client.0.smithi174.stdout: 1 389950 6.47 MB/sec execute 200 sec latency 58.193 ms 2020-04-02T23:27:57.756 INFO:tasks.workunit.client.0.smithi174.stdout: 1 390799 6.47 MB/sec execute 201 sec latency 10.399 ms 2020-04-02T23:27:58.756 INFO:tasks.workunit.client.0.smithi174.stdout: 1 391859 6.46 MB/sec execute 202 sec latency 55.681 ms 2020-04-02T23:27:59.756 INFO:tasks.workunit.client.0.smithi174.stdout: 1 393229 6.46 MB/sec execute 203 sec latency 10.280 ms 2020-04-02T23:28:00.756 INFO:tasks.workunit.client.0.smithi174.stdout: 1 394241 6.46 MB/sec execute 204 sec latency 9.083 ms 2020-04-02T23:28:01.756 INFO:tasks.workunit.client.0.smithi174.stdout: 1 395304 6.46 MB/sec execute 205 sec latency 10.086 ms 2020-04-02T23:28:02.756 INFO:tasks.workunit.client.0.smithi174.stdout: 1 396688 6.46 MB/sec execute 206 sec latency 10.525 ms 2020-04-02T23:28:03.757 INFO:tasks.workunit.client.0.smithi174.stdout: 1 397744 6.46 MB/sec execute 207 sec latency 9.773 ms 2020-04-02T23:28:04.756 INFO:tasks.workunit.client.0.smithi174.stdout: 1 398737 6.46 MB/sec execute 208 sec latency 12.780 ms 2020-04-02T23:28:05.756 INFO:tasks.workunit.client.0.smithi174.stdout: 1 400072 6.45 MB/sec execute 209 sec latency 10.704 ms 2020-04-02T23:28:06.756 INFO:tasks.workunit.client.0.smithi174.stdout: 1 401217 6.46 MB/sec execute 210 sec latency 9.593 ms 2020-04-02T23:28:07.756 INFO:tasks.workunit.client.0.smithi174.stdout: 1 402065 6.44 MB/sec execute 211 sec latency 13.375 ms 2020-04-02T23:28:08.756 INFO:tasks.workunit.client.0.smithi174.stdout: 1 403343 6.44 MB/sec execute 212 sec latency 10.109 ms 2020-04-02T23:28:09.756 INFO:tasks.workunit.client.0.smithi174.stdout: 1 404673 6.46 MB/sec execute 213 sec latency 10.928 ms 2020-04-02T23:28:10.758 INFO:tasks.workunit.client.0.smithi174.stdout: 1 405504 6.44 MB/sec execute 214 sec latency 10.440 ms 2020-04-02T23:28:11.757 INFO:tasks.workunit.client.0.smithi174.stdout: 1 406836 6.43 MB/sec execute 215 sec latency 9.188 ms 2020-04-02T23:28:12.756 INFO:tasks.workunit.client.0.smithi174.stdout: 1 408172 6.46 MB/sec execute 216 sec latency 10.662 ms 2020-04-02T23:28:13.757 INFO:tasks.workunit.client.0.smithi174.stdout: 1 408965 6.43 MB/sec execute 217 sec latency 8.112 ms 2020-04-02T23:28:14.757 INFO:tasks.workunit.client.0.smithi174.stdout: 1 410338 6.43 MB/sec execute 218 sec latency 9.691 ms 2020-04-02T23:28:15.757 INFO:tasks.workunit.client.0.smithi174.stdout: 1 411708 6.46 MB/sec execute 219 sec latency 15.880 ms 2020-04-02T23:28:16.757 INFO:tasks.workunit.client.0.smithi174.stdout: 1 412484 6.43 MB/sec execute 220 sec latency 8.175 ms 2020-04-02T23:28:17.757 INFO:tasks.workunit.client.0.smithi174.stdout: 1 413878 6.43 MB/sec execute 221 sec latency 10.139 ms 2020-04-02T23:28:18.757 INFO:tasks.workunit.client.0.smithi174.stdout: 1 415243 6.46 MB/sec execute 222 sec latency 11.529 ms 2020-04-02T23:28:19.757 INFO:tasks.workunit.client.0.smithi174.stdout: 1 416020 6.43 MB/sec execute 223 sec latency 7.932 ms 2020-04-02T23:28:20.757 INFO:tasks.workunit.client.0.smithi174.stdout: 1 417403 6.43 MB/sec execute 224 sec latency 8.873 ms 2020-04-02T23:28:21.757 INFO:tasks.workunit.client.0.smithi174.stdout: 1 418733 6.45 MB/sec execute 225 sec latency 30.927 ms 2020-04-02T23:28:22.757 INFO:tasks.workunit.client.0.smithi174.stdout: 1 419496 6.43 MB/sec execute 226 sec latency 8.648 ms 2020-04-02T23:28:23.757 INFO:tasks.workunit.client.0.smithi174.stdout: 1 420805 6.42 MB/sec execute 227 sec latency 13.104 ms 2020-04-02T23:28:24.757 INFO:tasks.workunit.client.0.smithi174.stdout: 1 422211 6.45 MB/sec execute 228 sec latency 9.619 ms 2020-04-02T23:28:25.757 INFO:tasks.workunit.client.0.smithi174.stdout: 1 422922 6.43 MB/sec execute 229 sec latency 13.220 ms 2020-04-02T23:28:26.507 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:28:26.521 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:28:26.563 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:28:26.578 INFO:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:28:26.757 INFO:tasks.workunit.client.0.smithi174.stdout: 1 424141 6.42 MB/sec execute 230 sec latency 11.017 ms 2020-04-02T23:28:27.757 INFO:tasks.workunit.client.0.smithi174.stdout: 1 425489 6.43 MB/sec execute 231 sec latency 13.357 ms 2020-04-02T23:28:28.757 INFO:tasks.workunit.client.0.smithi174.stdout: 1 426279 6.43 MB/sec execute 232 sec latency 9.181 ms 2020-04-02T23:28:29.757 INFO:tasks.workunit.client.0.smithi174.stdout: 1 427437 6.42 MB/sec execute 233 sec latency 12.716 ms 2020-04-02T23:28:30.757 INFO:tasks.workunit.client.0.smithi174.stdout: 1 428881 6.43 MB/sec execute 234 sec latency 10.364 ms 2020-04-02T23:28:31.757 INFO:tasks.workunit.client.0.smithi174.stdout: 1 429690 6.42 MB/sec execute 235 sec latency 53.088 ms 2020-04-02T23:28:32.757 INFO:tasks.workunit.client.0.smithi174.stdout: 1 430714 6.42 MB/sec execute 236 sec latency 11.352 ms 2020-04-02T23:28:33.757 INFO:tasks.workunit.client.0.smithi174.stdout: 1 431995 6.42 MB/sec execute 237 sec latency 11.923 ms 2020-04-02T23:28:34.757 INFO:tasks.workunit.client.0.smithi174.stdout: 1 433127 6.42 MB/sec execute 238 sec latency 11.377 ms 2020-04-02T23:28:35.757 INFO:tasks.workunit.client.0.smithi174.stdout: 1 433944 6.41 MB/sec execute 239 sec latency 11.046 ms 2020-04-02T23:28:36.757 INFO:tasks.workunit.client.0.smithi174.stdout: 1 435216 6.40 MB/sec execute 240 sec latency 11.776 ms 2020-04-02T23:28:37.757 INFO:tasks.workunit.client.0.smithi174.stdout: 1 436553 6.42 MB/sec execute 241 sec latency 11.294 ms 2020-04-02T23:28:38.757 INFO:tasks.workunit.client.0.smithi174.stdout: 1 437360 6.40 MB/sec execute 242 sec latency 10.684 ms 2020-04-02T23:28:39.757 INFO:tasks.workunit.client.0.smithi174.stdout: 1 438703 6.40 MB/sec execute 243 sec latency 9.569 ms 2020-04-02T23:28:40.757 INFO:tasks.workunit.client.0.smithi174.stdout: 1 440066 6.42 MB/sec execute 244 sec latency 11.173 ms 2020-04-02T23:28:41.757 INFO:tasks.workunit.client.0.smithi174.stdout: 1 440793 6.40 MB/sec execute 245 sec latency 11.057 ms 2020-04-02T23:28:42.759 INFO:tasks.workunit.client.0.smithi174.stdout: 1 442144 6.40 MB/sec execute 246 sec latency 9.186 ms 2020-04-02T23:28:43.757 INFO:tasks.workunit.client.0.smithi174.stdout: 1 443486 6.42 MB/sec execute 247 sec latency 13.461 ms 2020-04-02T23:28:44.758 INFO:tasks.workunit.client.0.smithi174.stdout: 1 444202 6.40 MB/sec execute 248 sec latency 11.643 ms 2020-04-02T23:28:45.757 INFO:tasks.workunit.client.0.smithi174.stdout: 1 445468 6.39 MB/sec execute 249 sec latency 9.673 ms 2020-04-02T23:28:46.757 INFO:tasks.workunit.client.0.smithi174.stdout: 1 446895 6.41 MB/sec execute 250 sec latency 10.369 ms 2020-04-02T23:28:47.757 INFO:tasks.workunit.client.0.smithi174.stdout: 1 447620 6.40 MB/sec execute 251 sec latency 8.984 ms 2020-04-02T23:28:48.757 INFO:tasks.workunit.client.0.smithi174.stdout: 1 448760 6.39 MB/sec execute 252 sec latency 17.498 ms 2020-04-02T23:28:49.761 INFO:tasks.workunit.client.0.smithi174.stdout: 1 450212 6.40 MB/sec execute 253 sec latency 14.195 ms 2020-04-02T23:28:50.757 INFO:tasks.workunit.client.0.smithi174.stdout: 1 451034 6.40 MB/sec execute 254 sec latency 11.116 ms 2020-04-02T23:28:51.758 INFO:tasks.workunit.client.0.smithi174.stdout: 1 452014 6.39 MB/sec execute 255 sec latency 13.716 ms 2020-04-02T23:28:52.758 INFO:tasks.workunit.client.0.smithi174.stdout: 1 453389 6.39 MB/sec execute 256 sec latency 11.307 ms 2020-04-02T23:28:53.758 INFO:tasks.workunit.client.0.smithi174.stdout: 1 454427 6.40 MB/sec execute 257 sec latency 11.035 ms 2020-04-02T23:28:54.758 INFO:tasks.workunit.client.0.smithi174.stdout: 1 455237 6.38 MB/sec execute 258 sec latency 8.747 ms 2020-04-02T23:28:55.758 INFO:tasks.workunit.client.0.smithi174.stdout: 1 456506 6.38 MB/sec execute 259 sec latency 12.031 ms 2020-04-02T23:28:56.681 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:28:56.695 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:28:56.737 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:28:56.752 INFO:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:28:56.758 INFO:tasks.workunit.client.0.smithi174.stdout: 1 457818 6.39 MB/sec execute 260 sec latency 23.856 ms 2020-04-02T23:28:57.758 INFO:tasks.workunit.client.0.smithi174.stdout: 1 458344 6.37 MB/sec execute 261 sec latency 158.558 ms 2020-04-02T23:28:58.758 INFO:tasks.workunit.client.0.smithi174.stdout: 1 459067 6.43 MB/sec execute 262 sec latency 46.537 ms 2020-04-02T23:28:59.758 INFO:tasks.workunit.client.0.smithi174.stdout: 1 460215 6.42 MB/sec execute 263 sec latency 9.746 ms 2020-04-02T23:29:00.759 INFO:tasks.workunit.client.0.smithi174.stdout: 1 461659 6.43 MB/sec execute 264 sec latency 12.669 ms 2020-04-02T23:29:01.758 INFO:tasks.workunit.client.0.smithi174.stdout: 1 462502 6.43 MB/sec execute 265 sec latency 9.514 ms 2020-04-02T23:29:02.758 INFO:tasks.workunit.client.0.smithi174.stdout: 1 463735 6.42 MB/sec execute 266 sec latency 10.976 ms 2020-04-02T23:29:03.758 INFO:tasks.workunit.client.0.smithi174.stdout: 1 465252 6.43 MB/sec execute 267 sec latency 10.034 ms 2020-04-02T23:29:04.758 INFO:tasks.workunit.client.0.smithi174.stdout: 1 466113 6.43 MB/sec execute 268 sec latency 8.307 ms 2020-04-02T23:29:05.758 INFO:tasks.workunit.client.0.smithi174.stdout: 1 467362 6.42 MB/sec execute 269 sec latency 14.211 ms 2020-04-02T23:29:06.758 INFO:tasks.workunit.client.0.smithi174.stdout: 1 468808 6.43 MB/sec execute 270 sec latency 9.350 ms 2020-04-02T23:29:07.758 INFO:tasks.workunit.client.0.smithi174.stdout: 1 469705 6.43 MB/sec execute 271 sec latency 7.738 ms 2020-04-02T23:29:08.758 INFO:tasks.workunit.client.0.smithi174.stdout: 1 470964 6.42 MB/sec execute 272 sec latency 11.731 ms 2020-04-02T23:29:09.758 INFO:tasks.workunit.client.0.smithi174.stdout: 1 472349 6.43 MB/sec execute 273 sec latency 49.447 ms 2020-04-02T23:29:10.758 INFO:tasks.workunit.client.0.smithi174.stdout: 1 473204 6.43 MB/sec execute 274 sec latency 8.159 ms 2020-04-02T23:29:11.758 INFO:tasks.workunit.client.0.smithi174.stdout: 1 474371 6.42 MB/sec execute 275 sec latency 38.503 ms 2020-04-02T23:29:12.758 INFO:tasks.workunit.client.0.smithi174.stdout: 1 475872 6.43 MB/sec execute 276 sec latency 10.496 ms 2020-04-02T23:29:13.758 INFO:tasks.workunit.client.0.smithi174.stdout: 1 476751 6.42 MB/sec execute 277 sec latency 7.603 ms 2020-04-02T23:29:14.758 INFO:tasks.workunit.client.0.smithi174.stdout: 1 477966 6.42 MB/sec execute 278 sec latency 9.116 ms 2020-04-02T23:29:15.758 INFO:tasks.workunit.client.0.smithi174.stdout: 1 479486 6.43 MB/sec execute 279 sec latency 10.643 ms 2020-04-02T23:29:16.758 INFO:tasks.workunit.client.0.smithi174.stdout: 1 480355 6.42 MB/sec execute 280 sec latency 8.002 ms 2020-04-02T23:29:17.758 INFO:tasks.workunit.client.0.smithi174.stdout: 1 481646 6.42 MB/sec execute 281 sec latency 9.342 ms 2020-04-02T23:29:18.758 INFO:tasks.workunit.client.0.smithi174.stdout: 1 483170 6.44 MB/sec execute 282 sec latency 14.757 ms 2020-04-02T23:29:19.758 INFO:tasks.workunit.client.0.smithi174.stdout: 1 483999 6.43 MB/sec execute 283 sec latency 9.593 ms 2020-04-02T23:29:20.758 INFO:tasks.workunit.client.0.smithi174.stdout: 1 485285 6.42 MB/sec execute 284 sec latency 10.074 ms 2020-04-02T23:29:21.758 INFO:tasks.workunit.client.0.smithi174.stdout: 1 486785 6.44 MB/sec execute 285 sec latency 13.162 ms 2020-04-02T23:29:22.759 INFO:tasks.workunit.client.0.smithi174.stdout: 1 487568 6.42 MB/sec execute 286 sec latency 9.669 ms 2020-04-02T23:29:23.758 INFO:tasks.workunit.client.0.smithi174.stdout: 1 488896 6.42 MB/sec execute 287 sec latency 9.696 ms 2020-04-02T23:29:24.758 INFO:tasks.workunit.client.0.smithi174.stdout: 1 490168 6.43 MB/sec execute 288 sec latency 12.897 ms 2020-04-02T23:29:25.759 INFO:tasks.workunit.client.0.smithi174.stdout: 1 490915 6.42 MB/sec execute 289 sec latency 10.743 ms 2020-04-02T23:29:26.759 INFO:tasks.workunit.client.0.smithi174.stdout: 1 492000 6.42 MB/sec execute 290 sec latency 11.922 ms 2020-04-02T23:29:27.759 INFO:tasks.workunit.client.0.smithi174.stdout: 1 493301 6.42 MB/sec execute 291 sec latency 13.112 ms 2020-04-02T23:29:28.578 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:29:28.592 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:29:28.635 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:29:28.649 INFO:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:29:28.758 INFO:tasks.workunit.client.0.smithi174.stdout: 1 494273 6.42 MB/sec execute 292 sec latency 12.467 ms 2020-04-02T23:29:29.759 INFO:tasks.workunit.client.0.smithi174.stdout: 1 495103 6.41 MB/sec execute 293 sec latency 15.368 ms 2020-04-02T23:29:30.759 INFO:tasks.workunit.client.0.smithi174.stdout: 1 496342 6.40 MB/sec execute 294 sec latency 11.578 ms 2020-04-02T23:29:31.759 INFO:tasks.workunit.client.0.smithi174.stdout: 1 497627 6.42 MB/sec execute 295 sec latency 12.389 ms 2020-04-02T23:29:32.759 INFO:tasks.workunit.client.0.smithi174.stdout: 1 498309 6.40 MB/sec execute 296 sec latency 9.600 ms 2020-04-02T23:29:33.759 INFO:tasks.workunit.client.0.smithi174.stdout: 1 499492 6.40 MB/sec execute 297 sec latency 18.668 ms 2020-04-02T23:29:34.759 INFO:tasks.workunit.client.0.smithi174.stdout: 1 500749 6.41 MB/sec execute 298 sec latency 32.922 ms 2020-04-02T23:29:35.759 INFO:tasks.workunit.client.0.smithi174.stdout: 1 501500 6.40 MB/sec execute 299 sec latency 12.031 ms 2020-04-02T23:29:36.759 INFO:tasks.workunit.client.0.smithi174.stdout: 1 502547 6.40 MB/sec execute 300 sec latency 17.931 ms 2020-04-02T23:29:37.759 INFO:tasks.workunit.client.0.smithi174.stdout: 1 503935 6.40 MB/sec execute 301 sec latency 9.647 ms 2020-04-02T23:29:38.759 INFO:tasks.workunit.client.0.smithi174.stdout: 1 504973 6.40 MB/sec execute 302 sec latency 9.387 ms 2020-04-02T23:29:39.759 INFO:tasks.workunit.client.0.smithi174.stdout: 1 506067 6.40 MB/sec execute 303 sec latency 9.421 ms 2020-04-02T23:29:40.759 INFO:tasks.workunit.client.0.smithi174.stdout: 1 507481 6.40 MB/sec execute 304 sec latency 9.814 ms 2020-04-02T23:29:41.759 INFO:tasks.workunit.client.0.smithi174.stdout: 1 508503 6.40 MB/sec execute 305 sec latency 10.372 ms 2020-04-02T23:29:42.759 INFO:tasks.workunit.client.0.smithi174.stdout: 1 509612 6.40 MB/sec execute 306 sec latency 8.712 ms 2020-04-02T23:29:43.759 INFO:tasks.workunit.client.0.smithi174.stdout: 1 510942 6.40 MB/sec execute 307 sec latency 42.374 ms 2020-04-02T23:29:44.759 INFO:tasks.workunit.client.0.smithi174.stdout: 1 511992 6.40 MB/sec execute 308 sec latency 10.787 ms 2020-04-02T23:29:45.759 INFO:tasks.workunit.client.0.smithi174.stdout: 1 512992 6.39 MB/sec execute 309 sec latency 10.352 ms 2020-04-02T23:29:46.759 INFO:tasks.workunit.client.0.smithi174.stdout: 1 514341 6.39 MB/sec execute 310 sec latency 15.419 ms 2020-04-02T23:29:47.759 INFO:tasks.workunit.client.0.smithi174.stdout: 1 515500 6.40 MB/sec execute 311 sec latency 10.100 ms 2020-04-02T23:29:48.759 INFO:tasks.workunit.client.0.smithi174.stdout: 1 516362 6.38 MB/sec execute 312 sec latency 12.207 ms 2020-04-02T23:29:49.759 INFO:tasks.workunit.client.0.smithi174.stdout: 1 517682 6.38 MB/sec execute 313 sec latency 10.869 ms 2020-04-02T23:29:50.759 INFO:tasks.workunit.client.0.smithi174.stdout: 1 518956 6.40 MB/sec execute 314 sec latency 11.264 ms 2020-04-02T23:29:51.759 INFO:tasks.workunit.client.0.smithi174.stdout: 1 519783 6.38 MB/sec execute 315 sec latency 11.062 ms 2020-04-02T23:29:52.759 INFO:tasks.workunit.client.0.smithi174.stdout: 1 521082 6.38 MB/sec execute 316 sec latency 11.333 ms 2020-04-02T23:29:53.759 INFO:tasks.workunit.client.0.smithi174.stdout: 1 522377 6.39 MB/sec execute 317 sec latency 13.722 ms 2020-04-02T23:29:54.759 INFO:tasks.workunit.client.0.smithi174.stdout: 1 523091 6.38 MB/sec execute 318 sec latency 11.581 ms 2020-04-02T23:29:55.759 INFO:tasks.workunit.client.0.smithi174.stdout: 1 524305 6.38 MB/sec execute 319 sec latency 18.766 ms 2020-04-02T23:29:56.759 INFO:tasks.workunit.client.0.smithi174.stdout: 1 525721 6.39 MB/sec execute 320 sec latency 11.142 ms 2020-04-02T23:29:57.760 INFO:tasks.workunit.client.0.smithi174.stdout: 1 526453 6.38 MB/sec execute 321 sec latency 8.740 ms 2020-04-02T23:29:58.759 INFO:tasks.workunit.client.0.smithi174.stdout: 1 527609 6.37 MB/sec execute 322 sec latency 10.675 ms 2020-04-02T23:29:58.765 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:29:58.779 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:29:58.822 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:29:58.836 INFO:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:29:59.759 INFO:tasks.workunit.client.0.smithi174.stdout: 1 529020 6.38 MB/sec execute 323 sec latency 14.847 ms 2020-04-02T23:30:00.759 INFO:tasks.workunit.client.0.smithi174.stdout: 1 529853 6.38 MB/sec execute 324 sec latency 11.803 ms 2020-04-02T23:30:01.759 INFO:tasks.workunit.client.0.smithi174.stdout: 1 530956 6.37 MB/sec execute 325 sec latency 14.976 ms 2020-04-02T23:30:02.760 INFO:tasks.workunit.client.0.smithi174.stdout: 1 532339 6.38 MB/sec execute 326 sec latency 12.550 ms 2020-04-02T23:30:03.760 INFO:tasks.workunit.client.0.smithi174.stdout: 1 533349 6.38 MB/sec execute 327 sec latency 8.556 ms 2020-04-02T23:30:04.760 INFO:tasks.workunit.client.0.smithi174.stdout: 1 534394 6.37 MB/sec execute 328 sec latency 12.342 ms 2020-04-02T23:30:05.760 INFO:tasks.workunit.client.0.smithi174.stdout: 1 535782 6.38 MB/sec execute 329 sec latency 14.883 ms 2020-04-02T23:30:06.760 INFO:tasks.workunit.client.0.smithi174.stdout: 1 536825 6.38 MB/sec execute 330 sec latency 9.811 ms 2020-04-02T23:30:07.760 INFO:tasks.workunit.client.0.smithi174.stdout: 1 537678 6.37 MB/sec execute 331 sec latency 12.268 ms 2020-04-02T23:30:08.760 INFO:tasks.workunit.client.0.smithi174.stdout: 1 538987 6.36 MB/sec execute 332 sec latency 11.996 ms 2020-04-02T23:30:09.760 INFO:tasks.workunit.client.0.smithi174.stdout: 1 540224 6.38 MB/sec execute 333 sec latency 61.065 ms 2020-04-02T23:30:10.760 INFO:tasks.workunit.client.0.smithi174.stdout: 1 540948 6.36 MB/sec execute 334 sec latency 47.243 ms 2020-04-02T23:30:11.760 INFO:tasks.workunit.client.0.smithi174.stdout: 1 542271 6.36 MB/sec execute 335 sec latency 10.081 ms 2020-04-02T23:30:12.760 INFO:tasks.workunit.client.0.smithi174.stdout: 1 543611 6.37 MB/sec execute 336 sec latency 10.537 ms 2020-04-02T23:30:13.760 INFO:tasks.workunit.client.0.smithi174.stdout: 1 544321 6.36 MB/sec execute 337 sec latency 10.369 ms 2020-04-02T23:30:14.760 INFO:tasks.workunit.client.0.smithi174.stdout: 1 545555 6.36 MB/sec execute 338 sec latency 10.803 ms 2020-04-02T23:30:15.760 INFO:tasks.workunit.client.0.smithi174.stdout: 1 546896 6.36 MB/sec execute 339 sec latency 10.812 ms 2020-04-02T23:30:16.760 INFO:tasks.workunit.client.0.smithi174.stdout: 1 547721 6.36 MB/sec execute 340 sec latency 9.367 ms 2020-04-02T23:30:17.760 INFO:tasks.workunit.client.0.smithi174.stdout: 1 548795 6.36 MB/sec execute 341 sec latency 13.872 ms 2020-04-02T23:30:18.760 INFO:tasks.workunit.client.0.smithi174.stdout: 1 550243 6.36 MB/sec execute 342 sec latency 11.848 ms 2020-04-02T23:30:19.760 INFO:tasks.workunit.client.0.smithi174.stdout: 1 551050 6.36 MB/sec execute 343 sec latency 69.776 ms 2020-04-02T23:30:20.760 INFO:tasks.workunit.client.0.smithi174.stdout: 1 552019 6.36 MB/sec execute 344 sec latency 11.746 ms 2020-04-02T23:30:21.760 INFO:tasks.workunit.client.0.smithi174.stdout: 1 553196 6.35 MB/sec execute 345 sec latency 13.411 ms 2020-04-02T23:30:22.760 INFO:tasks.workunit.client.0.smithi174.stdout: 1 554450 6.36 MB/sec execute 346 sec latency 11.273 ms 2020-04-02T23:30:23.760 INFO:tasks.workunit.client.0.smithi174.stdout: 1 555219 6.35 MB/sec execute 347 sec latency 12.900 ms 2020-04-02T23:30:24.760 INFO:tasks.workunit.client.0.smithi174.stdout: 1 556533 6.34 MB/sec execute 348 sec latency 10.793 ms 2020-04-02T23:30:25.760 INFO:tasks.workunit.client.0.smithi174.stdout: 1 557795 6.36 MB/sec execute 349 sec latency 14.037 ms 2020-04-02T23:30:26.760 INFO:tasks.workunit.client.0.smithi174.stdout: 1 558429 6.34 MB/sec execute 350 sec latency 12.706 ms 2020-04-02T23:30:27.760 INFO:tasks.workunit.client.0.smithi174.stdout: 1 559490 6.34 MB/sec execute 351 sec latency 13.735 ms 2020-04-02T23:30:28.760 INFO:tasks.workunit.client.0.smithi174.stdout: 1 560870 6.34 MB/sec execute 352 sec latency 12.888 ms 2020-04-02T23:30:28.936 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:30:28.951 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:30:28.993 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:30:29.007 INFO:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:30:29.760 INFO:tasks.workunit.client.0.smithi174.stdout: 1 561691 6.34 MB/sec execute 353 sec latency 9.999 ms 2020-04-02T23:30:30.760 INFO:tasks.workunit.client.0.smithi174.stdout: 1 562515 6.33 MB/sec execute 354 sec latency 13.962 ms 2020-04-02T23:30:31.760 INFO:tasks.workunit.client.0.smithi174.stdout: 1 563745 6.33 MB/sec execute 355 sec latency 12.808 ms 2020-04-02T23:30:32.760 INFO:tasks.workunit.client.0.smithi174.stdout: 1 565024 6.34 MB/sec execute 356 sec latency 13.169 ms 2020-04-02T23:30:33.760 INFO:tasks.workunit.client.0.smithi174.stdout: 1 565668 6.33 MB/sec execute 357 sec latency 13.639 ms 2020-04-02T23:30:34.761 INFO:tasks.workunit.client.0.smithi174.stdout: 1 566782 6.32 MB/sec execute 358 sec latency 14.017 ms 2020-04-02T23:30:35.761 INFO:tasks.workunit.client.0.smithi174.stdout: 1 568116 6.33 MB/sec execute 359 sec latency 14.962 ms 2020-04-02T23:30:36.761 INFO:tasks.workunit.client.0.smithi174.stdout: 1 568869 6.32 MB/sec execute 360 sec latency 11.435 ms 2020-04-02T23:30:37.761 INFO:tasks.workunit.client.0.smithi174.stdout: 1 569772 6.32 MB/sec execute 361 sec latency 16.971 ms 2020-04-02T23:30:38.761 INFO:tasks.workunit.client.0.smithi174.stdout: 1 571092 6.32 MB/sec execute 362 sec latency 11.786 ms 2020-04-02T23:30:39.761 INFO:tasks.workunit.client.0.smithi174.stdout: 1 572247 6.32 MB/sec execute 363 sec latency 10.695 ms 2020-04-02T23:30:40.761 INFO:tasks.workunit.client.0.smithi174.stdout: 1 573075 6.31 MB/sec execute 364 sec latency 11.350 ms 2020-04-02T23:30:41.761 INFO:tasks.workunit.client.0.smithi174.stdout: 1 574362 6.31 MB/sec execute 365 sec latency 10.864 ms 2020-04-02T23:30:42.761 INFO:tasks.workunit.client.0.smithi174.stdout: 1 575669 6.32 MB/sec execute 366 sec latency 10.986 ms 2020-04-02T23:30:43.761 INFO:tasks.workunit.client.0.smithi174.stdout: 1 576377 6.31 MB/sec execute 367 sec latency 11.987 ms 2020-04-02T23:30:44.761 INFO:tasks.workunit.client.0.smithi174.stdout: 1 577621 6.31 MB/sec execute 368 sec latency 39.849 ms 2020-04-02T23:30:45.761 INFO:tasks.workunit.client.0.smithi174.stdout: 1 578968 6.32 MB/sec execute 369 sec latency 11.091 ms 2020-04-02T23:30:46.761 INFO:tasks.workunit.client.0.smithi174.stdout: 1 579664 6.31 MB/sec execute 370 sec latency 10.153 ms 2020-04-02T23:30:47.761 INFO:tasks.workunit.client.0.smithi174.stdout: 1 580791 6.31 MB/sec execute 371 sec latency 10.906 ms 2020-04-02T23:30:48.761 INFO:tasks.workunit.client.0.smithi174.stdout: 1 582218 6.31 MB/sec execute 372 sec latency 11.590 ms 2020-04-02T23:30:49.761 INFO:tasks.workunit.client.0.smithi174.stdout: 1 583022 6.31 MB/sec execute 373 sec latency 29.585 ms 2020-04-02T23:30:50.761 INFO:tasks.workunit.client.0.smithi174.stdout: 1 584018 6.31 MB/sec execute 374 sec latency 11.712 ms 2020-04-02T23:30:51.761 INFO:tasks.workunit.client.0.smithi174.stdout: 1 585401 6.31 MB/sec execute 375 sec latency 9.402 ms 2020-04-02T23:30:52.761 INFO:tasks.workunit.client.0.smithi174.stdout: 1 586438 6.31 MB/sec execute 376 sec latency 12.024 ms 2020-04-02T23:30:53.761 INFO:tasks.workunit.client.0.smithi174.stdout: 1 587241 6.30 MB/sec execute 377 sec latency 15.241 ms 2020-04-02T23:30:54.761 INFO:tasks.workunit.client.0.smithi174.stdout: 1 588467 6.29 MB/sec execute 378 sec latency 39.021 ms 2020-04-02T23:30:55.761 INFO:tasks.workunit.client.0.smithi174.stdout: 1 589757 6.31 MB/sec execute 379 sec latency 16.002 ms 2020-04-02T23:30:56.761 INFO:tasks.workunit.client.0.smithi174.stdout: 1 590433 6.29 MB/sec execute 380 sec latency 10.749 ms 2020-04-02T23:30:57.761 INFO:tasks.workunit.client.0.smithi174.stdout: 1 591600 6.29 MB/sec execute 381 sec latency 12.240 ms 2020-04-02T23:30:58.761 INFO:tasks.workunit.client.0.smithi174.stdout: 1 592958 6.30 MB/sec execute 382 sec latency 14.327 ms 2020-04-02T23:30:59.108 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:30:59.123 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:30:59.165 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:30:59.179 INFO:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:30:59.761 INFO:tasks.workunit.client.0.smithi174.stdout: 1 593727 6.29 MB/sec execute 383 sec latency 9.630 ms 2020-04-02T23:31:00.761 INFO:tasks.workunit.client.0.smithi174.stdout: 1 594726 6.29 MB/sec execute 384 sec latency 12.782 ms 2020-04-02T23:31:01.761 INFO:tasks.workunit.client.0.smithi174.stdout: 1 596062 6.29 MB/sec execute 385 sec latency 13.525 ms 2020-04-02T23:31:02.761 INFO:tasks.workunit.client.0.smithi174.stdout: 1 597085 6.29 MB/sec execute 386 sec latency 13.554 ms 2020-04-02T23:31:03.762 INFO:tasks.workunit.client.0.smithi174.stdout: 1 597918 6.28 MB/sec execute 387 sec latency 13.965 ms 2020-04-02T23:31:04.761 INFO:tasks.workunit.client.0.smithi174.stdout: 1 599192 6.28 MB/sec execute 388 sec latency 10.105 ms 2020-04-02T23:31:05.761 INFO:tasks.workunit.client.0.smithi174.stdout: 1 600505 6.29 MB/sec execute 389 sec latency 8.427 ms 2020-04-02T23:31:06.761 INFO:tasks.workunit.client.0.smithi174.stdout: 1 601245 6.28 MB/sec execute 390 sec latency 10.773 ms 2020-04-02T23:31:07.761 INFO:tasks.workunit.client.0.smithi174.stdout: 1 602593 6.28 MB/sec execute 391 sec latency 9.678 ms 2020-04-02T23:31:08.761 INFO:tasks.workunit.client.0.smithi174.stdout: 1 603916 6.29 MB/sec execute 392 sec latency 10.306 ms 2020-04-02T23:31:09.761 INFO:tasks.workunit.client.0.smithi174.stdout: 1 604618 6.28 MB/sec execute 393 sec latency 11.583 ms 2020-04-02T23:31:10.761 INFO:tasks.workunit.client.0.smithi174.stdout: 1 605864 6.28 MB/sec execute 394 sec latency 13.040 ms 2020-04-02T23:31:11.761 INFO:tasks.workunit.client.0.smithi174.stdout: 1 607193 6.29 MB/sec execute 395 sec latency 11.557 ms 2020-04-02T23:31:12.761 INFO:tasks.workunit.client.0.smithi174.stdout: 1 607971 6.28 MB/sec execute 396 sec latency 9.096 ms 2020-04-02T23:31:13.762 INFO:tasks.workunit.client.0.smithi174.stdout: 1 609052 6.28 MB/sec execute 397 sec latency 14.490 ms 2020-04-02T23:31:14.762 INFO:tasks.workunit.client.0.smithi174.stdout: 1 610512 6.28 MB/sec execute 398 sec latency 11.305 ms 2020-04-02T23:31:15.762 INFO:tasks.workunit.client.0.smithi174.stdout: 1 611402 6.28 MB/sec execute 399 sec latency 12.910 ms 2020-04-02T23:31:16.762 INFO:tasks.workunit.client.0.smithi174.stdout: 1 612488 6.28 MB/sec execute 400 sec latency 15.411 ms 2020-04-02T23:31:17.762 INFO:tasks.workunit.client.0.smithi174.stdout: 1 613886 6.28 MB/sec execute 401 sec latency 9.847 ms 2020-04-02T23:31:18.762 INFO:tasks.workunit.client.0.smithi174.stdout: 1 614899 6.28 MB/sec execute 402 sec latency 9.810 ms 2020-04-02T23:31:19.762 INFO:tasks.workunit.client.0.smithi174.stdout: 1 615948 6.28 MB/sec execute 403 sec latency 10.092 ms 2020-04-02T23:31:20.762 INFO:tasks.workunit.client.0.smithi174.stdout: 1 617360 6.28 MB/sec execute 404 sec latency 9.473 ms 2020-04-02T23:31:21.762 INFO:tasks.workunit.client.0.smithi174.stdout: 1 618406 6.28 MB/sec execute 405 sec latency 9.860 ms 2020-04-02T23:31:22.762 INFO:tasks.workunit.client.0.smithi174.stdout: 1 619436 6.28 MB/sec execute 406 sec latency 10.577 ms 2020-04-02T23:31:23.762 INFO:tasks.workunit.client.0.smithi174.stdout: 1 620858 6.28 MB/sec execute 407 sec latency 11.960 ms 2020-04-02T23:31:24.762 INFO:tasks.workunit.client.0.smithi174.stdout: 1 621912 6.28 MB/sec execute 408 sec latency 10.301 ms 2020-04-02T23:31:25.762 INFO:tasks.workunit.client.0.smithi174.stdout: 1 622807 6.27 MB/sec execute 409 sec latency 12.181 ms 2020-04-02T23:31:26.763 INFO:tasks.workunit.client.0.smithi174.stdout: 1 624117 6.27 MB/sec execute 410 sec latency 11.151 ms 2020-04-02T23:31:27.762 INFO:tasks.workunit.client.0.smithi174.stdout: 1 625371 6.28 MB/sec execute 411 sec latency 11.732 ms 2020-04-02T23:31:28.762 INFO:tasks.workunit.client.0.smithi174.stdout: 1 626159 6.27 MB/sec execute 412 sec latency 11.580 ms 2020-04-02T23:31:29.287 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:31:29.304 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:31:29.346 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:31:29.362 INFO:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:31:29.762 INFO:tasks.workunit.client.0.smithi174.stdout: 1 627466 6.27 MB/sec execute 413 sec latency 10.003 ms 2020-04-02T23:31:30.762 INFO:tasks.workunit.client.0.smithi174.stdout: 1 628757 6.28 MB/sec execute 414 sec latency 11.549 ms 2020-04-02T23:31:31.762 INFO:tasks.workunit.client.0.smithi174.stdout: 1 629443 6.27 MB/sec execute 415 sec latency 11.345 ms 2020-04-02T23:31:32.762 INFO:tasks.workunit.client.0.smithi174.stdout: 1 630596 6.27 MB/sec execute 416 sec latency 10.677 ms 2020-04-02T23:31:33.762 INFO:tasks.workunit.client.0.smithi174.stdout: 1 631968 6.27 MB/sec execute 417 sec latency 16.718 ms 2020-04-02T23:31:34.762 INFO:tasks.workunit.client.0.smithi174.stdout: 1 632728 6.27 MB/sec execute 418 sec latency 54.220 ms 2020-04-02T23:31:35.764 INFO:tasks.workunit.client.0.smithi174.stdout: 1 633775 6.27 MB/sec execute 419 sec latency 12.386 ms 2020-04-02T23:31:36.762 INFO:tasks.workunit.client.0.smithi174.stdout: 1 635089 6.27 MB/sec execute 420 sec latency 12.089 ms 2020-04-02T23:31:37.762 INFO:tasks.workunit.client.0.smithi174.stdout: 1 636103 6.27 MB/sec execute 421 sec latency 11.049 ms 2020-04-02T23:31:38.762 INFO:tasks.workunit.client.0.smithi174.stdout: 1 636930 6.26 MB/sec execute 422 sec latency 14.452 ms 2020-04-02T23:31:39.762 INFO:tasks.workunit.client.0.smithi174.stdout: 1 638184 6.26 MB/sec execute 423 sec latency 11.010 ms 2020-04-02T23:31:40.762 INFO:tasks.workunit.client.0.smithi174.stdout: 1 639510 6.27 MB/sec execute 424 sec latency 10.489 ms 2020-04-02T23:31:41.762 INFO:tasks.workunit.client.0.smithi174.stdout: 1 640315 6.26 MB/sec execute 425 sec latency 11.084 ms 2020-04-02T23:31:42.762 INFO:tasks.workunit.client.0.smithi174.stdout: 1 641659 6.26 MB/sec execute 426 sec latency 8.706 ms 2020-04-02T23:31:43.762 INFO:tasks.workunit.client.0.smithi174.stdout: 1 643005 6.27 MB/sec execute 427 sec latency 12.973 ms 2020-04-02T23:31:44.763 INFO:tasks.workunit.client.0.smithi174.stdout: 1 643726 6.26 MB/sec execute 428 sec latency 10.027 ms 2020-04-02T23:31:45.763 INFO:tasks.workunit.client.0.smithi174.stdout: 1 645051 6.26 MB/sec execute 429 sec latency 10.430 ms 2020-04-02T23:31:46.763 INFO:tasks.workunit.client.0.smithi174.stdout: 1 646418 6.27 MB/sec execute 430 sec latency 12.278 ms 2020-04-02T23:31:47.763 INFO:tasks.workunit.client.0.smithi174.stdout: 1 647130 6.26 MB/sec execute 431 sec latency 10.330 ms 2020-04-02T23:31:48.763 INFO:tasks.workunit.client.0.smithi174.stdout: 1 648334 6.26 MB/sec execute 432 sec latency 8.878 ms 2020-04-02T23:31:49.763 INFO:tasks.workunit.client.0.smithi174.stdout: 1 649720 6.26 MB/sec execute 433 sec latency 11.156 ms 2020-04-02T23:31:50.763 INFO:tasks.workunit.client.0.smithi174.stdout: 1 650554 6.26 MB/sec execute 434 sec latency 8.693 ms 2020-04-02T23:31:51.763 INFO:tasks.workunit.client.0.smithi174.stdout: 1 651667 6.26 MB/sec execute 435 sec latency 13.645 ms 2020-04-02T23:31:52.763 INFO:tasks.workunit.client.0.smithi174.stdout: 1 653065 6.26 MB/sec execute 436 sec latency 13.693 ms 2020-04-02T23:31:53.763 INFO:tasks.workunit.client.0.smithi174.stdout: 1 653915 6.26 MB/sec execute 437 sec latency 11.017 ms 2020-04-02T23:31:54.763 INFO:tasks.workunit.client.0.smithi174.stdout: 1 654890 6.26 MB/sec execute 438 sec latency 14.633 ms 2020-04-02T23:31:55.763 INFO:tasks.workunit.client.0.smithi174.stdout: 1 656047 6.25 MB/sec execute 439 sec latency 11.576 ms 2020-04-02T23:31:56.763 INFO:tasks.workunit.client.0.smithi174.stdout: 1 657237 6.26 MB/sec execute 440 sec latency 56.506 ms 2020-04-02T23:31:57.763 INFO:tasks.workunit.client.0.smithi174.stdout: 1 657961 6.25 MB/sec execute 441 sec latency 12.706 ms 2020-04-02T23:31:58.763 INFO:tasks.workunit.client.0.smithi174.stdout: 1 659248 6.25 MB/sec execute 442 sec latency 11.914 ms 2020-04-02T23:31:59.467 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:31:59.482 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:31:59.525 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:31:59.539 INFO:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:31:59.730 INFO:tasks.ceph.mds.b.smithi196.stderr:2020-04-02T23:31:59.727+0000 7f90d48d2700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 25431) UID: 0 2020-04-02T23:31:59.763 INFO:tasks.workunit.client.0.smithi174.stdout: 1 660528 6.26 MB/sec execute 443 sec latency 14.870 ms 2020-04-02T23:32:00.763 INFO:tasks.workunit.client.0.smithi174.stdout: 1 661227 6.25 MB/sec execute 444 sec latency 12.885 ms 2020-04-02T23:32:01.763 INFO:tasks.workunit.client.0.smithi174.stdout: 1 662225 6.25 MB/sec execute 445 sec latency 13.070 ms 2020-04-02T23:32:02.763 INFO:tasks.workunit.client.0.smithi174.stdout: 1 663529 6.25 MB/sec execute 446 sec latency 15.428 ms 2020-04-02T23:32:03.763 INFO:tasks.workunit.client.0.smithi174.stdout: 1 664484 6.25 MB/sec execute 447 sec latency 17.631 ms 2020-04-02T23:32:04.763 INFO:tasks.workunit.client.0.smithi174.stdout: 1 665284 6.24 MB/sec execute 448 sec latency 15.632 ms 2020-04-02T23:32:05.763 INFO:tasks.workunit.client.0.smithi174.stdout: 1 666513 6.24 MB/sec execute 449 sec latency 13.071 ms 2020-04-02T23:32:06.763 INFO:tasks.workunit.client.0.smithi174.stdout: 1 667824 6.25 MB/sec execute 450 sec latency 18.108 ms 2020-04-02T23:32:07.763 INFO:tasks.workunit.client.0.smithi174.stdout: 1 668357 6.24 MB/sec execute 451 sec latency 41.500 ms 2020-04-02T23:32:08.763 INFO:tasks.workunit.client.0.smithi174.stdout: 1 669401 6.23 MB/sec execute 452 sec latency 14.326 ms 2020-04-02T23:32:09.763 INFO:tasks.workunit.client.0.smithi174.stdout: 1 670640 6.24 MB/sec execute 453 sec latency 13.419 ms 2020-04-02T23:32:10.763 INFO:tasks.workunit.client.0.smithi174.stdout: 1 671582 6.24 MB/sec execute 454 sec latency 11.453 ms 2020-04-02T23:32:11.763 INFO:tasks.workunit.client.0.smithi174.stdout: 1 672375 6.23 MB/sec execute 455 sec latency 21.679 ms 2020-04-02T23:32:12.763 INFO:tasks.workunit.client.0.smithi174.stdout: 1 673616 6.22 MB/sec execute 456 sec latency 11.882 ms 2020-04-02T23:32:13.763 INFO:tasks.workunit.client.0.smithi174.stdout: 1 674844 6.23 MB/sec execute 457 sec latency 15.436 ms 2020-04-02T23:32:14.763 INFO:tasks.workunit.client.0.smithi174.stdout: 1 675488 6.22 MB/sec execute 458 sec latency 11.595 ms 2020-04-02T23:32:15.763 INFO:tasks.workunit.client.0.smithi174.stdout: 1 676461 6.22 MB/sec execute 459 sec latency 14.698 ms 2020-04-02T23:32:16.764 INFO:tasks.workunit.client.0.smithi174.stdout: 1 677698 6.22 MB/sec execute 460 sec latency 14.825 ms 2020-04-02T23:32:17.764 INFO:tasks.workunit.client.0.smithi174.stdout: 1 678687 6.22 MB/sec execute 461 sec latency 12.306 ms 2020-04-02T23:32:18.764 INFO:tasks.workunit.client.0.smithi174.stdout: 1 679493 6.22 MB/sec execute 462 sec latency 16.210 ms 2020-04-02T23:32:19.764 INFO:tasks.workunit.client.0.smithi174.stdout: 1 680742 6.21 MB/sec execute 463 sec latency 12.276 ms 2020-04-02T23:32:20.764 INFO:tasks.workunit.client.0.smithi174.stdout: 1 682055 6.23 MB/sec execute 464 sec latency 16.910 ms 2020-04-02T23:32:21.764 INFO:tasks.workunit.client.0.smithi174.stdout: 1 682725 6.21 MB/sec execute 465 sec latency 11.134 ms 2020-04-02T23:32:22.764 INFO:tasks.workunit.client.0.smithi174.stdout: 1 683921 6.21 MB/sec execute 466 sec latency 11.822 ms 2020-04-02T23:32:23.764 INFO:tasks.workunit.client.0.smithi174.stdout: 1 685217 6.22 MB/sec execute 467 sec latency 13.426 ms 2020-04-02T23:32:24.764 INFO:tasks.workunit.client.0.smithi174.stdout: 1 685995 6.21 MB/sec execute 468 sec latency 9.354 ms 2020-04-02T23:32:25.764 INFO:tasks.workunit.client.0.smithi174.stdout: 1 686997 6.21 MB/sec execute 469 sec latency 17.933 ms 2020-04-02T23:32:26.764 INFO:tasks.workunit.client.0.smithi174.stdout: 1 688297 6.21 MB/sec execute 470 sec latency 13.436 ms 2020-04-02T23:32:27.764 INFO:tasks.workunit.client.0.smithi174.stdout: 1 689285 6.21 MB/sec execute 471 sec latency 12.314 ms 2020-04-02T23:32:28.764 INFO:tasks.workunit.client.0.smithi174.stdout: 1 690057 6.21 MB/sec execute 472 sec latency 16.300 ms 2020-04-02T23:32:29.764 INFO:tasks.workunit.client.0.smithi174.stdout: 1 691346 6.20 MB/sec execute 473 sec latency 12.895 ms 2020-04-02T23:32:30.764 INFO:tasks.workunit.client.0.smithi174.stdout: 1 692588 6.21 MB/sec execute 474 sec latency 15.177 ms 2020-04-02T23:32:31.764 INFO:tasks.workunit.client.0.smithi174.stdout: 1 693215 6.20 MB/sec execute 475 sec latency 12.711 ms 2020-04-02T23:32:32.764 INFO:tasks.workunit.client.0.smithi174.stdout: 1 694267 6.20 MB/sec execute 476 sec latency 14.126 ms 2020-04-02T23:32:33.764 INFO:tasks.workunit.client.0.smithi174.stdout: 1 695496 6.20 MB/sec execute 477 sec latency 13.549 ms 2020-04-02T23:32:34.764 INFO:tasks.workunit.client.0.smithi174.stdout: 1 696433 6.20 MB/sec execute 478 sec latency 48.608 ms 2020-04-02T23:32:35.764 INFO:tasks.workunit.client.0.smithi174.stdout: 1 697217 6.19 MB/sec execute 479 sec latency 12.860 ms 2020-04-02T23:32:36.764 INFO:tasks.workunit.client.0.smithi174.stdout: 1 698463 6.19 MB/sec execute 480 sec latency 10.361 ms 2020-04-02T23:32:37.767 INFO:tasks.workunit.client.0.smithi174.stdout: 1 699719 6.20 MB/sec execute 481 sec latency 14.422 ms 2020-04-02T23:32:38.764 INFO:tasks.workunit.client.0.smithi174.stdout: 1 700372 6.19 MB/sec execute 482 sec latency 13.719 ms 2020-04-02T23:32:39.764 INFO:tasks.workunit.client.0.smithi174.stdout: 1 701470 6.19 MB/sec execute 483 sec latency 13.877 ms 2020-04-02T23:32:40.764 INFO:tasks.workunit.client.0.smithi174.stdout: 1 702824 6.19 MB/sec execute 484 sec latency 13.466 ms 2020-04-02T23:32:41.764 INFO:tasks.workunit.client.0.smithi174.stdout: 1 703597 6.19 MB/sec execute 485 sec latency 18.244 ms 2020-04-02T23:32:42.764 INFO:tasks.workunit.client.0.smithi174.stdout: 1 704515 6.19 MB/sec execute 486 sec latency 13.709 ms 2020-04-02T23:32:43.764 INFO:tasks.workunit.client.0.smithi174.stdout: 1 705621 6.18 MB/sec execute 487 sec latency 21.507 ms 2020-04-02T23:32:44.764 INFO:tasks.workunit.client.0.smithi174.stdout: 1 706846 6.19 MB/sec execute 488 sec latency 57.209 ms 2020-04-02T23:32:45.764 INFO:tasks.workunit.client.0.smithi174.stdout: 1 707471 6.18 MB/sec execute 489 sec latency 11.235 ms 2020-04-02T23:32:46.764 INFO:tasks.workunit.client.0.smithi174.stdout: 1 708589 6.18 MB/sec execute 490 sec latency 13.932 ms 2020-04-02T23:32:47.764 INFO:tasks.workunit.client.0.smithi174.stdout: 1 709947 6.19 MB/sec execute 491 sec latency 13.738 ms 2020-04-02T23:32:48.764 INFO:tasks.workunit.client.0.smithi174.stdout: 1 710686 6.18 MB/sec execute 492 sec latency 11.676 ms 2020-04-02T23:32:49.765 INFO:tasks.workunit.client.0.smithi174.stdout: 1 711614 6.18 MB/sec execute 493 sec latency 14.039 ms 2020-04-02T23:32:50.765 INFO:tasks.workunit.client.0.smithi174.stdout: 1 712729 6.17 MB/sec execute 494 sec latency 14.085 ms 2020-04-02T23:32:51.765 INFO:tasks.workunit.client.0.smithi174.stdout: 1 713984 6.18 MB/sec execute 495 sec latency 14.182 ms 2020-04-02T23:32:52.765 INFO:tasks.workunit.client.0.smithi174.stdout: 1 714637 6.17 MB/sec execute 496 sec latency 13.591 ms 2020-04-02T23:32:53.765 INFO:tasks.workunit.client.0.smithi174.stdout: 1 715691 6.17 MB/sec execute 497 sec latency 19.808 ms 2020-04-02T23:32:54.765 INFO:tasks.workunit.client.0.smithi174.stdout: 1 717023 6.17 MB/sec execute 498 sec latency 15.121 ms 2020-04-02T23:32:55.765 INFO:tasks.workunit.client.0.smithi174.stdout: 1 717768 6.17 MB/sec execute 499 sec latency 10.972 ms 2020-04-02T23:32:56.765 INFO:tasks.workunit.client.0.smithi174.stdout: 1 718564 6.16 MB/sec execute 500 sec latency 15.041 ms 2020-04-02T23:32:57.765 INFO:tasks.workunit.client.0.smithi174.stdout: 1 719754 6.16 MB/sec execute 501 sec latency 14.562 ms 2020-04-02T23:32:58.765 INFO:tasks.workunit.client.0.smithi174.stdout: 1 720967 6.17 MB/sec execute 502 sec latency 17.262 ms 2020-04-02T23:32:59.765 INFO:tasks.workunit.client.0.smithi174.stdout: 1 721540 6.16 MB/sec execute 503 sec latency 13.985 ms 2020-04-02T23:33:00.765 INFO:tasks.workunit.client.0.smithi174.stdout: 1 722499 6.16 MB/sec execute 504 sec latency 12.057 ms 2020-04-02T23:33:01.765 INFO:tasks.workunit.client.0.smithi174.stdout: 1 723755 6.16 MB/sec execute 505 sec latency 13.324 ms 2020-04-02T23:33:02.765 INFO:tasks.workunit.client.0.smithi174.stdout: 1 724703 6.16 MB/sec execute 506 sec latency 13.816 ms 2020-04-02T23:33:03.765 INFO:tasks.workunit.client.0.smithi174.stdout: 1 725307 6.15 MB/sec execute 507 sec latency 25.945 ms 2020-04-02T23:33:04.765 INFO:tasks.workunit.client.0.smithi174.stdout: 1 726383 6.15 MB/sec execute 508 sec latency 19.427 ms 2020-04-02T23:33:05.765 INFO:tasks.workunit.client.0.smithi174.stdout: 1 727676 6.15 MB/sec execute 509 sec latency 15.626 ms 2020-04-02T23:33:06.765 INFO:tasks.workunit.client.0.smithi174.stdout: 1 728373 6.15 MB/sec execute 510 sec latency 12.215 ms 2020-04-02T23:33:07.765 INFO:tasks.workunit.client.0.smithi174.stdout: 1 729078 6.14 MB/sec execute 511 sec latency 18.249 ms 2020-04-02T23:33:08.765 INFO:tasks.workunit.client.0.smithi174.stdout: 1 730290 6.14 MB/sec execute 512 sec latency 18.385 ms 2020-04-02T23:33:09.765 INFO:tasks.workunit.client.0.smithi174.stdout: 1 731456 6.15 MB/sec execute 513 sec latency 24.358 ms 2020-04-02T23:33:10.765 INFO:tasks.workunit.client.0.smithi174.stdout: 1 732065 6.14 MB/sec execute 514 sec latency 11.937 ms 2020-04-02T23:33:11.765 INFO:tasks.workunit.client.0.smithi174.stdout: 1 732991 6.14 MB/sec execute 515 sec latency 17.277 ms 2020-04-02T23:33:12.765 INFO:tasks.workunit.client.0.smithi174.stdout: 1 734212 6.14 MB/sec execute 516 sec latency 11.908 ms 2020-04-02T23:33:13.769 INFO:tasks.workunit.client.0.smithi174.stdout: 1 735309 6.14 MB/sec execute 517 sec latency 13.566 ms 2020-04-02T23:33:14.766 INFO:tasks.workunit.client.0.smithi174.stdout: 1 736027 6.13 MB/sec execute 518 sec latency 11.739 ms 2020-04-02T23:33:15.765 INFO:tasks.workunit.client.0.smithi174.stdout: 1 737249 6.13 MB/sec execute 519 sec latency 14.407 ms 2020-04-02T23:33:16.765 INFO:tasks.workunit.client.0.smithi174.stdout: 1 738573 6.14 MB/sec execute 520 sec latency 14.975 ms 2020-04-02T23:33:17.765 INFO:tasks.workunit.client.0.smithi174.stdout: 1 739195 6.13 MB/sec execute 521 sec latency 11.370 ms 2020-04-02T23:33:18.765 INFO:tasks.workunit.client.0.smithi174.stdout: 1 740211 6.13 MB/sec execute 522 sec latency 11.985 ms 2020-04-02T23:33:19.765 INFO:tasks.workunit.client.0.smithi174.stdout: 1 741348 6.13 MB/sec execute 523 sec latency 74.007 ms 2020-04-02T23:33:20.765 INFO:tasks.workunit.client.0.smithi174.stdout: 1 742424 6.13 MB/sec execute 524 sec latency 12.574 ms 2020-04-02T23:33:21.765 INFO:tasks.workunit.client.0.smithi174.stdout: 1 743156 6.12 MB/sec execute 525 sec latency 12.060 ms 2020-04-02T23:33:22.765 INFO:tasks.workunit.client.0.smithi174.stdout: 1 744349 6.12 MB/sec execute 526 sec latency 13.712 ms 2020-04-02T23:33:23.766 INFO:tasks.workunit.client.0.smithi174.stdout: 1 745638 6.13 MB/sec execute 527 sec latency 14.075 ms 2020-04-02T23:33:24.766 INFO:tasks.workunit.client.0.smithi174.stdout: 1 746285 6.12 MB/sec execute 528 sec latency 10.787 ms 2020-04-02T23:33:25.766 INFO:tasks.workunit.client.0.smithi174.stdout: 1 747288 6.12 MB/sec execute 529 sec latency 12.894 ms 2020-04-02T23:33:26.769 INFO:tasks.workunit.client.0.smithi174.stdout: 1 748588 6.12 MB/sec execute 530 sec latency 12.614 ms 2020-04-02T23:33:27.766 INFO:tasks.workunit.client.0.smithi174.stdout: 1 749562 6.12 MB/sec execute 531 sec latency 14.973 ms 2020-04-02T23:33:28.766 INFO:tasks.workunit.client.0.smithi174.stdout: 1 750222 6.11 MB/sec execute 532 sec latency 16.741 ms 2020-04-02T23:33:29.766 INFO:tasks.workunit.client.0.smithi174.stdout: 1 751441 6.11 MB/sec execute 533 sec latency 13.222 ms 2020-04-02T23:33:30.766 INFO:tasks.workunit.client.0.smithi174.stdout: 1 752709 6.12 MB/sec execute 534 sec latency 14.598 ms 2020-04-02T23:33:31.766 INFO:tasks.workunit.client.0.smithi174.stdout: 1 753351 6.11 MB/sec execute 535 sec latency 11.298 ms 2020-04-02T23:33:32.766 INFO:tasks.workunit.client.0.smithi174.stdout: 1 754277 6.11 MB/sec execute 536 sec latency 15.002 ms 2020-04-02T23:33:33.769 INFO:tasks.workunit.client.0.smithi174.stdout: 1 755368 6.11 MB/sec execute 537 sec latency 19.551 ms 2020-04-02T23:33:34.766 INFO:tasks.workunit.client.0.smithi174.stdout: 1 756558 6.12 MB/sec execute 538 sec latency 15.031 ms 2020-04-02T23:33:35.766 INFO:tasks.workunit.client.0.smithi174.stdout: 1 757191 6.11 MB/sec execute 539 sec latency 14.262 ms 2020-04-02T23:33:36.766 INFO:tasks.workunit.client.0.smithi174.stdout: 1 758282 6.10 MB/sec execute 540 sec latency 14.724 ms 2020-04-02T23:33:37.766 INFO:tasks.workunit.client.0.smithi174.stdout: 1 759513 6.11 MB/sec execute 541 sec latency 16.070 ms 2020-04-02T23:33:38.766 INFO:tasks.workunit.client.0.smithi174.stdout: 1 760305 6.11 MB/sec execute 542 sec latency 13.884 ms 2020-04-02T23:33:39.766 INFO:tasks.workunit.client.0.smithi174.stdout: 1 761063 6.10 MB/sec execute 543 sec latency 14.790 ms 2020-04-02T23:33:40.766 INFO:tasks.workunit.client.0.smithi174.stdout: 1 762301 6.10 MB/sec execute 544 sec latency 10.814 ms 2020-04-02T23:33:41.766 INFO:tasks.workunit.client.0.smithi174.stdout: 1 763573 6.11 MB/sec execute 545 sec latency 14.234 ms 2020-04-02T23:33:42.766 INFO:tasks.workunit.client.0.smithi174.stdout: 1 764199 6.10 MB/sec execute 546 sec latency 15.189 ms 2020-04-02T23:33:43.766 INFO:tasks.workunit.client.0.smithi174.stdout: 1 765240 6.09 MB/sec execute 547 sec latency 27.994 ms 2020-04-02T23:33:44.766 INFO:tasks.workunit.client.0.smithi174.stdout: 1 766425 6.10 MB/sec execute 548 sec latency 13.578 ms 2020-04-02T23:33:45.766 INFO:tasks.workunit.client.0.smithi174.stdout: 1 767376 6.10 MB/sec execute 549 sec latency 10.252 ms 2020-04-02T23:33:46.766 INFO:tasks.workunit.client.0.smithi174.stdout: 1 768145 6.09 MB/sec execute 550 sec latency 13.995 ms 2020-04-02T23:33:47.766 INFO:tasks.workunit.client.0.smithi174.stdout: 1 769387 6.09 MB/sec execute 551 sec latency 12.357 ms 2020-04-02T23:33:48.766 INFO:tasks.workunit.client.0.smithi174.stdout: 1 770639 6.10 MB/sec execute 552 sec latency 13.212 ms 2020-04-02T23:33:49.767 INFO:tasks.workunit.client.0.smithi174.stdout: 1 771221 6.09 MB/sec execute 553 sec latency 40.994 ms 2020-04-02T23:33:50.766 INFO:tasks.workunit.client.0.smithi174.stdout: 1 772211 6.09 MB/sec execute 554 sec latency 18.819 ms 2020-04-02T23:33:51.766 INFO:tasks.workunit.client.0.smithi174.stdout: 1 773468 6.09 MB/sec execute 555 sec latency 13.664 ms 2020-04-02T23:33:52.766 INFO:tasks.workunit.client.0.smithi174.stdout: 1 774429 6.09 MB/sec execute 556 sec latency 12.289 ms 2020-04-02T23:33:53.766 INFO:tasks.workunit.client.0.smithi174.stdout: 1 775179 6.08 MB/sec execute 557 sec latency 22.817 ms 2020-04-02T23:33:54.766 INFO:tasks.workunit.client.0.smithi174.stdout: 1 776438 6.08 MB/sec execute 558 sec latency 31.582 ms 2020-04-02T23:33:55.766 INFO:tasks.workunit.client.0.smithi174.stdout: 1 777709 6.09 MB/sec execute 559 sec latency 13.006 ms 2020-04-02T23:33:56.767 INFO:tasks.workunit.client.0.smithi174.stdout: 1 778345 6.08 MB/sec execute 560 sec latency 10.636 ms 2020-04-02T23:33:57.767 INFO:tasks.workunit.client.0.smithi174.stdout: 1 779430 6.08 MB/sec execute 561 sec latency 17.433 ms 2020-04-02T23:33:58.767 INFO:tasks.workunit.client.0.smithi174.stdout: 1 780777 6.08 MB/sec execute 562 sec latency 19.671 ms 2020-04-02T23:33:59.767 INFO:tasks.workunit.client.0.smithi174.stdout: 1 781572 6.08 MB/sec execute 563 sec latency 13.894 ms 2020-04-02T23:34:00.770 INFO:tasks.workunit.client.0.smithi174.stdout: 1 782357 6.07 MB/sec execute 564 sec latency 13.373 ms 2020-04-02T23:34:01.767 INFO:tasks.workunit.client.0.smithi174.stdout: 1 783600 6.07 MB/sec execute 565 sec latency 9.760 ms 2020-04-02T23:34:02.767 INFO:tasks.workunit.client.0.smithi174.stdout: 1 784912 6.08 MB/sec execute 566 sec latency 12.208 ms 2020-04-02T23:34:03.773 INFO:tasks.workunit.client.0.smithi174.stdout: 1 785590 6.07 MB/sec execute 567 sec latency 23.260 ms 2020-04-02T23:34:04.767 INFO:tasks.workunit.client.0.smithi174.stdout: 1 786793 6.07 MB/sec execute 568 sec latency 14.110 ms 2020-04-02T23:34:05.767 INFO:tasks.workunit.client.0.smithi174.stdout: 1 788052 6.08 MB/sec execute 569 sec latency 14.450 ms 2020-04-02T23:34:06.767 INFO:tasks.workunit.client.0.smithi174.stdout: 1 788795 6.07 MB/sec execute 570 sec latency 12.238 ms 2020-04-02T23:34:07.767 INFO:tasks.workunit.client.0.smithi174.stdout: 1 789758 6.07 MB/sec execute 571 sec latency 13.802 ms 2020-04-02T23:34:08.767 INFO:tasks.workunit.client.0.smithi174.stdout: 1 790996 6.07 MB/sec execute 572 sec latency 14.890 ms 2020-04-02T23:34:09.773 INFO:tasks.workunit.client.0.smithi174.stdout: 1 792076 6.08 MB/sec execute 573 sec latency 12.436 ms 2020-04-02T23:34:10.767 INFO:tasks.workunit.client.0.smithi174.stdout: 1 792759 6.07 MB/sec execute 574 sec latency 10.182 ms 2020-04-02T23:34:11.767 INFO:tasks.workunit.client.0.smithi174.stdout: 1 793978 6.06 MB/sec execute 575 sec latency 15.971 ms 2020-04-02T23:34:12.767 INFO:tasks.workunit.client.0.smithi174.stdout: 1 795269 6.07 MB/sec execute 576 sec latency 16.023 ms 2020-04-02T23:34:13.767 INFO:tasks.workunit.client.0.smithi174.stdout: 1 795908 6.07 MB/sec execute 577 sec latency 24.608 ms 2020-04-02T23:34:14.767 INFO:tasks.workunit.client.0.smithi174.stdout: 1 796879 6.07 MB/sec execute 578 sec latency 14.337 ms 2020-04-02T23:34:15.767 INFO:tasks.workunit.client.0.smithi174.stdout: 1 798098 6.06 MB/sec execute 579 sec latency 15.080 ms 2020-04-02T23:34:16.768 INFO:tasks.workunit.client.0.smithi174.stdout: 1 799174 6.07 MB/sec execute 580 sec latency 14.167 ms 2020-04-02T23:34:17.767 INFO:tasks.workunit.client.0.smithi174.stdout: 1 799842 6.06 MB/sec execute 581 sec latency 15.813 ms 2020-04-02T23:34:18.767 INFO:tasks.workunit.client.0.smithi174.stdout: 1 801042 6.06 MB/sec execute 582 sec latency 15.208 ms 2020-04-02T23:34:19.769 INFO:tasks.workunit.client.0.smithi174.stdout: 1 802239 6.06 MB/sec execute 583 sec latency 14.101 ms 2020-04-02T23:34:20.767 INFO:tasks.workunit.client.0.smithi174.stdout: 1 802988 6.06 MB/sec execute 584 sec latency 11.480 ms 2020-04-02T23:34:21.767 INFO:tasks.workunit.client.0.smithi174.stdout: 1 803922 6.06 MB/sec execute 585 sec latency 13.284 ms 2020-04-02T23:34:22.767 INFO:tasks.workunit.client.0.smithi174.stdout: 1 805170 6.06 MB/sec execute 586 sec latency 13.901 ms 2020-04-02T23:34:23.767 INFO:tasks.workunit.client.0.smithi174.stdout: 1 806241 6.06 MB/sec execute 587 sec latency 23.499 ms 2020-04-02T23:34:24.768 INFO:tasks.workunit.client.0.smithi174.stdout: 1 806869 6.05 MB/sec execute 588 sec latency 67.731 ms 2020-04-02T23:34:25.767 INFO:tasks.workunit.client.0.smithi174.stdout: 1 808014 6.05 MB/sec execute 589 sec latency 13.501 ms 2020-04-02T23:34:26.767 INFO:tasks.workunit.client.0.smithi174.stdout: 1 809296 6.05 MB/sec execute 590 sec latency 9.762 ms 2020-04-02T23:34:27.767 INFO:tasks.workunit.client.0.smithi174.stdout: 1 810050 6.05 MB/sec execute 591 sec latency 10.746 ms 2020-04-02T23:34:28.767 INFO:tasks.workunit.client.0.smithi174.stdout: 1 810953 6.05 MB/sec execute 592 sec latency 19.476 ms 2020-04-02T23:34:29.769 INFO:tasks.workunit.client.0.smithi174.stdout: 1 812088 6.05 MB/sec execute 593 sec latency 13.639 ms 2020-04-02T23:34:30.691 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:34:30.706 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:34:30.752 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:34:30.775 INFO:tasks.workunit.client.0.smithi174.stdout: 1 813308 6.05 MB/sec execute 594 sec latency 12.796 ms 2020-04-02T23:34:30.776 INFO:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:34:31.768 INFO:tasks.workunit.client.0.smithi174.stdout: 1 814003 6.05 MB/sec execute 595 sec latency 13.073 ms 2020-04-02T23:34:32.767 INFO:tasks.workunit.client.0.smithi174.stdout: 1 815231 6.04 MB/sec execute 596 sec latency 10.116 ms 2020-04-02T23:34:33.768 INFO:tasks.workunit.client.0.smithi174.stdout: 1 816435 6.05 MB/sec execute 597 sec latency 16.256 ms 2020-04-02T23:34:34.768 INFO:tasks.workunit.client.0.smithi174.stdout: 1 817194 6.05 MB/sec execute 598 sec latency 9.279 ms 2020-04-02T23:34:35.773 INFO:tasks.workunit.client.0.smithi174.stdout: 1 818231 6.04 MB/sec execute 599 sec latency 13.354 ms 2020-04-02T23:34:36.768 INFO:tasks.workunit.client.0.smithi174.stdout: 1 cleanup 600 sec 2020-04-02T23:34:37.146 INFO:tasks.workunit.client.0.smithi174.stdout: 0 cleanup 600 sec 2020-04-02T23:34:37.147 INFO:tasks.workunit.client.0.smithi174.stdout: 2020-04-02T23:34:37.147 INFO:tasks.workunit.client.0.smithi174.stdout: Operation Count AvgLat MaxLat 2020-04-02T23:34:37.147 INFO:tasks.workunit.client.0.smithi174.stdout: ---------------------------------------- 2020-04-02T23:34:37.147 INFO:tasks.workunit.client.0.smithi174.stdout: NTCreateX 115745 2.050 87.306 2020-04-02T23:34:37.147 INFO:tasks.workunit.client.0.smithi174.stdout: Close 85045 0.043 4.107 2020-04-02T23:34:37.147 INFO:tasks.workunit.client.0.smithi174.stdout: Rename 4905 7.164 57.750 2020-04-02T23:34:37.147 INFO:tasks.workunit.client.0.smithi174.stdout: Unlink 23353 2.446 77.256 2020-04-02T23:34:37.148 INFO:tasks.workunit.client.0.smithi174.stdout: Deltree 2 147.315 275.145 2020-04-02T23:34:37.148 INFO:tasks.workunit.client.0.smithi174.stdout: Mkdir 1 0.204 0.204 2020-04-02T23:34:37.148 INFO:tasks.workunit.client.0.smithi174.stdout: Qpathinfo 104982 1.460 74.004 2020-04-02T23:34:37.148 INFO:tasks.workunit.client.0.smithi174.stdout: Qfileinfo 18378 0.057 1.501 2020-04-02T23:34:37.148 INFO:tasks.workunit.client.0.smithi174.stdout: Qfsinfo 19226 0.309 5.033 2020-04-02T23:34:37.148 INFO:tasks.workunit.client.0.smithi174.stdout: Sfileinfo 9439 0.734 38.495 2020-04-02T23:34:37.148 INFO:tasks.workunit.client.0.smithi174.stdout: Find 40560 1.203 69.772 2020-04-02T23:34:37.149 INFO:tasks.workunit.client.0.smithi174.stdout: WriteX 57570 0.350 3.613 2020-04-02T23:34:37.149 INFO:tasks.workunit.client.0.smithi174.stdout: ReadX 181522 0.003 1.168 2020-04-02T23:34:37.149 INFO:tasks.workunit.client.0.smithi174.stdout: LockX 378 0.597 0.976 2020-04-02T23:34:37.149 INFO:tasks.workunit.client.0.smithi174.stdout: UnlockX 378 0.454 0.746 2020-04-02T23:34:37.149 INFO:tasks.workunit.client.0.smithi174.stdout: Flush 8104 3.457 47.240 2020-04-02T23:34:37.149 INFO:tasks.workunit.client.0.smithi174.stdout: 2020-04-02T23:34:37.149 INFO:tasks.workunit.client.0.smithi174.stdout:Throughput 6.04428 MB/sec 1 clients 1 procs max_latency=158.558 ms 2020-04-02T23:34:37.150 INFO:tasks.workunit.client.0.smithi174.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2020-04-02T23:34:37.150 INFO:tasks.workunit.client.0.smithi174.stdout: 2020-04-02T23:34:37.150 INFO:tasks.workunit.client.0.smithi174.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2020-04-02T23:34:37.150 INFO:tasks.workunit.client.0.smithi174.stdout:8 of 10 processes prepared for launch 0 sec 2020-04-02T23:34:37.248 INFO:tasks.workunit.client.0.smithi174.stdout:10 of 10 processes prepared for launch 0 sec 2020-04-02T23:34:37.248 INFO:tasks.workunit.client.0.smithi174.stdout:releasing clients 2020-04-02T23:34:38.248 INFO:tasks.workunit.client.0.smithi174.stdout: 10 152 64.33 MB/sec warmup 1 sec latency 39.687 ms 2020-04-02T23:34:39.248 INFO:tasks.workunit.client.0.smithi174.stdout: 10 298 54.99 MB/sec warmup 2 sec latency 43.984 ms 2020-04-02T23:34:40.248 INFO:tasks.workunit.client.0.smithi174.stdout: 10 444 52.07 MB/sec warmup 3 sec latency 40.460 ms 2020-04-02T23:34:41.248 INFO:tasks.workunit.client.0.smithi174.stdout: 10 623 52.52 MB/sec warmup 4 sec latency 41.037 ms 2020-04-02T23:34:42.248 INFO:tasks.workunit.client.0.smithi174.stdout: 10 833 43.07 MB/sec warmup 5 sec latency 60.234 ms 2020-04-02T23:34:43.248 INFO:tasks.workunit.client.0.smithi174.stdout: 10 1062 37.99 MB/sec warmup 6 sec latency 52.203 ms 2020-04-02T23:34:44.248 INFO:tasks.workunit.client.0.smithi174.stdout: 10 1258 33.39 MB/sec warmup 7 sec latency 132.031 ms 2020-04-02T23:34:45.253 INFO:tasks.workunit.client.0.smithi174.stdout: 10 1541 32.63 MB/sec warmup 8 sec latency 97.827 ms 2020-04-02T23:34:46.248 INFO:tasks.workunit.client.0.smithi174.stdout: 10 1790 29.24 MB/sec warmup 9 sec latency 77.367 ms 2020-04-02T23:34:47.248 INFO:tasks.workunit.client.0.smithi174.stdout: 10 2064 26.61 MB/sec warmup 10 sec latency 31.256 ms 2020-04-02T23:34:48.248 INFO:tasks.workunit.client.0.smithi174.stdout: 10 2337 25.24 MB/sec warmup 11 sec latency 46.343 ms 2020-04-02T23:34:49.248 INFO:tasks.workunit.client.0.smithi174.stdout: 10 2564 24.29 MB/sec warmup 12 sec latency 64.953 ms 2020-04-02T23:34:50.248 INFO:tasks.workunit.client.0.smithi174.stdout: 10 2940 25.60 MB/sec warmup 13 sec latency 53.065 ms 2020-04-02T23:34:51.248 INFO:tasks.workunit.client.0.smithi174.stdout: 10 3289 25.14 MB/sec warmup 14 sec latency 87.066 ms 2020-04-02T23:34:52.248 INFO:tasks.workunit.client.0.smithi174.stdout: 10 3573 25.65 MB/sec warmup 15 sec latency 35.152 ms 2020-04-02T23:34:53.248 INFO:tasks.workunit.client.0.smithi174.stdout: 10 3763 24.66 MB/sec warmup 16 sec latency 134.424 ms 2020-04-02T23:34:54.248 INFO:tasks.workunit.client.0.smithi174.stdout: 10 3872 23.44 MB/sec warmup 17 sec latency 99.544 ms 2020-04-02T23:34:55.248 INFO:tasks.workunit.client.0.smithi174.stdout: 10 3993 22.26 MB/sec warmup 18 sec latency 82.530 ms 2020-04-02T23:34:56.248 INFO:tasks.workunit.client.0.smithi174.stdout: 10 4138 21.13 MB/sec warmup 19 sec latency 40.769 ms 2020-04-02T23:34:57.248 INFO:tasks.workunit.client.0.smithi174.stdout: 10 4298 20.21 MB/sec warmup 20 sec latency 63.723 ms 2020-04-02T23:34:58.248 INFO:tasks.workunit.client.0.smithi174.stdout: 10 4471 19.49 MB/sec warmup 21 sec latency 97.295 ms 2020-04-02T23:34:59.248 INFO:tasks.workunit.client.0.smithi174.stdout: 10 4701 19.24 MB/sec warmup 22 sec latency 57.763 ms 2020-04-02T23:35:00.248 INFO:tasks.workunit.client.0.smithi174.stdout: 10 4972 19.26 MB/sec warmup 23 sec latency 51.667 ms 2020-04-02T23:35:00.887 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:35:00.903 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:35:00.945 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:35:00.960 INFO:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:35:01.248 INFO:tasks.workunit.client.0.smithi174.stdout: 10 5193 18.87 MB/sec warmup 24 sec latency 60.829 ms 2020-04-02T23:35:02.248 INFO:tasks.workunit.client.0.smithi174.stdout: 10 5427 18.20 MB/sec warmup 25 sec latency 49.691 ms 2020-04-02T23:35:03.248 INFO:tasks.workunit.client.0.smithi174.stdout: 10 5698 17.71 MB/sec warmup 26 sec latency 61.256 ms 2020-04-02T23:35:04.248 INFO:tasks.workunit.client.0.smithi174.stdout: 10 5956 17.50 MB/sec warmup 27 sec latency 55.310 ms 2020-04-02T23:35:05.248 INFO:tasks.workunit.client.0.smithi174.stdout: 10 6234 17.60 MB/sec warmup 28 sec latency 58.890 ms 2020-04-02T23:35:06.248 INFO:tasks.workunit.client.0.smithi174.stdout: 10 6597 18.24 MB/sec warmup 29 sec latency 96.194 ms 2020-04-02T23:35:07.248 INFO:tasks.workunit.client.0.smithi174.stdout: 10 6939 18.47 MB/sec warmup 30 sec latency 33.552 ms 2020-04-02T23:35:08.248 INFO:tasks.workunit.client.0.smithi174.stdout: 10 7187 18.70 MB/sec warmup 31 sec latency 43.985 ms 2020-04-02T23:35:09.248 INFO:tasks.workunit.client.0.smithi174.stdout: 10 7356 18.41 MB/sec warmup 32 sec latency 117.015 ms 2020-04-02T23:35:10.249 INFO:tasks.workunit.client.0.smithi174.stdout: 10 7465 17.87 MB/sec warmup 33 sec latency 56.134 ms 2020-04-02T23:35:11.249 INFO:tasks.workunit.client.0.smithi174.stdout: 10 7596 17.42 MB/sec warmup 34 sec latency 71.418 ms 2020-04-02T23:35:12.249 INFO:tasks.workunit.client.0.smithi174.stdout: 10 7743 16.96 MB/sec warmup 35 sec latency 76.346 ms 2020-04-02T23:35:13.249 INFO:tasks.workunit.client.0.smithi174.stdout: 10 7922 16.61 MB/sec warmup 36 sec latency 78.580 ms 2020-04-02T23:35:14.249 INFO:tasks.workunit.client.0.smithi174.stdout: 10 8106 16.38 MB/sec warmup 37 sec latency 123.961 ms 2020-04-02T23:35:15.249 INFO:tasks.workunit.client.0.smithi174.stdout: 10 8331 16.35 MB/sec warmup 38 sec latency 54.739 ms 2020-04-02T23:35:16.249 INFO:tasks.workunit.client.0.smithi174.stdout: 10 8581 16.34 MB/sec warmup 39 sec latency 40.864 ms 2020-04-02T23:35:17.249 INFO:tasks.workunit.client.0.smithi174.stdout: 10 8818 16.12 MB/sec warmup 40 sec latency 36.319 ms 2020-04-02T23:35:18.256 INFO:tasks.workunit.client.0.smithi174.stdout: 10 9069 15.81 MB/sec warmup 41 sec latency 39.777 ms 2020-04-02T23:35:19.249 INFO:tasks.workunit.client.0.smithi174.stdout: 10 9334 15.58 MB/sec warmup 42 sec latency 37.452 ms 2020-04-02T23:35:20.249 INFO:tasks.workunit.client.0.smithi174.stdout: 10 9601 15.64 MB/sec warmup 43 sec latency 43.577 ms 2020-04-02T23:35:21.249 INFO:tasks.workunit.client.0.smithi174.stdout: 10 9844 15.63 MB/sec warmup 44 sec latency 61.712 ms 2020-04-02T23:35:22.249 INFO:tasks.workunit.client.0.smithi174.stdout: 10 10206 16.13 MB/sec warmup 45 sec latency 49.263 ms 2020-04-02T23:35:23.249 INFO:tasks.workunit.client.0.smithi174.stdout: 10 10526 16.24 MB/sec warmup 46 sec latency 48.223 ms 2020-04-02T23:35:24.249 INFO:tasks.workunit.client.0.smithi174.stdout: 10 10743 16.41 MB/sec warmup 47 sec latency 97.191 ms 2020-04-02T23:35:25.249 INFO:tasks.workunit.client.0.smithi174.stdout: 10 10908 16.24 MB/sec warmup 48 sec latency 145.151 ms 2020-04-02T23:35:26.249 INFO:tasks.workunit.client.0.smithi174.stdout: 10 11022 15.95 MB/sec warmup 49 sec latency 81.429 ms 2020-04-02T23:35:27.249 INFO:tasks.workunit.client.0.smithi174.stdout: 10 11157 15.67 MB/sec warmup 50 sec latency 64.841 ms 2020-04-02T23:35:28.249 INFO:tasks.workunit.client.0.smithi174.stdout: 10 11310 15.40 MB/sec warmup 51 sec latency 86.230 ms 2020-04-02T23:35:29.249 INFO:tasks.workunit.client.0.smithi174.stdout: 10 11512 15.21 MB/sec warmup 52 sec latency 78.766 ms 2020-04-02T23:35:30.249 INFO:tasks.workunit.client.0.smithi174.stdout: 10 11742 15.15 MB/sec warmup 53 sec latency 62.953 ms 2020-04-02T23:35:31.249 INFO:tasks.workunit.client.0.smithi174.stdout: 10 11988 15.12 MB/sec warmup 54 sec latency 45.415 ms 2020-04-02T23:35:32.249 INFO:tasks.workunit.client.0.smithi174.stdout: 10 12254 15.13 MB/sec warmup 55 sec latency 34.898 ms 2020-04-02T23:35:32.390 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:35:32.419 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:35:32.461 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:35:32.484 INFO:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:35:33.249 INFO:tasks.workunit.client.0.smithi174.stdout: 10 12496 14.97 MB/sec warmup 56 sec latency 38.262 ms 2020-04-02T23:35:34.249 INFO:tasks.workunit.client.0.smithi174.stdout: 10 12743 14.79 MB/sec warmup 57 sec latency 48.615 ms 2020-04-02T23:35:35.251 INFO:tasks.workunit.client.0.smithi174.stdout: 10 13032 14.77 MB/sec warmup 58 sec latency 30.934 ms 2020-04-02T23:35:36.249 INFO:tasks.workunit.client.0.smithi174.stdout: 10 13292 14.79 MB/sec warmup 59 sec latency 66.147 ms 2020-04-02T23:35:37.249 INFO:tasks.workunit.client.0.smithi174.stdout: 10 13606 15.08 MB/sec warmup 60 sec latency 66.040 ms 2020-04-02T23:35:38.249 INFO:tasks.workunit.client.0.smithi174.stdout: 10 13893 15.18 MB/sec warmup 61 sec latency 56.846 ms 2020-04-02T23:35:39.249 INFO:tasks.workunit.client.0.smithi174.stdout: 10 14179 15.26 MB/sec warmup 62 sec latency 40.179 ms 2020-04-02T23:35:40.249 INFO:tasks.workunit.client.0.smithi174.stdout: 10 14399 15.34 MB/sec warmup 63 sec latency 111.412 ms 2020-04-02T23:35:41.249 INFO:tasks.workunit.client.0.smithi174.stdout: 10 14532 15.20 MB/sec warmup 64 sec latency 114.520 ms 2020-04-02T23:35:42.249 INFO:tasks.workunit.client.0.smithi174.stdout: 10 14666 15.00 MB/sec warmup 65 sec latency 57.098 ms 2020-04-02T23:35:43.249 INFO:tasks.workunit.client.0.smithi174.stdout: 10 14790 14.79 MB/sec warmup 66 sec latency 131.130 ms 2020-04-02T23:35:44.249 INFO:tasks.workunit.client.0.smithi174.stdout: 10 14923 14.62 MB/sec warmup 67 sec latency 143.356 ms 2020-04-02T23:35:45.250 INFO:tasks.workunit.client.0.smithi174.stdout: 10 15110 14.53 MB/sec warmup 68 sec latency 73.052 ms 2020-04-02T23:35:46.250 INFO:tasks.workunit.client.0.smithi174.stdout: 10 15289 14.41 MB/sec warmup 69 sec latency 88.313 ms 2020-04-02T23:35:47.250 INFO:tasks.workunit.client.0.smithi174.stdout: 10 15523 14.35 MB/sec warmup 70 sec latency 54.662 ms 2020-04-02T23:35:48.250 INFO:tasks.workunit.client.0.smithi174.stdout: 10 15766 14.34 MB/sec warmup 71 sec latency 92.759 ms 2020-04-02T23:35:49.250 INFO:tasks.workunit.client.0.smithi174.stdout: 10 16015 14.31 MB/sec warmup 72 sec latency 39.699 ms 2020-04-02T23:35:50.250 INFO:tasks.workunit.client.0.smithi174.stdout: 10 16259 14.17 MB/sec warmup 73 sec latency 33.908 ms 2020-04-02T23:35:51.250 INFO:tasks.workunit.client.0.smithi174.stdout: 10 16544 14.17 MB/sec warmup 74 sec latency 40.258 ms 2020-04-02T23:35:52.250 INFO:tasks.workunit.client.0.smithi174.stdout: 10 16823 14.20 MB/sec warmup 75 sec latency 29.971 ms 2020-04-02T23:35:53.250 INFO:tasks.workunit.client.0.smithi174.stdout: 10 17085 14.30 MB/sec warmup 76 sec latency 45.764 ms 2020-04-02T23:35:54.250 INFO:tasks.workunit.client.0.smithi174.stdout: 10 17393 14.49 MB/sec warmup 77 sec latency 115.821 ms 2020-04-02T23:35:55.250 INFO:tasks.workunit.client.0.smithi174.stdout: 10 17681 14.56 MB/sec warmup 78 sec latency 44.105 ms 2020-04-02T23:35:56.250 INFO:tasks.workunit.client.0.smithi174.stdout: 10 17887 14.64 MB/sec warmup 79 sec latency 87.137 ms 2020-04-02T23:35:57.250 INFO:tasks.workunit.client.0.smithi174.stdout: 10 18050 14.52 MB/sec warmup 80 sec latency 82.582 ms 2020-04-02T23:35:58.250 INFO:tasks.workunit.client.0.smithi174.stdout: 10 18177 14.38 MB/sec warmup 81 sec latency 84.040 ms 2020-04-02T23:35:59.250 INFO:tasks.workunit.client.0.smithi174.stdout: 10 18317 14.24 MB/sec warmup 82 sec latency 96.178 ms 2020-04-02T23:36:00.250 INFO:tasks.workunit.client.0.smithi174.stdout: 10 18461 14.10 MB/sec warmup 83 sec latency 118.184 ms 2020-04-02T23:36:01.250 INFO:tasks.workunit.client.0.smithi174.stdout: 10 18642 14.03 MB/sec warmup 84 sec latency 84.358 ms 2020-04-02T23:36:02.250 INFO:tasks.workunit.client.0.smithi174.stdout: 10 18813 13.91 MB/sec warmup 85 sec latency 94.498 ms 2020-04-02T23:36:03.250 INFO:tasks.workunit.client.0.smithi174.stdout: 10 19067 13.87 MB/sec warmup 86 sec latency 64.592 ms 2020-04-02T23:36:04.250 INFO:tasks.workunit.client.0.smithi174.stdout: 10 19312 13.89 MB/sec warmup 87 sec latency 148.499 ms 2020-04-02T23:36:05.250 INFO:tasks.workunit.client.0.smithi174.stdout: 10 19580 13.90 MB/sec warmup 88 sec latency 56.268 ms 2020-04-02T23:36:05.790 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:36:05.808 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:36:05.851 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:36:05.867 INFO:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:36:06.250 INFO:tasks.workunit.client.0.smithi174.stdout: 10 19849 13.88 MB/sec warmup 89 sec latency 48.018 ms 2020-04-02T23:36:07.250 INFO:tasks.workunit.client.0.smithi174.stdout: 10 20144 13.81 MB/sec warmup 90 sec latency 37.571 ms 2020-04-02T23:36:08.250 INFO:tasks.workunit.client.0.smithi174.stdout: 10 20419 13.84 MB/sec warmup 91 sec latency 44.787 ms 2020-04-02T23:36:09.250 INFO:tasks.workunit.client.0.smithi174.stdout: 10 20657 13.87 MB/sec warmup 92 sec latency 92.894 ms 2020-04-02T23:36:10.250 INFO:tasks.workunit.client.0.smithi174.stdout: 10 20918 14.02 MB/sec warmup 93 sec latency 77.028 ms 2020-04-02T23:36:11.250 INFO:tasks.workunit.client.0.smithi174.stdout: 10 21152 14.00 MB/sec warmup 94 sec latency 66.830 ms 2020-04-02T23:36:12.250 INFO:tasks.workunit.client.0.smithi174.stdout: 10 21406 14.04 MB/sec warmup 95 sec latency 57.447 ms 2020-04-02T23:36:13.250 INFO:tasks.workunit.client.0.smithi174.stdout: 10 21603 14.07 MB/sec warmup 96 sec latency 102.538 ms 2020-04-02T23:36:14.250 INFO:tasks.workunit.client.0.smithi174.stdout: 10 21725 13.98 MB/sec warmup 97 sec latency 165.108 ms 2020-04-02T23:36:15.250 INFO:tasks.workunit.client.0.smithi174.stdout: 10 21871 13.88 MB/sec warmup 98 sec latency 51.710 ms 2020-04-02T23:36:16.250 INFO:tasks.workunit.client.0.smithi174.stdout: 10 22030 13.82 MB/sec warmup 99 sec latency 88.121 ms 2020-04-02T23:36:17.251 INFO:tasks.workunit.client.0.smithi174.stdout: 10 22201 13.70 MB/sec warmup 100 sec latency 80.901 ms 2020-04-02T23:36:18.250 INFO:tasks.workunit.client.0.smithi174.stdout: 10 22415 13.60 MB/sec warmup 101 sec latency 91.273 ms 2020-04-02T23:36:19.251 INFO:tasks.workunit.client.0.smithi174.stdout: 10 22659 13.58 MB/sec warmup 102 sec latency 80.740 ms 2020-04-02T23:36:20.251 INFO:tasks.workunit.client.0.smithi174.stdout: 10 22915 13.61 MB/sec warmup 103 sec latency 55.178 ms 2020-04-02T23:36:21.251 INFO:tasks.workunit.client.0.smithi174.stdout: 10 23220 13.68 MB/sec warmup 104 sec latency 45.207 ms 2020-04-02T23:36:22.251 INFO:tasks.workunit.client.0.smithi174.stdout: 10 23486 13.62 MB/sec warmup 105 sec latency 34.945 ms 2020-04-02T23:36:23.251 INFO:tasks.workunit.client.0.smithi174.stdout: 10 23739 13.57 MB/sec warmup 106 sec latency 35.932 ms 2020-04-02T23:36:24.251 INFO:tasks.workunit.client.0.smithi174.stdout: 10 23998 13.58 MB/sec warmup 107 sec latency 134.249 ms 2020-04-02T23:36:25.251 INFO:tasks.workunit.client.0.smithi174.stdout: 10 24234 13.61 MB/sec warmup 108 sec latency 67.424 ms 2020-04-02T23:36:26.251 INFO:tasks.workunit.client.0.smithi174.stdout: 10 24505 13.71 MB/sec warmup 109 sec latency 110.251 ms 2020-04-02T23:36:27.251 INFO:tasks.workunit.client.0.smithi174.stdout: 10 24797 13.77 MB/sec warmup 110 sec latency 60.654 ms 2020-04-02T23:36:28.251 INFO:tasks.workunit.client.0.smithi174.stdout: 10 25036 13.82 MB/sec warmup 111 sec latency 52.880 ms 2020-04-02T23:36:29.251 INFO:tasks.workunit.client.0.smithi174.stdout: 10 25212 13.78 MB/sec warmup 112 sec latency 94.109 ms 2020-04-02T23:36:30.251 INFO:tasks.workunit.client.0.smithi174.stdout: 10 25360 13.72 MB/sec warmup 113 sec latency 81.938 ms 2020-04-02T23:36:31.251 INFO:tasks.workunit.client.0.smithi174.stdout: 10 25523 13.68 MB/sec warmup 114 sec latency 63.466 ms 2020-04-02T23:36:32.251 INFO:tasks.workunit.client.0.smithi174.stdout: 10 25682 13.57 MB/sec warmup 115 sec latency 58.403 ms 2020-04-02T23:36:33.251 INFO:tasks.workunit.client.0.smithi174.stdout: 10 25875 13.48 MB/sec warmup 116 sec latency 71.169 ms 2020-04-02T23:36:34.251 INFO:tasks.workunit.client.0.smithi174.stdout: 10 26062 13.43 MB/sec warmup 117 sec latency 176.046 ms 2020-04-02T23:36:35.251 INFO:tasks.workunit.client.0.smithi174.stdout: 10 26244 13.38 MB/sec warmup 118 sec latency 135.235 ms 2020-04-02T23:36:35.992 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:36:36.013 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:36:36.060 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:36:36.075 INFO:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:36:36.251 INFO:tasks.workunit.client.0.smithi174.stdout: 10 26516 13.41 MB/sec warmup 119 sec latency 50.532 ms 2020-04-02T23:36:38.251 INFO:tasks.workunit.client.0.smithi174.stdout: 10 27036 6.04 MB/sec execute 1 sec latency 69.069 ms 2020-04-02T23:36:39.251 INFO:tasks.workunit.client.0.smithi174.stdout: 10 27293 8.06 MB/sec execute 2 sec latency 47.717 ms 2020-04-02T23:36:40.252 INFO:tasks.workunit.client.0.smithi174.stdout: 10 27528 8.36 MB/sec execute 3 sec latency 40.544 ms 2020-04-02T23:36:41.251 INFO:tasks.workunit.client.0.smithi174.stdout: 10 27755 9.66 MB/sec execute 4 sec latency 48.242 ms 2020-04-02T23:36:42.251 INFO:tasks.workunit.client.0.smithi174.stdout: 10 28041 12.10 MB/sec execute 5 sec latency 52.624 ms 2020-04-02T23:36:43.251 INFO:tasks.workunit.client.0.smithi174.stdout: 10 28288 13.16 MB/sec execute 6 sec latency 86.447 ms 2020-04-02T23:36:44.251 INFO:tasks.workunit.client.0.smithi174.stdout: 10 28515 13.25 MB/sec execute 7 sec latency 136.400 ms 2020-04-02T23:36:45.251 INFO:tasks.workunit.client.0.smithi174.stdout: 10 28738 14.42 MB/sec execute 8 sec latency 100.827 ms 2020-04-02T23:36:46.251 INFO:tasks.workunit.client.0.smithi174.stdout: 10 28918 14.02 MB/sec execute 9 sec latency 110.733 ms 2020-04-02T23:36:47.251 INFO:tasks.workunit.client.0.smithi174.stdout: 10 29072 13.07 MB/sec execute 10 sec latency 93.077 ms 2020-04-02T23:36:48.252 INFO:tasks.workunit.client.0.smithi174.stdout: 10 29250 12.08 MB/sec execute 11 sec latency 70.175 ms 2020-04-02T23:36:49.251 INFO:tasks.workunit.client.0.smithi174.stdout: 10 29447 11.46 MB/sec execute 12 sec latency 79.212 ms 2020-04-02T23:36:50.252 INFO:tasks.workunit.client.0.smithi174.stdout: 10 29625 11.16 MB/sec execute 13 sec latency 78.039 ms 2020-04-02T23:36:51.251 INFO:tasks.workunit.client.0.smithi174.stdout: 10 29839 11.21 MB/sec execute 14 sec latency 103.622 ms 2020-04-02T23:36:52.251 INFO:tasks.workunit.client.0.smithi174.stdout: 10 30111 11.45 MB/sec execute 15 sec latency 53.211 ms 2020-04-02T23:36:53.251 INFO:tasks.workunit.client.0.smithi174.stdout: 10 30375 12.04 MB/sec execute 16 sec latency 43.299 ms 2020-04-02T23:36:54.252 INFO:tasks.workunit.client.0.smithi174.stdout: 10 30580 11.83 MB/sec execute 17 sec latency 129.057 ms 2020-04-02T23:36:55.252 INFO:tasks.workunit.client.0.smithi174.stdout: 10 30818 11.65 MB/sec execute 18 sec latency 59.314 ms 2020-04-02T23:36:56.252 INFO:tasks.workunit.client.0.smithi174.stdout: 10 31062 11.31 MB/sec execute 19 sec latency 39.571 ms 2020-04-02T23:36:57.252 INFO:tasks.workunit.client.0.smithi174.stdout: 10 31305 11.55 MB/sec execute 20 sec latency 42.778 ms 2020-04-02T23:36:58.252 INFO:tasks.workunit.client.0.smithi174.stdout: 10 31536 11.68 MB/sec execute 21 sec latency 63.619 ms 2020-04-02T23:36:59.252 INFO:tasks.workunit.client.0.smithi174.stdout: 10 31853 12.31 MB/sec execute 22 sec latency 58.226 ms 2020-04-02T23:37:00.252 INFO:tasks.workunit.client.0.smithi174.stdout: 10 32105 12.41 MB/sec execute 23 sec latency 44.229 ms 2020-04-02T23:37:01.252 INFO:tasks.workunit.client.0.smithi174.stdout: 10 32351 12.90 MB/sec execute 24 sec latency 49.486 ms 2020-04-02T23:37:02.252 INFO:tasks.workunit.client.0.smithi174.stdout: 10 32533 12.75 MB/sec execute 25 sec latency 104.437 ms 2020-04-02T23:37:03.252 INFO:tasks.workunit.client.0.smithi174.stdout: 10 32711 12.41 MB/sec execute 26 sec latency 68.305 ms 2020-04-02T23:37:04.252 INFO:tasks.workunit.client.0.smithi174.stdout: 10 32875 12.16 MB/sec execute 27 sec latency 96.129 ms 2020-04-02T23:37:05.252 INFO:tasks.workunit.client.0.smithi174.stdout: 10 33046 11.93 MB/sec execute 28 sec latency 71.210 ms 2020-04-02T23:37:06.252 INFO:tasks.workunit.client.0.smithi174.stdout: 10 33262 11.92 MB/sec execute 29 sec latency 67.952 ms 2020-04-02T23:37:07.252 INFO:tasks.workunit.client.0.smithi174.stdout: 10 33497 11.84 MB/sec execute 30 sec latency 64.460 ms 2020-04-02T23:37:08.252 INFO:tasks.workunit.client.0.smithi174.stdout: 10 33727 11.88 MB/sec execute 31 sec latency 46.164 ms 2020-04-02T23:37:09.252 INFO:tasks.workunit.client.0.smithi174.stdout: 10 33963 11.97 MB/sec execute 32 sec latency 76.473 ms 2020-04-02T23:37:10.252 INFO:tasks.workunit.client.0.smithi174.stdout: 10 34198 12.08 MB/sec execute 33 sec latency 42.434 ms 2020-04-02T23:37:11.252 INFO:tasks.workunit.client.0.smithi174.stdout: 10 34408 11.83 MB/sec execute 34 sec latency 79.152 ms 2020-04-02T23:37:12.252 INFO:tasks.workunit.client.0.smithi174.stdout: 10 34663 11.71 MB/sec execute 35 sec latency 31.567 ms 2020-04-02T23:37:12.656 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:37:12.696 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:37:12.738 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:37:12.752 INFO:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:37:13.252 INFO:tasks.workunit.client.0.smithi174.stdout: 10 34920 11.76 MB/sec execute 36 sec latency 46.360 ms 2020-04-02T23:37:14.252 INFO:tasks.workunit.client.0.smithi174.stdout: 10 35105 11.75 MB/sec execute 37 sec latency 115.996 ms 2020-04-02T23:37:15.252 INFO:tasks.workunit.client.0.smithi174.stdout: 10 35425 12.19 MB/sec execute 38 sec latency 52.422 ms 2020-04-02T23:37:16.252 INFO:tasks.workunit.client.0.smithi174.stdout: 10 35706 12.36 MB/sec execute 39 sec latency 85.952 ms 2020-04-02T23:37:17.252 INFO:tasks.workunit.client.0.smithi174.stdout: 10 35941 12.53 MB/sec execute 40 sec latency 71.113 ms 2020-04-02T23:37:18.252 INFO:tasks.workunit.client.0.smithi174.stdout: 10 36150 12.43 MB/sec execute 41 sec latency 80.147 ms 2020-04-02T23:37:19.252 INFO:tasks.workunit.client.0.smithi174.stdout: 10 36346 12.32 MB/sec execute 42 sec latency 80.987 ms 2020-04-02T23:37:20.252 INFO:tasks.workunit.client.0.smithi174.stdout: 10 36504 12.14 MB/sec execute 43 sec latency 80.407 ms 2020-04-02T23:37:21.252 INFO:tasks.workunit.client.0.smithi174.stdout: 10 36727 12.18 MB/sec execute 44 sec latency 67.504 ms 2020-04-02T23:37:22.253 INFO:tasks.workunit.client.0.smithi174.stdout: 10 36980 12.11 MB/sec execute 45 sec latency 72.357 ms 2020-04-02T23:37:23.253 INFO:tasks.workunit.client.0.smithi174.stdout: 10 37214 12.11 MB/sec execute 46 sec latency 82.682 ms 2020-04-02T23:37:24.252 INFO:tasks.workunit.client.0.smithi174.stdout: 10 37409 11.99 MB/sec execute 47 sec latency 141.328 ms 2020-04-02T23:37:25.252 INFO:tasks.workunit.client.0.smithi174.stdout: 10 37676 12.22 MB/sec execute 48 sec latency 70.086 ms 2020-04-02T23:37:26.252 INFO:tasks.workunit.client.0.smithi174.stdout: 10 37905 12.12 MB/sec execute 49 sec latency 56.804 ms 2020-04-02T23:37:27.252 INFO:tasks.workunit.client.0.smithi174.stdout: 10 38171 12.04 MB/sec execute 50 sec latency 34.047 ms 2020-04-02T23:37:28.253 INFO:tasks.workunit.client.0.smithi174.stdout: 10 38425 12.03 MB/sec execute 51 sec latency 57.829 ms 2020-04-02T23:37:29.253 INFO:tasks.workunit.client.0.smithi174.stdout: 10 38634 12.02 MB/sec execute 52 sec latency 75.113 ms 2020-04-02T23:37:30.253 INFO:tasks.workunit.client.0.smithi174.stdout: 10 38886 12.21 MB/sec execute 53 sec latency 75.272 ms 2020-04-02T23:37:31.253 INFO:tasks.workunit.client.0.smithi174.stdout: 10 39190 12.43 MB/sec execute 54 sec latency 50.854 ms 2020-04-02T23:37:32.253 INFO:tasks.workunit.client.0.smithi174.stdout: 10 39430 12.47 MB/sec execute 55 sec latency 40.574 ms 2020-04-02T23:37:33.253 INFO:tasks.workunit.client.0.smithi174.stdout: 10 39649 12.49 MB/sec execute 56 sec latency 87.026 ms 2020-04-02T23:37:34.253 INFO:tasks.workunit.client.0.smithi174.stdout: 10 39825 12.39 MB/sec execute 57 sec latency 127.490 ms 2020-04-02T23:37:35.253 INFO:tasks.workunit.client.0.smithi174.stdout: 10 39983 12.28 MB/sec execute 58 sec latency 63.255 ms 2020-04-02T23:37:36.253 INFO:tasks.workunit.client.0.smithi174.stdout: 10 40188 12.29 MB/sec execute 59 sec latency 62.626 ms 2020-04-02T23:37:37.253 INFO:tasks.workunit.client.0.smithi174.stdout: 10 40403 12.21 MB/sec execute 60 sec latency 49.605 ms 2020-04-02T23:37:38.253 INFO:tasks.workunit.client.0.smithi174.stdout: 10 40603 12.14 MB/sec execute 61 sec latency 68.422 ms 2020-04-02T23:37:39.253 INFO:tasks.workunit.client.0.smithi174.stdout: 10 40824 12.11 MB/sec execute 62 sec latency 58.437 ms 2020-04-02T23:37:40.253 INFO:tasks.workunit.client.0.smithi174.stdout: 10 41059 12.18 MB/sec execute 63 sec latency 65.273 ms 2020-04-02T23:37:41.253 INFO:tasks.workunit.client.0.smithi174.stdout: 10 41281 12.19 MB/sec execute 64 sec latency 63.643 ms 2020-04-02T23:37:42.253 INFO:tasks.workunit.client.0.smithi174.stdout: 10 41506 12.10 MB/sec execute 65 sec latency 58.657 ms 2020-04-02T23:37:43.253 INFO:tasks.workunit.client.0.smithi174.stdout: 10 41756 12.07 MB/sec execute 66 sec latency 61.717 ms 2020-04-02T23:37:44.253 INFO:tasks.workunit.client.0.smithi174.stdout: 10 41994 12.01 MB/sec execute 67 sec latency 134.495 ms 2020-04-02T23:37:45.253 INFO:tasks.workunit.client.0.smithi174.stdout: 10 42201 12.01 MB/sec execute 68 sec latency 81.432 ms 2020-04-02T23:37:45.842 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:37:45.858 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:37:45.901 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:37:45.917 INFO:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:37:46.253 INFO:tasks.workunit.client.0.smithi174.stdout: 10 42489 12.21 MB/sec execute 69 sec latency 78.712 ms 2020-04-02T23:37:47.253 INFO:tasks.workunit.client.0.smithi174.stdout: 10 42775 12.32 MB/sec execute 70 sec latency 50.891 ms 2020-04-02T23:37:48.253 INFO:tasks.workunit.client.0.smithi174.stdout: 10 43019 12.40 MB/sec execute 71 sec latency 63.420 ms 2020-04-02T23:37:49.253 INFO:tasks.workunit.client.0.smithi174.stdout: 10 43239 12.38 MB/sec execute 72 sec latency 96.013 ms 2020-04-02T23:37:50.253 INFO:tasks.workunit.client.0.smithi174.stdout: 10 43422 12.32 MB/sec execute 73 sec latency 80.031 ms 2020-04-02T23:37:51.253 INFO:tasks.workunit.client.0.smithi174.stdout: 10 43578 12.22 MB/sec execute 74 sec latency 70.743 ms 2020-04-02T23:37:52.253 INFO:tasks.workunit.client.0.smithi174.stdout: 10 43787 12.24 MB/sec execute 75 sec latency 71.421 ms 2020-04-02T23:37:53.253 INFO:tasks.workunit.client.0.smithi174.stdout: 10 44010 12.19 MB/sec execute 76 sec latency 72.821 ms 2020-04-02T23:37:54.253 INFO:tasks.workunit.client.0.smithi174.stdout: 10 44184 12.14 MB/sec execute 77 sec latency 143.864 ms 2020-04-02T23:37:55.253 INFO:tasks.workunit.client.0.smithi174.stdout: 10 44401 12.10 MB/sec execute 78 sec latency 90.508 ms 2020-04-02T23:37:56.253 INFO:tasks.workunit.client.0.smithi174.stdout: 10 44646 12.15 MB/sec execute 79 sec latency 54.281 ms 2020-04-02T23:37:57.253 INFO:tasks.workunit.client.0.smithi174.stdout: 10 44882 12.19 MB/sec execute 80 sec latency 43.629 ms 2020-04-02T23:37:58.254 INFO:tasks.workunit.client.0.smithi174.stdout: 10 45127 12.13 MB/sec execute 81 sec latency 36.145 ms 2020-04-02T23:37:59.253 INFO:tasks.workunit.client.0.smithi174.stdout: 10 45399 12.08 MB/sec execute 82 sec latency 33.101 ms 2020-04-02T23:38:00.253 INFO:tasks.workunit.client.0.smithi174.stdout: 10 45639 12.08 MB/sec execute 83 sec latency 65.243 ms 2020-04-02T23:38:01.253 INFO:tasks.workunit.client.0.smithi174.stdout: 10 45872 12.14 MB/sec execute 84 sec latency 87.685 ms 2020-04-02T23:38:02.253 INFO:tasks.workunit.client.0.smithi174.stdout: 10 46149 12.25 MB/sec execute 85 sec latency 41.405 ms 2020-04-02T23:38:03.253 INFO:tasks.workunit.client.0.smithi174.stdout: 10 46428 12.28 MB/sec execute 86 sec latency 46.157 ms 2020-04-02T23:38:04.254 INFO:tasks.workunit.client.0.smithi174.stdout: 10 46657 12.33 MB/sec execute 87 sec latency 115.645 ms 2020-04-02T23:38:05.254 INFO:tasks.workunit.client.0.smithi174.stdout: 10 46870 12.34 MB/sec execute 88 sec latency 107.732 ms 2020-04-02T23:38:06.254 INFO:tasks.workunit.client.0.smithi174.stdout: 10 47029 12.29 MB/sec execute 89 sec latency 131.287 ms 2020-04-02T23:38:07.254 INFO:tasks.workunit.client.0.smithi174.stdout: 10 47228 12.31 MB/sec execute 90 sec latency 57.603 ms 2020-04-02T23:38:08.254 INFO:tasks.workunit.client.0.smithi174.stdout: 10 47434 12.26 MB/sec execute 91 sec latency 48.973 ms 2020-04-02T23:38:09.254 INFO:tasks.workunit.client.0.smithi174.stdout: 10 47648 12.22 MB/sec execute 92 sec latency 49.374 ms 2020-04-02T23:38:10.254 INFO:tasks.workunit.client.0.smithi174.stdout: 10 47849 12.15 MB/sec execute 93 sec latency 120.635 ms 2020-04-02T23:38:11.254 INFO:tasks.workunit.client.0.smithi174.stdout: 10 48048 12.12 MB/sec execute 94 sec latency 87.046 ms 2020-04-02T23:38:12.254 INFO:tasks.workunit.client.0.smithi174.stdout: 10 48303 12.20 MB/sec execute 95 sec latency 58.686 ms 2020-04-02T23:38:13.254 INFO:tasks.workunit.client.0.smithi174.stdout: 10 48556 12.20 MB/sec execute 96 sec latency 66.960 ms 2020-04-02T23:38:14.254 INFO:tasks.workunit.client.0.smithi174.stdout: 10 48635 12.10 MB/sec execute 97 sec latency 441.512 ms 2020-04-02T23:38:15.254 INFO:tasks.workunit.client.0.smithi174.stdout: 10 48878 12.05 MB/sec execute 98 sec latency 499.210 ms 2020-04-02T23:38:16.021 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:38:16.109 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:38:16.111 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:38:16.126 INFO:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:38:16.201 INFO:tasks.ceph.mds.b.smithi196.stderr:2020-04-02T23:38:16.199+0000 7f90d48d2700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 25746) UID: 0 2020-04-02T23:38:16.254 INFO:tasks.workunit.client.0.smithi174.stdout: 10 49135 12.04 MB/sec execute 99 sec latency 90.790 ms 2020-04-02T23:38:17.254 INFO:tasks.workunit.client.0.smithi174.stdout: 10 49355 12.02 MB/sec execute 100 sec latency 62.341 ms 2020-04-02T23:38:18.254 INFO:tasks.workunit.client.0.smithi174.stdout: 10 49626 12.15 MB/sec execute 101 sec latency 53.342 ms 2020-04-02T23:38:19.254 INFO:tasks.workunit.client.0.smithi174.stdout: 10 49912 12.20 MB/sec execute 102 sec latency 84.491 ms 2020-04-02T23:38:20.254 INFO:tasks.workunit.client.0.smithi174.stdout: 10 50180 12.21 MB/sec execute 103 sec latency 69.076 ms 2020-04-02T23:38:21.254 INFO:tasks.workunit.client.0.smithi174.stdout: 10 50398 12.27 MB/sec execute 104 sec latency 88.513 ms 2020-04-02T23:38:22.255 INFO:tasks.workunit.client.0.smithi174.stdout: 10 50580 12.26 MB/sec execute 105 sec latency 84.482 ms 2020-04-02T23:38:23.254 INFO:tasks.workunit.client.0.smithi174.stdout: 10 50778 12.26 MB/sec execute 106 sec latency 68.600 ms 2020-04-02T23:38:24.254 INFO:tasks.workunit.client.0.smithi174.stdout: 10 50913 12.18 MB/sec execute 107 sec latency 147.185 ms 2020-04-02T23:38:25.254 INFO:tasks.workunit.client.0.smithi174.stdout: 10 51103 12.14 MB/sec execute 108 sec latency 88.962 ms 2020-04-02T23:38:26.254 INFO:tasks.workunit.client.0.smithi174.stdout: 10 51284 12.09 MB/sec execute 109 sec latency 106.087 ms 2020-04-02T23:38:27.254 INFO:tasks.workunit.client.0.smithi174.stdout: 10 51468 12.04 MB/sec execute 110 sec latency 96.332 ms 2020-04-02T23:38:28.254 INFO:tasks.workunit.client.0.smithi174.stdout: 10 51662 12.03 MB/sec execute 111 sec latency 66.800 ms 2020-04-02T23:38:29.254 INFO:tasks.workunit.client.0.smithi174.stdout: 10 51898 12.07 MB/sec execute 112 sec latency 63.566 ms 2020-04-02T23:38:30.254 INFO:tasks.workunit.client.0.smithi174.stdout: 10 52105 12.08 MB/sec execute 113 sec latency 66.173 ms 2020-04-02T23:38:31.254 INFO:tasks.workunit.client.0.smithi174.stdout: 10 52329 12.03 MB/sec execute 114 sec latency 81.658 ms 2020-04-02T23:38:32.254 INFO:tasks.workunit.client.0.smithi174.stdout: 10 52560 11.99 MB/sec execute 115 sec latency 64.072 ms 2020-04-02T23:38:33.255 INFO:tasks.workunit.client.0.smithi174.stdout: 10 52790 11.99 MB/sec execute 116 sec latency 42.828 ms 2020-04-02T23:38:34.254 INFO:tasks.workunit.client.0.smithi174.stdout: 10 52997 11.99 MB/sec execute 117 sec latency 92.940 ms 2020-04-02T23:38:35.254 INFO:tasks.workunit.client.0.smithi174.stdout: 10 53262 12.03 MB/sec execute 118 sec latency 60.343 ms 2020-04-02T23:38:36.255 INFO:tasks.workunit.client.0.smithi174.stdout: 10 53577 12.08 MB/sec execute 119 sec latency 61.522 ms 2020-04-02T23:38:37.255 INFO:tasks.workunit.client.0.smithi174.stdout: 10 53853 12.16 MB/sec execute 120 sec latency 61.615 ms 2020-04-02T23:38:38.255 INFO:tasks.workunit.client.0.smithi174.stdout: 10 54070 12.18 MB/sec execute 121 sec latency 75.300 ms 2020-04-02T23:38:39.255 INFO:tasks.workunit.client.0.smithi174.stdout: 10 54267 12.20 MB/sec execute 122 sec latency 79.347 ms 2020-04-02T23:38:40.255 INFO:tasks.workunit.client.0.smithi174.stdout: 10 54471 12.17 MB/sec execute 123 sec latency 67.792 ms 2020-04-02T23:38:41.255 INFO:tasks.workunit.client.0.smithi174.stdout: 10 54672 12.13 MB/sec execute 124 sec latency 63.374 ms 2020-04-02T23:38:42.255 INFO:tasks.workunit.client.0.smithi174.stdout: 10 54850 12.09 MB/sec execute 125 sec latency 80.442 ms 2020-04-02T23:38:43.255 INFO:tasks.workunit.client.0.smithi174.stdout: 10 55013 12.05 MB/sec execute 126 sec latency 126.608 ms 2020-04-02T23:38:44.255 INFO:tasks.workunit.client.0.smithi174.stdout: 10 55170 12.02 MB/sec execute 127 sec latency 149.976 ms 2020-04-02T23:38:45.255 INFO:tasks.workunit.client.0.smithi174.stdout: 10 55413 12.03 MB/sec execute 128 sec latency 75.815 ms 2020-04-02T23:38:46.255 INFO:tasks.workunit.client.0.smithi174.stdout: 10 55627 12.05 MB/sec execute 129 sec latency 198.155 ms 2020-04-02T23:38:47.255 INFO:tasks.workunit.client.0.smithi174.stdout: 10 55851 12.05 MB/sec execute 130 sec latency 109.552 ms 2020-04-02T23:38:48.255 INFO:tasks.workunit.client.0.smithi174.stdout: 10 56081 12.00 MB/sec execute 131 sec latency 79.019 ms 2020-04-02T23:38:49.255 INFO:tasks.workunit.client.0.smithi174.stdout: 10 56298 11.94 MB/sec execute 132 sec latency 56.454 ms 2020-04-02T23:38:50.255 INFO:tasks.workunit.client.0.smithi174.stdout: 10 56523 11.95 MB/sec execute 133 sec latency 45.046 ms 2020-04-02T23:38:51.255 INFO:tasks.workunit.client.0.smithi174.stdout: 10 56747 11.98 MB/sec execute 134 sec latency 62.240 ms 2020-04-02T23:38:52.255 INFO:tasks.workunit.client.0.smithi174.stdout: 10 57006 12.02 MB/sec execute 135 sec latency 72.760 ms 2020-04-02T23:38:53.255 INFO:tasks.workunit.client.0.smithi174.stdout: 10 57274 12.04 MB/sec execute 136 sec latency 70.857 ms 2020-04-02T23:38:54.255 INFO:tasks.workunit.client.0.smithi174.stdout: 10 57478 12.07 MB/sec execute 137 sec latency 222.707 ms 2020-04-02T23:38:55.255 INFO:tasks.workunit.client.0.smithi174.stdout: 10 57689 12.11 MB/sec execute 138 sec latency 113.211 ms 2020-04-02T23:38:56.255 INFO:tasks.workunit.client.0.smithi174.stdout: 10 57896 12.11 MB/sec execute 139 sec latency 61.704 ms 2020-04-02T23:38:57.255 INFO:tasks.workunit.client.0.smithi174.stdout: 10 58080 12.08 MB/sec execute 140 sec latency 71.513 ms 2020-04-02T23:38:58.255 INFO:tasks.workunit.client.0.smithi174.stdout: 10 58242 12.03 MB/sec execute 141 sec latency 69.455 ms 2020-04-02T23:38:59.255 INFO:tasks.workunit.client.0.smithi174.stdout: 10 58406 11.99 MB/sec execute 142 sec latency 81.545 ms 2020-04-02T23:39:00.255 INFO:tasks.workunit.client.0.smithi174.stdout: 10 58573 11.97 MB/sec execute 143 sec latency 82.686 ms 2020-04-02T23:39:01.255 INFO:tasks.workunit.client.0.smithi174.stdout: 10 58792 11.97 MB/sec execute 144 sec latency 90.248 ms 2020-04-02T23:39:02.256 INFO:tasks.workunit.client.0.smithi174.stdout: 10 59001 11.96 MB/sec execute 145 sec latency 86.696 ms 2020-04-02T23:39:03.255 INFO:tasks.workunit.client.0.smithi174.stdout: 10 59237 11.99 MB/sec execute 146 sec latency 94.277 ms 2020-04-02T23:39:04.255 INFO:tasks.workunit.client.0.smithi174.stdout: 10 59426 11.96 MB/sec execute 147 sec latency 190.669 ms 2020-04-02T23:39:05.255 INFO:tasks.workunit.client.0.smithi174.stdout: 10 59639 11.92 MB/sec execute 148 sec latency 89.731 ms 2020-04-02T23:39:06.255 INFO:tasks.workunit.client.0.smithi174.stdout: 10 59893 11.91 MB/sec execute 149 sec latency 96.418 ms 2020-04-02T23:39:07.255 INFO:tasks.workunit.client.0.smithi174.stdout: 10 60129 11.90 MB/sec execute 150 sec latency 65.357 ms 2020-04-02T23:39:08.255 INFO:tasks.workunit.client.0.smithi174.stdout: 10 60356 11.91 MB/sec execute 151 sec latency 56.714 ms 2020-04-02T23:39:09.255 INFO:tasks.workunit.client.0.smithi174.stdout: 10 60649 11.97 MB/sec execute 152 sec latency 70.231 ms 2020-04-02T23:39:10.255 INFO:tasks.workunit.client.0.smithi174.stdout: 10 60929 11.99 MB/sec execute 153 sec latency 66.870 ms 2020-04-02T23:39:11.256 INFO:tasks.workunit.client.0.smithi174.stdout: 10 61174 12.07 MB/sec execute 154 sec latency 56.955 ms 2020-04-02T23:39:12.256 INFO:tasks.workunit.client.0.smithi174.stdout: 10 61403 12.09 MB/sec execute 155 sec latency 74.927 ms 2020-04-02T23:39:13.256 INFO:tasks.workunit.client.0.smithi174.stdout: 10 61602 12.07 MB/sec execute 156 sec latency 52.470 ms 2020-04-02T23:39:14.256 INFO:tasks.workunit.client.0.smithi174.stdout: 10 61757 12.04 MB/sec execute 157 sec latency 135.616 ms 2020-04-02T23:39:15.256 INFO:tasks.workunit.client.0.smithi174.stdout: 10 61930 11.99 MB/sec execute 158 sec latency 69.043 ms 2020-04-02T23:39:16.256 INFO:tasks.workunit.client.0.smithi174.stdout: 10 62096 11.97 MB/sec execute 159 sec latency 86.505 ms 2020-04-02T23:39:17.256 INFO:tasks.workunit.client.0.smithi174.stdout: 10 62291 11.96 MB/sec execute 160 sec latency 96.223 ms 2020-04-02T23:39:18.256 INFO:tasks.workunit.client.0.smithi174.stdout: 10 62476 11.93 MB/sec execute 161 sec latency 89.056 ms 2020-04-02T23:39:19.256 INFO:tasks.workunit.client.0.smithi174.stdout: 10 62721 11.94 MB/sec execute 162 sec latency 62.923 ms 2020-04-02T23:39:20.256 INFO:tasks.workunit.client.0.smithi174.stdout: 10 62951 11.95 MB/sec execute 163 sec latency 68.309 ms 2020-04-02T23:39:21.256 INFO:tasks.workunit.client.0.smithi174.stdout: 10 63176 11.92 MB/sec execute 164 sec latency 66.098 ms 2020-04-02T23:39:22.256 INFO:tasks.workunit.client.0.smithi174.stdout: 10 63438 11.92 MB/sec execute 165 sec latency 64.710 ms 2020-04-02T23:39:23.256 INFO:tasks.workunit.client.0.smithi174.stdout: 10 63690 11.91 MB/sec execute 166 sec latency 61.030 ms 2020-04-02T23:39:24.256 INFO:tasks.workunit.client.0.smithi174.stdout: 10 63869 11.90 MB/sec execute 167 sec latency 286.224 ms 2020-04-02T23:39:25.256 INFO:tasks.workunit.client.0.smithi174.stdout: 10 64132 11.92 MB/sec execute 168 sec latency 79.436 ms 2020-04-02T23:39:26.256 INFO:tasks.workunit.client.0.smithi174.stdout: 10 64414 11.96 MB/sec execute 169 sec latency 54.315 ms 2020-04-02T23:39:27.256 INFO:tasks.workunit.client.0.smithi174.stdout: 10 64682 12.02 MB/sec execute 170 sec latency 61.636 ms 2020-04-02T23:39:28.256 INFO:tasks.workunit.client.0.smithi174.stdout: 10 64938 12.07 MB/sec execute 171 sec latency 78.020 ms 2020-04-02T23:39:29.257 INFO:tasks.workunit.client.0.smithi174.stdout: 10 65150 12.06 MB/sec execute 172 sec latency 61.625 ms 2020-04-02T23:39:30.256 INFO:tasks.workunit.client.0.smithi174.stdout: 10 65333 12.03 MB/sec execute 173 sec latency 73.107 ms 2020-04-02T23:39:31.256 INFO:tasks.workunit.client.0.smithi174.stdout: 10 65487 11.99 MB/sec execute 174 sec latency 136.038 ms 2020-04-02T23:39:32.256 INFO:tasks.workunit.client.0.smithi174.stdout: 10 65670 11.98 MB/sec execute 175 sec latency 73.361 ms 2020-04-02T23:39:33.256 INFO:tasks.workunit.client.0.smithi174.stdout: 10 65871 11.96 MB/sec execute 176 sec latency 79.623 ms 2020-04-02T23:39:34.256 INFO:tasks.workunit.client.0.smithi174.stdout: 10 66056 11.95 MB/sec execute 177 sec latency 184.302 ms 2020-04-02T23:39:35.256 INFO:tasks.workunit.client.0.smithi174.stdout: 10 66280 11.95 MB/sec execute 178 sec latency 53.988 ms 2020-04-02T23:39:36.256 INFO:tasks.workunit.client.0.smithi174.stdout: 10 66484 11.94 MB/sec execute 179 sec latency 134.905 ms 2020-04-02T23:39:37.257 INFO:tasks.workunit.client.0.smithi174.stdout: 10 66721 11.95 MB/sec execute 180 sec latency 49.110 ms 2020-04-02T23:39:38.256 INFO:tasks.workunit.client.0.smithi174.stdout: 10 66963 11.92 MB/sec execute 181 sec latency 47.654 ms 2020-04-02T23:39:39.256 INFO:tasks.workunit.client.0.smithi174.stdout: 10 67208 11.92 MB/sec execute 182 sec latency 49.808 ms 2020-04-02T23:39:40.256 INFO:tasks.workunit.client.0.smithi174.stdout: 10 67427 11.90 MB/sec execute 183 sec latency 70.857 ms 2020-04-02T23:39:41.256 INFO:tasks.workunit.client.0.smithi174.stdout: 10 67686 11.93 MB/sec execute 184 sec latency 64.792 ms 2020-04-02T23:39:42.256 INFO:tasks.workunit.client.0.smithi174.stdout: 10 67959 11.97 MB/sec execute 185 sec latency 102.121 ms 2020-04-02T23:39:43.256 INFO:tasks.workunit.client.0.smithi174.stdout: 10 68242 12.01 MB/sec execute 186 sec latency 45.716 ms 2020-04-02T23:39:44.256 INFO:tasks.workunit.client.0.smithi174.stdout: 10 68488 12.05 MB/sec execute 187 sec latency 107.195 ms 2020-04-02T23:39:45.257 INFO:tasks.workunit.client.0.smithi174.stdout: 10 68712 12.04 MB/sec execute 188 sec latency 65.589 ms 2020-04-02T23:39:46.256 INFO:tasks.workunit.client.0.smithi174.stdout: 10 68899 12.04 MB/sec execute 189 sec latency 65.308 ms 2020-04-02T23:39:47.256 INFO:tasks.workunit.client.0.smithi174.stdout: 10 69067 12.02 MB/sec execute 190 sec latency 92.386 ms 2020-04-02T23:39:48.257 INFO:tasks.workunit.client.0.smithi174.stdout: 10 69244 12.00 MB/sec execute 191 sec latency 61.931 ms 2020-04-02T23:39:49.257 INFO:tasks.workunit.client.0.smithi174.stdout: 10 69413 11.96 MB/sec execute 192 sec latency 98.492 ms 2020-04-02T23:39:50.257 INFO:tasks.workunit.client.0.smithi174.stdout: 10 69613 11.94 MB/sec execute 193 sec latency 97.744 ms 2020-04-02T23:39:51.257 INFO:tasks.workunit.client.0.smithi174.stdout: 10 69792 11.94 MB/sec execute 194 sec latency 72.684 ms 2020-04-02T23:39:52.257 INFO:tasks.workunit.client.0.smithi174.stdout: 10 70024 11.96 MB/sec execute 195 sec latency 52.263 ms 2020-04-02T23:39:53.257 INFO:tasks.workunit.client.0.smithi174.stdout: 10 70228 11.95 MB/sec execute 196 sec latency 66.671 ms 2020-04-02T23:39:54.257 INFO:tasks.workunit.client.0.smithi174.stdout: 10 70405 11.92 MB/sec execute 197 sec latency 206.903 ms 2020-04-02T23:39:55.257 INFO:tasks.workunit.client.0.smithi174.stdout: 10 70641 11.90 MB/sec execute 198 sec latency 49.715 ms 2020-04-02T23:39:56.257 INFO:tasks.workunit.client.0.smithi174.stdout: 10 70890 11.88 MB/sec execute 199 sec latency 47.787 ms 2020-04-02T23:39:57.257 INFO:tasks.workunit.client.0.smithi174.stdout: 10 71119 11.86 MB/sec execute 200 sec latency 70.754 ms 2020-04-02T23:39:58.257 INFO:tasks.workunit.client.0.smithi174.stdout: 10 71416 11.93 MB/sec execute 201 sec latency 49.358 ms 2020-04-02T23:39:59.257 INFO:tasks.workunit.client.0.smithi174.stdout: 10 71715 11.97 MB/sec execute 202 sec latency 56.947 ms 2020-04-02T23:40:00.257 INFO:tasks.workunit.client.0.smithi174.stdout: 10 72004 12.02 MB/sec execute 203 sec latency 58.204 ms 2020-04-02T23:40:01.257 INFO:tasks.workunit.client.0.smithi174.stdout: 10 72248 12.02 MB/sec execute 204 sec latency 105.019 ms 2020-04-02T23:40:02.257 INFO:tasks.workunit.client.0.smithi174.stdout: 10 72444 12.03 MB/sec execute 205 sec latency 58.282 ms 2020-04-02T23:40:03.259 INFO:tasks.workunit.client.0.smithi174.stdout: 10 72627 12.02 MB/sec execute 206 sec latency 81.936 ms 2020-04-02T23:40:04.257 INFO:tasks.workunit.client.0.smithi174.stdout: 10 72798 12.00 MB/sec execute 207 sec latency 119.628 ms 2020-04-02T23:40:05.257 INFO:tasks.workunit.client.0.smithi174.stdout: 10 73001 11.98 MB/sec execute 208 sec latency 50.877 ms 2020-04-02T23:40:06.258 INFO:tasks.workunit.client.0.smithi174.stdout: 10 73165 11.95 MB/sec execute 209 sec latency 144.218 ms 2020-04-02T23:40:07.257 INFO:tasks.workunit.client.0.smithi174.stdout: 10 73333 11.93 MB/sec execute 210 sec latency 80.694 ms 2020-04-02T23:40:08.257 INFO:tasks.workunit.client.0.smithi174.stdout: 10 73534 11.92 MB/sec execute 211 sec latency 67.513 ms 2020-04-02T23:40:09.257 INFO:tasks.workunit.client.0.smithi174.stdout: 10 73780 11.94 MB/sec execute 212 sec latency 67.672 ms 2020-04-02T23:40:10.257 INFO:tasks.workunit.client.0.smithi174.stdout: 10 74014 11.94 MB/sec execute 213 sec latency 70.226 ms 2020-04-02T23:40:11.257 INFO:tasks.workunit.client.0.smithi174.stdout: 10 74261 11.91 MB/sec execute 214 sec latency 63.619 ms 2020-04-02T23:40:12.258 INFO:tasks.workunit.client.0.smithi174.stdout: 10 74508 11.89 MB/sec execute 215 sec latency 90.132 ms 2020-04-02T23:40:13.257 INFO:tasks.workunit.client.0.smithi174.stdout: 10 74748 11.89 MB/sec execute 216 sec latency 54.240 ms 2020-04-02T23:40:14.258 INFO:tasks.workunit.client.0.smithi174.stdout: 10 74972 11.91 MB/sec execute 217 sec latency 154.087 ms 2020-04-02T23:40:15.257 INFO:tasks.workunit.client.0.smithi174.stdout: 10 75271 11.96 MB/sec execute 218 sec latency 73.647 ms 2020-04-02T23:40:16.257 INFO:tasks.workunit.client.0.smithi174.stdout: 10 75559 12.00 MB/sec execute 219 sec latency 61.777 ms 2020-04-02T23:40:17.257 INFO:tasks.workunit.client.0.smithi174.stdout: 10 75802 12.00 MB/sec execute 220 sec latency 75.816 ms 2020-04-02T23:40:18.257 INFO:tasks.workunit.client.0.smithi174.stdout: 10 76006 12.02 MB/sec execute 221 sec latency 86.926 ms 2020-04-02T23:40:19.258 INFO:tasks.workunit.client.0.smithi174.stdout: 10 76182 12.02 MB/sec execute 222 sec latency 143.824 ms 2020-04-02T23:40:20.258 INFO:tasks.workunit.client.0.smithi174.stdout: 10 76370 12.01 MB/sec execute 223 sec latency 54.523 ms 2020-04-02T23:40:21.258 INFO:tasks.workunit.client.0.smithi174.stdout: 10 76565 11.98 MB/sec execute 224 sec latency 91.043 ms 2020-04-02T23:40:22.258 INFO:tasks.workunit.client.0.smithi174.stdout: 10 76707 11.96 MB/sec execute 225 sec latency 111.375 ms 2020-04-02T23:40:23.258 INFO:tasks.workunit.client.0.smithi174.stdout: 10 76883 11.94 MB/sec execute 226 sec latency 85.950 ms 2020-04-02T23:40:24.258 INFO:tasks.workunit.client.0.smithi174.stdout: 10 77023 11.92 MB/sec execute 227 sec latency 143.448 ms 2020-04-02T23:40:25.261 INFO:tasks.workunit.client.0.smithi174.stdout: 10 77253 11.93 MB/sec execute 228 sec latency 68.467 ms 2020-04-02T23:40:26.258 INFO:tasks.workunit.client.0.smithi174.stdout: 10 77466 11.92 MB/sec execute 229 sec latency 126.434 ms 2020-04-02T23:40:27.258 INFO:tasks.workunit.client.0.smithi174.stdout: 10 77697 11.91 MB/sec execute 230 sec latency 94.259 ms 2020-04-02T23:40:28.258 INFO:tasks.workunit.client.0.smithi174.stdout: 10 77942 11.88 MB/sec execute 231 sec latency 71.316 ms 2020-04-02T23:40:29.258 INFO:tasks.workunit.client.0.smithi174.stdout: 10 78186 11.88 MB/sec execute 232 sec latency 51.425 ms 2020-04-02T23:40:30.258 INFO:tasks.workunit.client.0.smithi174.stdout: 10 78437 11.88 MB/sec execute 233 sec latency 64.769 ms 2020-04-02T23:40:31.258 INFO:tasks.workunit.client.0.smithi174.stdout: 10 78710 11.91 MB/sec execute 234 sec latency 66.373 ms 2020-04-02T23:40:32.258 INFO:tasks.workunit.client.0.smithi174.stdout: 10 78987 11.94 MB/sec execute 235 sec latency 94.016 ms 2020-04-02T23:40:33.258 INFO:tasks.workunit.client.0.smithi174.stdout: 10 79272 11.99 MB/sec execute 236 sec latency 51.966 ms 2020-04-02T23:40:34.258 INFO:tasks.workunit.client.0.smithi174.stdout: 10 79478 12.00 MB/sec execute 237 sec latency 132.689 ms 2020-04-02T23:40:35.258 INFO:tasks.workunit.client.0.smithi174.stdout: 10 79666 12.00 MB/sec execute 238 sec latency 74.939 ms 2020-04-02T23:40:36.258 INFO:tasks.workunit.client.0.smithi174.stdout: 10 79854 12.00 MB/sec execute 239 sec latency 102.303 ms 2020-04-02T23:40:37.258 INFO:tasks.workunit.client.0.smithi174.stdout: 10 80045 11.98 MB/sec execute 240 sec latency 68.483 ms 2020-04-02T23:40:38.258 INFO:tasks.workunit.client.0.smithi174.stdout: 10 80192 11.95 MB/sec execute 241 sec latency 107.352 ms 2020-04-02T23:40:39.261 INFO:tasks.workunit.client.0.smithi174.stdout: 10 80352 11.93 MB/sec execute 242 sec latency 94.797 ms 2020-04-02T23:40:40.258 INFO:tasks.workunit.client.0.smithi174.stdout: 10 80533 11.91 MB/sec execute 243 sec latency 66.024 ms 2020-04-02T23:40:41.258 INFO:tasks.workunit.client.0.smithi174.stdout: 10 80754 11.91 MB/sec execute 244 sec latency 68.067 ms 2020-04-02T23:40:42.258 INFO:tasks.workunit.client.0.smithi174.stdout: 10 80975 11.91 MB/sec execute 245 sec latency 59.875 ms 2020-04-02T23:40:43.258 INFO:tasks.workunit.client.0.smithi174.stdout: 10 81199 11.90 MB/sec execute 246 sec latency 87.283 ms 2020-04-02T23:40:44.258 INFO:tasks.workunit.client.0.smithi174.stdout: 10 81411 11.88 MB/sec execute 247 sec latency 160.259 ms 2020-04-02T23:40:45.258 INFO:tasks.workunit.client.0.smithi174.stdout: 10 81662 11.88 MB/sec execute 248 sec latency 54.645 ms 2020-04-02T23:40:46.265 INFO:tasks.workunit.client.0.smithi174.stdout: 10 81927 11.89 MB/sec execute 249 sec latency 57.688 ms 2020-04-02T23:40:47.258 INFO:tasks.workunit.client.0.smithi174.stdout: 10 82195 11.90 MB/sec execute 250 sec latency 122.673 ms 2020-04-02T23:40:48.258 INFO:tasks.workunit.client.0.smithi174.stdout: 10 82493 11.93 MB/sec execute 251 sec latency 62.864 ms 2020-04-02T23:40:49.258 INFO:tasks.workunit.client.0.smithi174.stdout: 10 82759 11.96 MB/sec execute 252 sec latency 63.206 ms 2020-04-02T23:40:50.259 INFO:tasks.workunit.client.0.smithi174.stdout: 10 83020 11.99 MB/sec execute 253 sec latency 76.036 ms 2020-04-02T23:40:51.259 INFO:tasks.workunit.client.0.smithi174.stdout: 10 83234 12.01 MB/sec execute 254 sec latency 120.565 ms 2020-04-02T23:40:52.258 INFO:tasks.workunit.client.0.smithi174.stdout: 10 83446 12.00 MB/sec execute 255 sec latency 84.614 ms 2020-04-02T23:40:53.259 INFO:tasks.workunit.client.0.smithi174.stdout: 10 83649 11.99 MB/sec execute 256 sec latency 73.623 ms 2020-04-02T23:40:54.259 INFO:tasks.workunit.client.0.smithi174.stdout: 10 83788 11.96 MB/sec execute 257 sec latency 120.165 ms 2020-04-02T23:40:55.259 INFO:tasks.workunit.client.0.smithi174.stdout: 10 83985 11.95 MB/sec execute 258 sec latency 90.410 ms 2020-04-02T23:40:56.259 INFO:tasks.workunit.client.0.smithi174.stdout: 10 84186 11.94 MB/sec execute 259 sec latency 89.181 ms 2020-04-02T23:40:57.259 INFO:tasks.workunit.client.0.smithi174.stdout: 10 84419 11.95 MB/sec execute 260 sec latency 56.248 ms 2020-04-02T23:40:58.259 INFO:tasks.workunit.client.0.smithi174.stdout: 10 84633 11.92 MB/sec execute 261 sec latency 81.846 ms 2020-04-02T23:40:59.259 INFO:tasks.workunit.client.0.smithi174.stdout: 10 84885 11.92 MB/sec execute 262 sec latency 53.065 ms 2020-04-02T23:41:00.259 INFO:tasks.workunit.client.0.smithi174.stdout: 10 85132 11.91 MB/sec execute 263 sec latency 61.881 ms 2020-04-02T23:41:01.259 INFO:tasks.workunit.client.0.smithi174.stdout: 10 85370 11.90 MB/sec execute 264 sec latency 65.019 ms 2020-04-02T23:41:02.259 INFO:tasks.workunit.client.0.smithi174.stdout: 10 85620 11.93 MB/sec execute 265 sec latency 70.103 ms 2020-04-02T23:41:03.259 INFO:tasks.workunit.client.0.smithi174.stdout: 10 85851 11.92 MB/sec execute 266 sec latency 61.479 ms 2020-04-02T23:41:04.259 INFO:tasks.workunit.client.0.smithi174.stdout: 10 86049 11.92 MB/sec execute 267 sec latency 151.938 ms 2020-04-02T23:41:05.259 INFO:tasks.workunit.client.0.smithi174.stdout: 10 86302 11.96 MB/sec execute 268 sec latency 71.454 ms 2020-04-02T23:41:06.259 INFO:tasks.workunit.client.0.smithi174.stdout: 10 86543 11.98 MB/sec execute 269 sec latency 49.957 ms 2020-04-02T23:41:07.259 INFO:tasks.workunit.client.0.smithi174.stdout: 10 86764 12.00 MB/sec execute 270 sec latency 59.652 ms 2020-04-02T23:41:08.259 INFO:tasks.workunit.client.0.smithi174.stdout: 10 86987 11.99 MB/sec execute 271 sec latency 62.638 ms 2020-04-02T23:41:09.259 INFO:tasks.workunit.client.0.smithi174.stdout: 10 87170 11.99 MB/sec execute 272 sec latency 65.467 ms 2020-04-02T23:41:10.259 INFO:tasks.workunit.client.0.smithi174.stdout: 10 87329 11.96 MB/sec execute 273 sec latency 90.571 ms 2020-04-02T23:41:11.259 INFO:tasks.workunit.client.0.smithi174.stdout: 10 87509 11.95 MB/sec execute 274 sec latency 86.540 ms 2020-04-02T23:41:12.259 INFO:tasks.workunit.client.0.smithi174.stdout: 10 87696 11.93 MB/sec execute 275 sec latency 69.776 ms 2020-04-02T23:41:13.259 INFO:tasks.workunit.client.0.smithi174.stdout: 10 87858 11.92 MB/sec execute 276 sec latency 131.744 ms 2020-04-02T23:41:14.259 INFO:tasks.workunit.client.0.smithi174.stdout: 10 88031 11.91 MB/sec execute 277 sec latency 152.775 ms 2020-04-02T23:41:15.259 INFO:tasks.workunit.client.0.smithi174.stdout: 10 88229 11.89 MB/sec execute 278 sec latency 73.835 ms 2020-04-02T23:41:16.259 INFO:tasks.workunit.client.0.smithi174.stdout: 10 88457 11.89 MB/sec execute 279 sec latency 46.432 ms 2020-04-02T23:41:17.259 INFO:tasks.workunit.client.0.smithi174.stdout: 10 88706 11.88 MB/sec execute 280 sec latency 51.278 ms 2020-04-02T23:41:18.259 INFO:tasks.workunit.client.0.smithi174.stdout: 10 88967 11.88 MB/sec execute 281 sec latency 64.228 ms 2020-04-02T23:41:18.952 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:41:19.033 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:41:19.036 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:41:19.051 INFO:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:41:19.260 INFO:tasks.workunit.client.0.smithi174.stdout: 10 89242 11.88 MB/sec execute 282 sec latency 52.278 ms 2020-04-02T23:41:20.259 INFO:tasks.workunit.client.0.smithi174.stdout: 10 89540 11.92 MB/sec execute 283 sec latency 48.484 ms 2020-04-02T23:41:21.259 INFO:tasks.workunit.client.0.smithi174.stdout: 10 89849 11.96 MB/sec execute 284 sec latency 46.701 ms 2020-04-02T23:41:22.259 INFO:tasks.workunit.client.0.smithi174.stdout: 10 90093 11.98 MB/sec execute 285 sec latency 72.623 ms 2020-04-02T23:41:23.260 INFO:tasks.workunit.client.0.smithi174.stdout: 10 90343 11.99 MB/sec execute 286 sec latency 71.889 ms 2020-04-02T23:41:24.260 INFO:tasks.workunit.client.0.smithi174.stdout: 10 90531 11.99 MB/sec execute 287 sec latency 172.504 ms 2020-04-02T23:41:25.260 INFO:tasks.workunit.client.0.smithi174.stdout: 10 90693 11.98 MB/sec execute 288 sec latency 84.373 ms 2020-04-02T23:41:26.260 INFO:tasks.workunit.client.0.smithi174.stdout: 10 90877 11.97 MB/sec execute 289 sec latency 83.991 ms 2020-04-02T23:41:27.266 INFO:tasks.workunit.client.0.smithi174.stdout: 10 91049 11.95 MB/sec execute 290 sec latency 70.784 ms 2020-04-02T23:41:28.260 INFO:tasks.workunit.client.0.smithi174.stdout: 10 91223 11.93 MB/sec execute 291 sec latency 67.085 ms 2020-04-02T23:41:29.260 INFO:tasks.workunit.client.0.smithi174.stdout: 10 91405 11.92 MB/sec execute 292 sec latency 78.685 ms 2020-04-02T23:41:30.260 INFO:tasks.workunit.client.0.smithi174.stdout: 10 91596 11.91 MB/sec execute 293 sec latency 68.486 ms 2020-04-02T23:41:31.260 INFO:tasks.workunit.client.0.smithi174.stdout: 10 91816 11.91 MB/sec execute 294 sec latency 49.218 ms 2020-04-02T23:41:32.260 INFO:tasks.workunit.client.0.smithi174.stdout: 10 92047 11.90 MB/sec execute 295 sec latency 70.630 ms 2020-04-02T23:41:33.264 INFO:tasks.workunit.client.0.smithi174.stdout: 10 92305 11.89 MB/sec execute 296 sec latency 70.326 ms 2020-04-02T23:41:34.263 INFO:tasks.workunit.client.0.smithi174.stdout: 10 92530 11.88 MB/sec execute 297 sec latency 140.708 ms 2020-04-02T23:41:35.263 INFO:tasks.workunit.client.0.smithi174.stdout: 10 92803 11.89 MB/sec execute 298 sec latency 60.689 ms 2020-04-02T23:41:36.263 INFO:tasks.workunit.client.0.smithi174.stdout: 10 93100 11.92 MB/sec execute 299 sec latency 55.487 ms 2020-04-02T23:41:37.263 INFO:tasks.workunit.client.0.smithi174.stdout: 10 93377 11.95 MB/sec execute 300 sec latency 101.166 ms 2020-04-02T23:41:38.263 INFO:tasks.workunit.client.0.smithi174.stdout: 10 93651 11.98 MB/sec execute 301 sec latency 53.042 ms 2020-04-02T23:41:39.263 INFO:tasks.workunit.client.0.smithi174.stdout: 10 93907 11.99 MB/sec execute 302 sec latency 68.937 ms 2020-04-02T23:41:40.263 INFO:tasks.workunit.client.0.smithi174.stdout: 10 94090 12.00 MB/sec execute 303 sec latency 101.701 ms 2020-04-02T23:41:41.263 INFO:tasks.workunit.client.0.smithi174.stdout: 10 94262 11.98 MB/sec execute 304 sec latency 88.503 ms 2020-04-02T23:41:42.263 INFO:tasks.workunit.client.0.smithi174.stdout: 10 94446 11.97 MB/sec execute 305 sec latency 89.676 ms 2020-04-02T23:41:43.263 INFO:tasks.workunit.client.0.smithi174.stdout: 10 94627 11.95 MB/sec execute 306 sec latency 80.952 ms 2020-04-02T23:41:44.263 INFO:tasks.workunit.client.0.smithi174.stdout: 10 94791 11.94 MB/sec execute 307 sec latency 135.889 ms 2020-04-02T23:41:45.264 INFO:tasks.workunit.client.0.smithi174.stdout: 10 94992 11.93 MB/sec execute 308 sec latency 61.967 ms 2020-04-02T23:41:46.263 INFO:tasks.workunit.client.0.smithi174.stdout: 10 95191 11.92 MB/sec execute 309 sec latency 117.011 ms 2020-04-02T23:41:47.263 INFO:tasks.workunit.client.0.smithi174.stdout: 10 95411 11.91 MB/sec execute 310 sec latency 65.381 ms 2020-04-02T23:41:48.264 INFO:tasks.workunit.client.0.smithi174.stdout: 10 95649 11.91 MB/sec execute 311 sec latency 46.548 ms 2020-04-02T23:41:49.195 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:41:49.215 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:41:49.257 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:41:49.263 INFO:tasks.workunit.client.0.smithi174.stdout: 10 95890 11.90 MB/sec execute 312 sec latency 49.138 ms 2020-04-02T23:41:49.271 INFO:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:41:50.263 INFO:tasks.workunit.client.0.smithi174.stdout: 10 96130 11.90 MB/sec execute 313 sec latency 127.020 ms 2020-04-02T23:41:51.263 INFO:tasks.workunit.client.0.smithi174.stdout: 10 96382 11.91 MB/sec execute 314 sec latency 48.687 ms 2020-04-02T23:41:52.264 INFO:tasks.workunit.client.0.smithi174.stdout: 10 96651 11.92 MB/sec execute 315 sec latency 57.241 ms 2020-04-02T23:41:53.264 INFO:tasks.workunit.client.0.smithi174.stdout: 10 96922 11.95 MB/sec execute 316 sec latency 66.063 ms 2020-04-02T23:41:54.264 INFO:tasks.workunit.client.0.smithi174.stdout: 10 97174 11.97 MB/sec execute 317 sec latency 122.312 ms 2020-04-02T23:41:55.264 INFO:tasks.workunit.client.0.smithi174.stdout: 10 97433 11.98 MB/sec execute 318 sec latency 45.315 ms 2020-04-02T23:41:56.264 INFO:tasks.workunit.client.0.smithi174.stdout: 10 97638 11.99 MB/sec execute 319 sec latency 72.176 ms 2020-04-02T23:41:57.264 INFO:tasks.workunit.client.0.smithi174.stdout: 10 97808 11.98 MB/sec execute 320 sec latency 67.832 ms 2020-04-02T23:41:58.264 INFO:tasks.workunit.client.0.smithi174.stdout: 10 97995 11.98 MB/sec execute 321 sec latency 75.221 ms 2020-04-02T23:41:59.264 INFO:tasks.workunit.client.0.smithi174.stdout: 10 98181 11.96 MB/sec execute 322 sec latency 95.780 ms 2020-04-02T23:42:00.264 INFO:tasks.workunit.client.0.smithi174.stdout: 10 98324 11.94 MB/sec execute 323 sec latency 131.667 ms 2020-04-02T23:42:01.264 INFO:tasks.workunit.client.0.smithi174.stdout: 10 98528 11.93 MB/sec execute 324 sec latency 67.924 ms 2020-04-02T23:42:02.264 INFO:tasks.workunit.client.0.smithi174.stdout: 10 98734 11.92 MB/sec execute 325 sec latency 69.159 ms 2020-04-02T23:42:03.264 INFO:tasks.workunit.client.0.smithi174.stdout: 10 98950 11.91 MB/sec execute 326 sec latency 58.478 ms 2020-04-02T23:42:04.264 INFO:tasks.workunit.client.0.smithi174.stdout: 10 99170 11.91 MB/sec execute 327 sec latency 134.315 ms 2020-04-02T23:42:05.264 INFO:tasks.workunit.client.0.smithi174.stdout: 10 99429 11.91 MB/sec execute 328 sec latency 45.911 ms 2020-04-02T23:42:06.264 INFO:tasks.workunit.client.0.smithi174.stdout: 10 99674 11.91 MB/sec execute 329 sec latency 62.837 ms 2020-04-02T23:42:07.264 INFO:tasks.workunit.client.0.smithi174.stdout: 10 99934 11.91 MB/sec execute 330 sec latency 86.815 ms 2020-04-02T23:42:08.265 INFO:tasks.workunit.client.0.smithi174.stdout: 10 100224 11.94 MB/sec execute 331 sec latency 37.834 ms 2020-04-02T23:42:09.264 INFO:tasks.workunit.client.0.smithi174.stdout: 10 100465 11.94 MB/sec execute 332 sec latency 61.623 ms 2020-04-02T23:42:10.264 INFO:tasks.workunit.client.0.smithi174.stdout: 10 100735 11.97 MB/sec execute 333 sec latency 66.041 ms 2020-04-02T23:42:11.273 INFO:tasks.workunit.client.0.smithi174.stdout: 10 100982 11.98 MB/sec execute 334 sec latency 75.552 ms 2020-04-02T23:42:12.265 INFO:tasks.workunit.client.0.smithi174.stdout: 10 101194 11.99 MB/sec execute 335 sec latency 58.885 ms 2020-04-02T23:42:13.264 INFO:tasks.workunit.client.0.smithi174.stdout: 10 101406 11.99 MB/sec execute 336 sec latency 104.110 ms 2020-04-02T23:42:14.264 INFO:tasks.workunit.client.0.smithi174.stdout: 10 101580 11.99 MB/sec execute 337 sec latency 117.966 ms 2020-04-02T23:42:15.268 INFO:tasks.workunit.client.0.smithi174.stdout: 10 101747 11.97 MB/sec execute 338 sec latency 79.830 ms 2020-04-02T23:42:16.265 INFO:tasks.workunit.client.0.smithi174.stdout: 10 101945 11.96 MB/sec execute 339 sec latency 68.740 ms 2020-04-02T23:42:17.264 INFO:tasks.workunit.client.0.smithi174.stdout: 10 102157 11.95 MB/sec execute 340 sec latency 79.545 ms 2020-04-02T23:42:18.264 INFO:tasks.workunit.client.0.smithi174.stdout: 10 102361 11.93 MB/sec execute 341 sec latency 77.665 ms 2020-04-02T23:42:19.264 INFO:tasks.workunit.client.0.smithi174.stdout: 10 102610 11.93 MB/sec execute 342 sec latency 54.205 ms 2020-04-02T23:42:19.811 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:42:19.841 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:42:19.883 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:42:19.909 INFO:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:42:20.264 INFO:tasks.workunit.client.0.smithi174.stdout: 10 102863 11.93 MB/sec execute 343 sec latency 59.355 ms 2020-04-02T23:42:21.265 INFO:tasks.workunit.client.0.smithi174.stdout: 10 103123 11.94 MB/sec execute 344 sec latency 78.728 ms 2020-04-02T23:42:22.264 INFO:tasks.workunit.client.0.smithi174.stdout: 10 103400 11.95 MB/sec execute 345 sec latency 69.238 ms 2020-04-02T23:42:23.265 INFO:tasks.workunit.client.0.smithi174.stdout: 10 103681 11.96 MB/sec execute 346 sec latency 48.969 ms 2020-04-02T23:42:24.265 INFO:tasks.workunit.client.0.smithi174.stdout: 10 103891 11.96 MB/sec execute 347 sec latency 217.715 ms 2020-04-02T23:42:25.265 INFO:tasks.workunit.client.0.smithi174.stdout: 10 104130 11.97 MB/sec execute 348 sec latency 81.722 ms 2020-04-02T23:42:26.265 INFO:tasks.workunit.client.0.smithi174.stdout: 10 104381 11.98 MB/sec execute 349 sec latency 87.493 ms 2020-04-02T23:42:27.265 INFO:tasks.workunit.client.0.smithi174.stdout: 10 104632 11.99 MB/sec execute 350 sec latency 64.078 ms 2020-04-02T23:42:28.265 INFO:tasks.workunit.client.0.smithi174.stdout: 10 104849 12.00 MB/sec execute 351 sec latency 71.328 ms 2020-04-02T23:42:29.265 INFO:tasks.workunit.client.0.smithi174.stdout: 10 105035 11.99 MB/sec execute 352 sec latency 72.828 ms 2020-04-02T23:42:30.265 INFO:tasks.workunit.client.0.smithi174.stdout: 10 105238 11.99 MB/sec execute 353 sec latency 73.436 ms 2020-04-02T23:42:31.267 INFO:tasks.workunit.client.0.smithi174.stdout: 10 105424 11.99 MB/sec execute 354 sec latency 79.204 ms 2020-04-02T23:42:32.265 INFO:tasks.workunit.client.0.smithi174.stdout: 10 105604 11.97 MB/sec execute 355 sec latency 100.897 ms 2020-04-02T23:42:33.265 INFO:tasks.workunit.client.0.smithi174.stdout: 10 105833 11.96 MB/sec execute 356 sec latency 76.438 ms 2020-04-02T23:42:34.265 INFO:tasks.workunit.client.0.smithi174.stdout: 10 106001 11.94 MB/sec execute 357 sec latency 155.048 ms 2020-04-02T23:42:35.265 INFO:tasks.workunit.client.0.smithi174.stdout: 10 106223 11.94 MB/sec execute 358 sec latency 158.580 ms 2020-04-02T23:42:36.265 INFO:tasks.workunit.client.0.smithi174.stdout: 10 106505 11.95 MB/sec execute 359 sec latency 49.711 ms 2020-04-02T23:42:37.265 INFO:tasks.workunit.client.0.smithi174.stdout: 10 106757 11.95 MB/sec execute 360 sec latency 58.707 ms 2020-04-02T23:42:38.265 INFO:tasks.workunit.client.0.smithi174.stdout: 10 107032 11.97 MB/sec execute 361 sec latency 57.542 ms 2020-04-02T23:42:39.265 INFO:tasks.workunit.client.0.smithi174.stdout: 10 107300 11.97 MB/sec execute 362 sec latency 63.063 ms 2020-04-02T23:42:40.265 INFO:tasks.workunit.client.0.smithi174.stdout: 10 107530 11.98 MB/sec execute 363 sec latency 120.650 ms 2020-04-02T23:42:41.265 INFO:tasks.workunit.client.0.smithi174.stdout: 10 107802 11.99 MB/sec execute 364 sec latency 61.210 ms 2020-04-02T23:42:42.265 INFO:tasks.workunit.client.0.smithi174.stdout: 10 108060 12.00 MB/sec execute 365 sec latency 65.413 ms 2020-04-02T23:42:43.265 INFO:tasks.workunit.client.0.smithi174.stdout: 10 108272 12.00 MB/sec execute 366 sec latency 84.465 ms 2020-04-02T23:42:44.265 INFO:tasks.workunit.client.0.smithi174.stdout: 10 108466 12.01 MB/sec execute 367 sec latency 154.431 ms 2020-04-02T23:42:45.266 INFO:tasks.workunit.client.0.smithi174.stdout: 10 108672 12.01 MB/sec execute 368 sec latency 107.450 ms 2020-04-02T23:42:46.265 INFO:tasks.workunit.client.0.smithi174.stdout: 10 108838 12.00 MB/sec execute 369 sec latency 92.375 ms 2020-04-02T23:42:47.265 INFO:tasks.workunit.client.0.smithi174.stdout: 10 109029 11.99 MB/sec execute 370 sec latency 59.885 ms 2020-04-02T23:42:48.265 INFO:tasks.workunit.client.0.smithi174.stdout: 10 109234 11.98 MB/sec execute 371 sec latency 69.358 ms 2020-04-02T23:42:49.265 INFO:tasks.workunit.client.0.smithi174.stdout: 10 109439 11.96 MB/sec execute 372 sec latency 73.567 ms 2020-04-02T23:42:50.023 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:42:50.041 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:42:50.083 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:42:50.097 INFO:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:42:50.180 INFO:tasks.ceph.mds.b.smithi196.stderr:2020-04-02T23:42:50.177+0000 7f90d48d2700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 25923) UID: 0 2020-04-02T23:42:50.265 INFO:tasks.workunit.client.0.smithi174.stdout: 10 109675 11.96 MB/sec execute 373 sec latency 93.219 ms 2020-04-02T23:42:51.265 INFO:tasks.workunit.client.0.smithi174.stdout: 10 109927 11.96 MB/sec execute 374 sec latency 58.846 ms 2020-04-02T23:42:52.265 INFO:tasks.workunit.client.0.smithi174.stdout: 10 110171 11.97 MB/sec execute 375 sec latency 58.268 ms 2020-04-02T23:42:53.265 INFO:tasks.workunit.client.0.smithi174.stdout: 10 110429 11.98 MB/sec execute 376 sec latency 82.615 ms 2020-04-02T23:42:54.266 INFO:tasks.workunit.client.0.smithi174.stdout: 10 110658 11.98 MB/sec execute 377 sec latency 138.414 ms 2020-04-02T23:42:55.265 INFO:tasks.workunit.client.0.smithi174.stdout: 10 110914 11.97 MB/sec execute 378 sec latency 57.394 ms 2020-04-02T23:42:56.266 INFO:tasks.workunit.client.0.smithi174.stdout: 10 111142 11.98 MB/sec execute 379 sec latency 56.214 ms 2020-04-02T23:42:57.266 INFO:tasks.workunit.client.0.smithi174.stdout: 10 111373 11.98 MB/sec execute 380 sec latency 75.512 ms 2020-04-02T23:42:58.266 INFO:tasks.workunit.client.0.smithi174.stdout: 10 111597 12.00 MB/sec execute 381 sec latency 83.393 ms 2020-04-02T23:42:59.266 INFO:tasks.workunit.client.0.smithi174.stdout: 10 111840 12.00 MB/sec execute 382 sec latency 56.576 ms 2020-04-02T23:43:00.266 INFO:tasks.workunit.client.0.smithi174.stdout: 10 112069 12.02 MB/sec execute 383 sec latency 76.003 ms 2020-04-02T23:43:01.266 INFO:tasks.workunit.client.0.smithi174.stdout: 10 112273 12.02 MB/sec execute 384 sec latency 68.209 ms 2020-04-02T23:43:02.266 INFO:tasks.workunit.client.0.smithi174.stdout: 10 112451 12.01 MB/sec execute 385 sec latency 84.433 ms 2020-04-02T23:43:03.266 INFO:tasks.workunit.client.0.smithi174.stdout: 10 112629 11.99 MB/sec execute 386 sec latency 97.537 ms 2020-04-02T23:43:04.266 INFO:tasks.workunit.client.0.smithi174.stdout: 10 112774 11.98 MB/sec execute 387 sec latency 206.062 ms 2020-04-02T23:43:05.266 INFO:tasks.workunit.client.0.smithi174.stdout: 10 112957 11.96 MB/sec execute 388 sec latency 80.860 ms 2020-04-02T23:43:06.266 INFO:tasks.workunit.client.0.smithi174.stdout: 10 113153 11.95 MB/sec execute 389 sec latency 89.432 ms 2020-04-02T23:43:07.266 INFO:tasks.workunit.client.0.smithi174.stdout: 10 113402 11.96 MB/sec execute 390 sec latency 56.088 ms 2020-04-02T23:43:08.266 INFO:tasks.workunit.client.0.smithi174.stdout: 10 113641 11.95 MB/sec execute 391 sec latency 45.751 ms 2020-04-02T23:43:09.266 INFO:tasks.workunit.client.0.smithi174.stdout: 10 113904 11.97 MB/sec execute 392 sec latency 45.998 ms 2020-04-02T23:43:10.266 INFO:tasks.workunit.client.0.smithi174.stdout: 10 114117 11.97 MB/sec execute 393 sec latency 63.492 ms 2020-04-02T23:43:11.266 INFO:tasks.workunit.client.0.smithi174.stdout: 10 114369 11.97 MB/sec execute 394 sec latency 44.852 ms 2020-04-02T23:43:12.266 INFO:tasks.workunit.client.0.smithi174.stdout: 10 114634 11.97 MB/sec execute 395 sec latency 61.030 ms 2020-04-02T23:43:13.266 INFO:tasks.workunit.client.0.smithi174.stdout: 10 114863 11.97 MB/sec execute 396 sec latency 58.934 ms 2020-04-02T23:43:14.266 INFO:tasks.workunit.client.0.smithi174.stdout: 10 115045 11.97 MB/sec execute 397 sec latency 144.658 ms 2020-04-02T23:43:15.266 INFO:tasks.workunit.client.0.smithi174.stdout: 10 115272 11.99 MB/sec execute 398 sec latency 93.770 ms 2020-04-02T23:43:16.266 INFO:tasks.workunit.client.0.smithi174.stdout: 10 115527 12.00 MB/sec execute 399 sec latency 71.518 ms 2020-04-02T23:43:17.266 INFO:tasks.workunit.client.0.smithi174.stdout: 10 115742 12.00 MB/sec execute 400 sec latency 73.205 ms 2020-04-02T23:43:18.266 INFO:tasks.workunit.client.0.smithi174.stdout: 10 115919 11.99 MB/sec execute 401 sec latency 92.258 ms 2020-04-02T23:43:19.266 INFO:tasks.workunit.client.0.smithi174.stdout: 10 116109 11.98 MB/sec execute 402 sec latency 78.956 ms 2020-04-02T23:43:20.266 INFO:tasks.workunit.client.0.smithi174.stdout: 10 116279 11.97 MB/sec execute 403 sec latency 146.905 ms 2020-04-02T23:43:21.266 INFO:tasks.workunit.client.0.smithi174.stdout: 10 116445 11.95 MB/sec execute 404 sec latency 73.249 ms 2020-04-02T23:43:22.266 INFO:tasks.workunit.client.0.smithi174.stdout: 10 116659 11.96 MB/sec execute 405 sec latency 84.188 ms 2020-04-02T23:43:23.266 INFO:tasks.workunit.client.0.smithi174.stdout: 10 116885 11.95 MB/sec execute 406 sec latency 84.125 ms 2020-04-02T23:43:24.266 INFO:tasks.workunit.client.0.smithi174.stdout: 10 117085 11.94 MB/sec execute 407 sec latency 219.053 ms 2020-04-02T23:43:25.266 INFO:tasks.workunit.client.0.smithi174.stdout: 10 117326 11.95 MB/sec execute 408 sec latency 69.982 ms 2020-04-02T23:43:26.266 INFO:tasks.workunit.client.0.smithi174.stdout: 10 117570 11.96 MB/sec execute 409 sec latency 65.587 ms 2020-04-02T23:43:27.266 INFO:tasks.workunit.client.0.smithi174.stdout: 10 117799 11.96 MB/sec execute 410 sec latency 53.313 ms 2020-04-02T23:43:28.266 INFO:tasks.workunit.client.0.smithi174.stdout: 10 118048 11.96 MB/sec execute 411 sec latency 58.487 ms 2020-04-02T23:43:29.267 INFO:tasks.workunit.client.0.smithi174.stdout: 10 118277 11.95 MB/sec execute 412 sec latency 44.020 ms 2020-04-02T23:43:30.266 INFO:tasks.workunit.client.0.smithi174.stdout: 10 118513 11.95 MB/sec execute 413 sec latency 62.779 ms 2020-04-02T23:43:31.266 INFO:tasks.workunit.client.0.smithi174.stdout: 10 118725 11.96 MB/sec execute 414 sec latency 81.042 ms 2020-04-02T23:43:32.266 INFO:tasks.workunit.client.0.smithi174.stdout: 10 118990 11.98 MB/sec execute 415 sec latency 60.707 ms 2020-04-02T23:43:33.267 INFO:tasks.workunit.client.0.smithi174.stdout: 10 119241 11.99 MB/sec execute 416 sec latency 54.555 ms 2020-04-02T23:43:34.267 INFO:tasks.workunit.client.0.smithi174.stdout: 10 119421 11.99 MB/sec execute 417 sec latency 161.047 ms 2020-04-02T23:43:35.267 INFO:tasks.workunit.client.0.smithi174.stdout: 10 119623 11.98 MB/sec execute 418 sec latency 86.004 ms 2020-04-02T23:43:36.267 INFO:tasks.workunit.client.0.smithi174.stdout: 10 119817 11.97 MB/sec execute 419 sec latency 69.773 ms 2020-04-02T23:43:37.267 INFO:tasks.workunit.client.0.smithi174.stdout: 10 119984 11.96 MB/sec execute 420 sec latency 104.598 ms 2020-04-02T23:43:38.267 INFO:tasks.workunit.client.0.smithi174.stdout: 10 120192 11.96 MB/sec execute 421 sec latency 79.111 ms 2020-04-02T23:43:39.267 INFO:tasks.workunit.client.0.smithi174.stdout: 10 120424 11.95 MB/sec execute 422 sec latency 84.427 ms 2020-04-02T23:43:40.267 INFO:tasks.workunit.client.0.smithi174.stdout: 10 120625 11.94 MB/sec execute 423 sec latency 89.176 ms 2020-04-02T23:43:41.267 INFO:tasks.workunit.client.0.smithi174.stdout: 10 120871 11.95 MB/sec execute 424 sec latency 90.371 ms 2020-04-02T23:43:42.267 INFO:tasks.workunit.client.0.smithi174.stdout: 10 121107 11.96 MB/sec execute 425 sec latency 64.856 ms 2020-04-02T23:43:43.267 INFO:tasks.workunit.client.0.smithi174.stdout: 10 121319 11.96 MB/sec execute 426 sec latency 70.755 ms 2020-04-02T23:43:44.268 INFO:tasks.workunit.client.0.smithi174.stdout: 10 121522 11.96 MB/sec execute 427 sec latency 138.204 ms 2020-04-02T23:43:45.267 INFO:tasks.workunit.client.0.smithi174.stdout: 10 121739 11.95 MB/sec execute 428 sec latency 67.013 ms 2020-04-02T23:43:46.267 INFO:tasks.workunit.client.0.smithi174.stdout: 10 121957 11.93 MB/sec execute 429 sec latency 57.339 ms 2020-04-02T23:43:47.267 INFO:tasks.workunit.client.0.smithi174.stdout: 10 122173 11.94 MB/sec execute 430 sec latency 71.944 ms 2020-04-02T23:43:48.267 INFO:tasks.workunit.client.0.smithi174.stdout: 10 122380 11.94 MB/sec execute 431 sec latency 70.855 ms 2020-04-02T23:43:49.267 INFO:tasks.workunit.client.0.smithi174.stdout: 10 122663 11.97 MB/sec execute 432 sec latency 57.669 ms 2020-04-02T23:43:50.267 INFO:tasks.workunit.client.0.smithi174.stdout: 10 122856 11.96 MB/sec execute 433 sec latency 102.096 ms 2020-04-02T23:43:51.267 INFO:tasks.workunit.client.0.smithi174.stdout: 10 123089 11.96 MB/sec execute 434 sec latency 94.972 ms 2020-04-02T23:43:52.267 INFO:tasks.workunit.client.0.smithi174.stdout: 10 123285 11.96 MB/sec execute 435 sec latency 103.518 ms 2020-04-02T23:43:53.267 INFO:tasks.workunit.client.0.smithi174.stdout: 10 123476 11.96 MB/sec execute 436 sec latency 70.787 ms 2020-04-02T23:43:54.267 INFO:tasks.workunit.client.0.smithi174.stdout: 10 123655 11.96 MB/sec execute 437 sec latency 180.340 ms 2020-04-02T23:43:55.267 INFO:tasks.workunit.client.0.smithi174.stdout: 10 123876 11.95 MB/sec execute 438 sec latency 59.578 ms 2020-04-02T23:43:56.267 INFO:tasks.workunit.client.0.smithi174.stdout: 10 124068 11.94 MB/sec execute 439 sec latency 93.283 ms 2020-04-02T23:43:57.269 INFO:tasks.workunit.client.0.smithi174.stdout: 10 124267 11.93 MB/sec execute 440 sec latency 98.578 ms 2020-04-02T23:43:58.267 INFO:tasks.workunit.client.0.smithi174.stdout: 10 124488 11.93 MB/sec execute 441 sec latency 75.608 ms 2020-04-02T23:43:59.267 INFO:tasks.workunit.client.0.smithi174.stdout: 10 124706 11.93 MB/sec execute 442 sec latency 77.676 ms 2020-04-02T23:44:00.267 INFO:tasks.workunit.client.0.smithi174.stdout: 10 124923 11.94 MB/sec execute 443 sec latency 74.694 ms 2020-04-02T23:44:01.267 INFO:tasks.workunit.client.0.smithi174.stdout: 10 125136 11.93 MB/sec execute 444 sec latency 74.885 ms 2020-04-02T23:44:02.267 INFO:tasks.workunit.client.0.smithi174.stdout: 10 125358 11.93 MB/sec execute 445 sec latency 80.730 ms 2020-04-02T23:44:03.267 INFO:tasks.workunit.client.0.smithi174.stdout: 10 125573 11.92 MB/sec execute 446 sec latency 52.931 ms 2020-04-02T23:44:04.267 INFO:tasks.workunit.client.0.smithi174.stdout: 10 125776 11.92 MB/sec execute 447 sec latency 122.124 ms 2020-04-02T23:44:05.268 INFO:tasks.workunit.client.0.smithi174.stdout: 10 126006 11.93 MB/sec execute 448 sec latency 57.828 ms 2020-04-02T23:44:06.268 INFO:tasks.workunit.client.0.smithi174.stdout: 10 126254 11.94 MB/sec execute 449 sec latency 71.734 ms 2020-04-02T23:44:07.268 INFO:tasks.workunit.client.0.smithi174.stdout: 10 126516 11.94 MB/sec execute 450 sec latency 59.857 ms 2020-04-02T23:44:08.268 INFO:tasks.workunit.client.0.smithi174.stdout: 10 126728 11.95 MB/sec execute 451 sec latency 61.797 ms 2020-04-02T23:44:09.268 INFO:tasks.workunit.client.0.smithi174.stdout: 10 126905 11.94 MB/sec execute 452 sec latency 95.792 ms 2020-04-02T23:44:10.268 INFO:tasks.workunit.client.0.smithi174.stdout: 10 127108 11.95 MB/sec execute 453 sec latency 62.111 ms 2020-04-02T23:44:11.268 INFO:tasks.workunit.client.0.smithi174.stdout: 10 127302 11.94 MB/sec execute 454 sec latency 104.266 ms 2020-04-02T23:44:12.268 INFO:tasks.workunit.client.0.smithi174.stdout: 10 127522 11.93 MB/sec execute 455 sec latency 97.403 ms 2020-04-02T23:44:13.268 INFO:tasks.workunit.client.0.smithi174.stdout: 10 127709 11.92 MB/sec execute 456 sec latency 100.141 ms 2020-04-02T23:44:14.268 INFO:tasks.workunit.client.0.smithi174.stdout: 10 127897 11.92 MB/sec execute 457 sec latency 143.671 ms 2020-04-02T23:44:15.269 INFO:tasks.workunit.client.0.smithi174.stdout: 10 128126 11.92 MB/sec execute 458 sec latency 65.258 ms 2020-04-02T23:44:16.268 INFO:tasks.workunit.client.0.smithi174.stdout: 10 128338 11.92 MB/sec execute 459 sec latency 69.614 ms 2020-04-02T23:44:17.268 INFO:tasks.workunit.client.0.smithi174.stdout: 10 128575 11.93 MB/sec execute 460 sec latency 49.559 ms 2020-04-02T23:44:18.268 INFO:tasks.workunit.client.0.smithi174.stdout: 10 128796 11.92 MB/sec execute 461 sec latency 93.526 ms 2020-04-02T23:44:19.268 INFO:tasks.workunit.client.0.smithi174.stdout: 10 129020 11.92 MB/sec execute 462 sec latency 48.804 ms 2020-04-02T23:44:20.268 INFO:tasks.workunit.client.0.smithi174.stdout: 10 129243 11.91 MB/sec execute 463 sec latency 69.464 ms 2020-04-02T23:44:21.268 INFO:tasks.workunit.client.0.smithi174.stdout: 10 129485 11.92 MB/sec execute 464 sec latency 62.599 ms 2020-04-02T23:44:22.268 INFO:tasks.workunit.client.0.smithi174.stdout: 10 129725 11.92 MB/sec execute 465 sec latency 59.752 ms 2020-04-02T23:44:23.268 INFO:tasks.workunit.client.0.smithi174.stdout: 10 129975 11.93 MB/sec execute 466 sec latency 53.032 ms 2020-04-02T23:44:24.268 INFO:tasks.workunit.client.0.smithi174.stdout: 10 130232 11.94 MB/sec execute 467 sec latency 164.602 ms 2020-04-02T23:44:25.268 INFO:tasks.workunit.client.0.smithi174.stdout: 10 130447 11.94 MB/sec execute 468 sec latency 62.714 ms 2020-04-02T23:44:26.268 INFO:tasks.workunit.client.0.smithi174.stdout: 10 130665 11.95 MB/sec execute 469 sec latency 79.894 ms 2020-04-02T23:44:27.268 INFO:tasks.workunit.client.0.smithi174.stdout: 10 130874 11.94 MB/sec execute 470 sec latency 73.248 ms 2020-04-02T23:44:28.268 INFO:tasks.workunit.client.0.smithi174.stdout: 10 131075 11.93 MB/sec execute 471 sec latency 59.111 ms 2020-04-02T23:44:29.268 INFO:tasks.workunit.client.0.smithi174.stdout: 10 131280 11.93 MB/sec execute 472 sec latency 64.049 ms 2020-04-02T23:44:30.268 INFO:tasks.workunit.client.0.smithi174.stdout: 10 131470 11.92 MB/sec execute 473 sec latency 70.506 ms 2020-04-02T23:44:31.268 INFO:tasks.workunit.client.0.smithi174.stdout: 10 131675 11.92 MB/sec execute 474 sec latency 74.791 ms 2020-04-02T23:44:32.268 INFO:tasks.workunit.client.0.smithi174.stdout: 10 131878 11.92 MB/sec execute 475 sec latency 66.432 ms 2020-04-02T23:44:33.268 INFO:tasks.workunit.client.0.smithi174.stdout: 10 132101 11.93 MB/sec execute 476 sec latency 47.828 ms 2020-04-02T23:44:34.268 INFO:tasks.workunit.client.0.smithi174.stdout: 10 132298 11.92 MB/sec execute 477 sec latency 173.869 ms 2020-04-02T23:44:35.269 INFO:tasks.workunit.client.0.smithi174.stdout: 10 132493 11.91 MB/sec execute 478 sec latency 70.931 ms 2020-04-02T23:44:36.269 INFO:tasks.workunit.client.0.smithi174.stdout: 10 132693 11.90 MB/sec execute 479 sec latency 81.043 ms 2020-04-02T23:44:37.269 INFO:tasks.workunit.client.0.smithi174.stdout: 10 132907 11.90 MB/sec execute 480 sec latency 81.741 ms 2020-04-02T23:44:38.269 INFO:tasks.workunit.client.0.smithi174.stdout: 10 133124 11.90 MB/sec execute 481 sec latency 63.564 ms 2020-04-02T23:44:39.269 INFO:tasks.workunit.client.0.smithi174.stdout: 10 133356 11.91 MB/sec execute 482 sec latency 66.804 ms 2020-04-02T23:44:40.269 INFO:tasks.workunit.client.0.smithi174.stdout: 10 133622 11.92 MB/sec execute 483 sec latency 68.745 ms 2020-04-02T23:44:41.269 INFO:tasks.workunit.client.0.smithi174.stdout: 10 133860 11.93 MB/sec execute 484 sec latency 63.526 ms 2020-04-02T23:44:42.269 INFO:tasks.workunit.client.0.smithi174.stdout: 10 134084 11.93 MB/sec execute 485 sec latency 91.647 ms 2020-04-02T23:44:43.269 INFO:tasks.workunit.client.0.smithi174.stdout: 10 134294 11.93 MB/sec execute 486 sec latency 76.740 ms 2020-04-02T23:44:44.269 INFO:tasks.workunit.client.0.smithi174.stdout: 10 134488 11.92 MB/sec execute 487 sec latency 121.478 ms 2020-04-02T23:44:45.269 INFO:tasks.workunit.client.0.smithi174.stdout: 10 134670 11.91 MB/sec execute 488 sec latency 64.345 ms 2020-04-02T23:44:46.269 INFO:tasks.workunit.client.0.smithi174.stdout: 10 134860 11.91 MB/sec execute 489 sec latency 82.153 ms 2020-04-02T23:44:47.269 INFO:tasks.workunit.client.0.smithi174.stdout: 10 135041 11.90 MB/sec execute 490 sec latency 74.784 ms 2020-04-02T23:44:48.269 INFO:tasks.workunit.client.0.smithi174.stdout: 10 135245 11.90 MB/sec execute 491 sec latency 62.947 ms 2020-04-02T23:44:49.269 INFO:tasks.workunit.client.0.smithi174.stdout: 10 135472 11.91 MB/sec execute 492 sec latency 66.445 ms 2020-04-02T23:44:50.269 INFO:tasks.workunit.client.0.smithi174.stdout: 10 135691 11.91 MB/sec execute 493 sec latency 96.333 ms 2020-04-02T23:44:51.269 INFO:tasks.workunit.client.0.smithi174.stdout: 10 135923 11.91 MB/sec execute 494 sec latency 71.408 ms 2020-04-02T23:44:52.269 INFO:tasks.workunit.client.0.smithi174.stdout: 10 136149 11.90 MB/sec execute 495 sec latency 91.944 ms 2020-04-02T23:44:53.269 INFO:tasks.workunit.client.0.smithi174.stdout: 10 136388 11.90 MB/sec execute 496 sec latency 64.805 ms 2020-04-02T23:44:54.269 INFO:tasks.workunit.client.0.smithi174.stdout: 10 136584 11.90 MB/sec execute 497 sec latency 133.261 ms 2020-04-02T23:44:55.269 INFO:tasks.workunit.client.0.smithi174.stdout: 10 136805 11.89 MB/sec execute 498 sec latency 66.076 ms 2020-04-02T23:44:56.269 INFO:tasks.workunit.client.0.smithi174.stdout: 10 137073 11.91 MB/sec execute 499 sec latency 51.486 ms 2020-04-02T23:44:57.269 INFO:tasks.workunit.client.0.smithi174.stdout: 10 137323 11.91 MB/sec execute 500 sec latency 70.597 ms 2020-04-02T23:44:58.269 INFO:tasks.workunit.client.0.smithi174.stdout: 10 137570 11.93 MB/sec execute 501 sec latency 72.479 ms 2020-04-02T23:44:59.269 INFO:tasks.workunit.client.0.smithi174.stdout: 10 137768 11.92 MB/sec execute 502 sec latency 78.680 ms 2020-04-02T23:45:00.269 INFO:tasks.workunit.client.0.smithi174.stdout: 10 137976 11.92 MB/sec execute 503 sec latency 55.994 ms 2020-04-02T23:45:01.269 INFO:tasks.workunit.client.0.smithi174.stdout: 10 138160 11.91 MB/sec execute 504 sec latency 170.954 ms 2020-04-02T23:45:02.269 INFO:tasks.workunit.client.0.smithi174.stdout: 10 138331 11.90 MB/sec execute 505 sec latency 80.446 ms 2020-04-02T23:45:03.269 INFO:tasks.workunit.client.0.smithi174.stdout: 10 138527 11.90 MB/sec execute 506 sec latency 67.460 ms 2020-04-02T23:45:04.269 INFO:tasks.workunit.client.0.smithi174.stdout: 10 138675 11.89 MB/sec execute 507 sec latency 180.193 ms 2020-04-02T23:45:05.269 INFO:tasks.workunit.client.0.smithi174.stdout: 10 138894 11.89 MB/sec execute 508 sec latency 95.862 ms 2020-04-02T23:45:06.269 INFO:tasks.workunit.client.0.smithi174.stdout: 10 139112 11.90 MB/sec execute 509 sec latency 93.635 ms 2020-04-02T23:45:07.269 INFO:tasks.workunit.client.0.smithi174.stdout: 10 139341 11.90 MB/sec execute 510 sec latency 125.843 ms 2020-04-02T23:45:08.269 INFO:tasks.workunit.client.0.smithi174.stdout: 10 139545 11.89 MB/sec execute 511 sec latency 102.832 ms 2020-04-02T23:45:09.269 INFO:tasks.workunit.client.0.smithi174.stdout: 10 139757 11.88 MB/sec execute 512 sec latency 68.302 ms 2020-04-02T23:45:10.269 INFO:tasks.workunit.client.0.smithi174.stdout: 10 140010 11.88 MB/sec execute 513 sec latency 56.178 ms 2020-04-02T23:45:11.269 INFO:tasks.workunit.client.0.smithi174.stdout: 10 140206 11.88 MB/sec execute 514 sec latency 96.237 ms 2020-04-02T23:45:12.269 INFO:tasks.workunit.client.0.smithi174.stdout: 10 140447 11.89 MB/sec execute 515 sec latency 58.828 ms 2020-04-02T23:45:13.270 INFO:tasks.workunit.client.0.smithi174.stdout: 10 140672 11.89 MB/sec execute 516 sec latency 68.115 ms 2020-04-02T23:45:14.270 INFO:tasks.workunit.client.0.smithi174.stdout: 10 140885 11.89 MB/sec execute 517 sec latency 191.519 ms 2020-04-02T23:45:15.270 INFO:tasks.workunit.client.0.smithi174.stdout: 10 141096 11.90 MB/sec execute 518 sec latency 89.939 ms 2020-04-02T23:45:16.270 INFO:tasks.workunit.client.0.smithi174.stdout: 10 141307 11.90 MB/sec execute 519 sec latency 72.117 ms 2020-04-02T23:45:17.270 INFO:tasks.workunit.client.0.smithi174.stdout: 10 141544 11.90 MB/sec execute 520 sec latency 59.401 ms 2020-04-02T23:45:18.270 INFO:tasks.workunit.client.0.smithi174.stdout: 10 141759 11.89 MB/sec execute 521 sec latency 59.151 ms 2020-04-02T23:45:19.270 INFO:tasks.workunit.client.0.smithi174.stdout: 10 141953 11.88 MB/sec execute 522 sec latency 99.476 ms 2020-04-02T23:45:20.270 INFO:tasks.workunit.client.0.smithi174.stdout: 10 142181 11.89 MB/sec execute 523 sec latency 75.710 ms 2020-04-02T23:45:21.270 INFO:tasks.workunit.client.0.smithi174.stdout: 10 142394 11.89 MB/sec execute 524 sec latency 115.322 ms 2020-04-02T23:45:22.270 INFO:tasks.workunit.client.0.smithi174.stdout: 10 142643 11.89 MB/sec execute 525 sec latency 56.269 ms 2020-04-02T23:45:23.270 INFO:tasks.workunit.client.0.smithi174.stdout: 10 142891 11.90 MB/sec execute 526 sec latency 92.266 ms 2020-04-02T23:45:24.270 INFO:tasks.workunit.client.0.smithi174.stdout: 10 143061 11.89 MB/sec execute 527 sec latency 165.518 ms 2020-04-02T23:45:25.270 INFO:tasks.workunit.client.0.smithi174.stdout: 10 143292 11.89 MB/sec execute 528 sec latency 59.189 ms 2020-04-02T23:45:26.270 INFO:tasks.workunit.client.0.smithi174.stdout: 10 143523 11.88 MB/sec execute 529 sec latency 56.912 ms 2020-04-02T23:45:27.270 INFO:tasks.workunit.client.0.smithi174.stdout: 10 143748 11.89 MB/sec execute 530 sec latency 62.794 ms 2020-04-02T23:45:28.270 INFO:tasks.workunit.client.0.smithi174.stdout: 10 143971 11.88 MB/sec execute 531 sec latency 76.705 ms 2020-04-02T23:45:29.270 INFO:tasks.workunit.client.0.smithi174.stdout: 10 144245 11.90 MB/sec execute 532 sec latency 48.890 ms 2020-04-02T23:45:30.270 INFO:tasks.workunit.client.0.smithi174.stdout: 10 144504 11.90 MB/sec execute 533 sec latency 57.529 ms 2020-04-02T23:45:31.270 INFO:tasks.workunit.client.0.smithi174.stdout: 10 144719 11.91 MB/sec execute 534 sec latency 55.169 ms 2020-04-02T23:45:32.270 INFO:tasks.workunit.client.0.smithi174.stdout: 10 144964 11.92 MB/sec execute 535 sec latency 86.381 ms 2020-04-02T23:45:33.270 INFO:tasks.workunit.client.0.smithi174.stdout: 10 145183 11.90 MB/sec execute 536 sec latency 62.214 ms 2020-04-02T23:45:34.270 INFO:tasks.workunit.client.0.smithi174.stdout: 10 145373 11.90 MB/sec execute 537 sec latency 161.605 ms 2020-04-02T23:45:35.270 INFO:tasks.workunit.client.0.smithi174.stdout: 10 145588 11.90 MB/sec execute 538 sec latency 74.307 ms 2020-04-02T23:45:36.270 INFO:tasks.workunit.client.0.smithi174.stdout: 10 145815 11.90 MB/sec execute 539 sec latency 85.405 ms 2020-04-02T23:45:37.270 INFO:tasks.workunit.client.0.smithi174.stdout: 10 146035 11.91 MB/sec execute 540 sec latency 116.824 ms 2020-04-02T23:45:38.270 INFO:tasks.workunit.client.0.smithi174.stdout: 10 146268 11.91 MB/sec execute 541 sec latency 56.413 ms 2020-04-02T23:45:39.270 INFO:tasks.workunit.client.0.smithi174.stdout: 10 146501 11.91 MB/sec execute 542 sec latency 60.706 ms 2020-04-02T23:45:40.270 INFO:tasks.workunit.client.0.smithi174.stdout: 10 146715 11.91 MB/sec execute 543 sec latency 68.987 ms 2020-04-02T23:45:41.270 INFO:tasks.workunit.client.0.smithi174.stdout: 10 146921 11.90 MB/sec execute 544 sec latency 55.489 ms 2020-04-02T23:45:42.270 INFO:tasks.workunit.client.0.smithi174.stdout: 10 147175 11.90 MB/sec execute 545 sec latency 54.498 ms 2020-04-02T23:45:43.270 INFO:tasks.workunit.client.0.smithi174.stdout: 10 147405 11.90 MB/sec execute 546 sec latency 60.780 ms 2020-04-02T23:45:44.270 INFO:tasks.workunit.client.0.smithi174.stdout: 10 147594 11.89 MB/sec execute 547 sec latency 191.599 ms 2020-04-02T23:45:44.918 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:45:44.959 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:45:45.002 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:45:45.015 INFO:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:45:45.270 INFO:tasks.workunit.client.0.smithi174.stdout: 10 147856 11.90 MB/sec execute 548 sec latency 49.263 ms 2020-04-02T23:45:46.270 INFO:tasks.workunit.client.0.smithi174.stdout: 10 148125 11.91 MB/sec execute 549 sec latency 45.997 ms 2020-04-02T23:45:47.270 INFO:tasks.workunit.client.0.smithi174.stdout: 10 148356 11.92 MB/sec execute 550 sec latency 73.866 ms 2020-04-02T23:45:48.271 INFO:tasks.workunit.client.0.smithi174.stdout: 10 148595 11.92 MB/sec execute 551 sec latency 105.623 ms 2020-04-02T23:45:49.271 INFO:tasks.workunit.client.0.smithi174.stdout: 10 148836 11.91 MB/sec execute 552 sec latency 59.511 ms 2020-04-02T23:45:50.271 INFO:tasks.workunit.client.0.smithi174.stdout: 10 149035 11.92 MB/sec execute 553 sec latency 109.394 ms 2020-04-02T23:45:51.271 INFO:tasks.workunit.client.0.smithi174.stdout: 10 149224 11.92 MB/sec execute 554 sec latency 140.393 ms 2020-04-02T23:45:52.271 INFO:tasks.workunit.client.0.smithi174.stdout: 10 149449 11.92 MB/sec execute 555 sec latency 150.534 ms 2020-04-02T23:45:53.271 INFO:tasks.workunit.client.0.smithi174.stdout: 10 149674 11.91 MB/sec execute 556 sec latency 74.874 ms 2020-04-02T23:45:54.271 INFO:tasks.workunit.client.0.smithi174.stdout: 10 149869 11.92 MB/sec execute 557 sec latency 115.660 ms 2020-04-02T23:45:55.271 INFO:tasks.workunit.client.0.smithi174.stdout: 10 150070 11.91 MB/sec execute 558 sec latency 76.779 ms 2020-04-02T23:45:56.271 INFO:tasks.workunit.client.0.smithi174.stdout: 10 150270 11.91 MB/sec execute 559 sec latency 126.105 ms 2020-04-02T23:45:57.272 INFO:tasks.workunit.client.0.smithi174.stdout: 10 150479 11.90 MB/sec execute 560 sec latency 92.477 ms 2020-04-02T23:45:58.271 INFO:tasks.workunit.client.0.smithi174.stdout: 10 150727 11.90 MB/sec execute 561 sec latency 65.945 ms 2020-04-02T23:45:59.271 INFO:tasks.workunit.client.0.smithi174.stdout: 10 150968 11.90 MB/sec execute 562 sec latency 79.341 ms 2020-04-02T23:46:00.271 INFO:tasks.workunit.client.0.smithi174.stdout: 10 151178 11.90 MB/sec execute 563 sec latency 104.863 ms 2020-04-02T23:46:01.271 INFO:tasks.workunit.client.0.smithi174.stdout: 10 151460 11.91 MB/sec execute 564 sec latency 74.515 ms 2020-04-02T23:46:02.271 INFO:tasks.workunit.client.0.smithi174.stdout: 10 151717 11.91 MB/sec execute 565 sec latency 74.815 ms 2020-04-02T23:46:03.271 INFO:tasks.workunit.client.0.smithi174.stdout: 10 151957 11.92 MB/sec execute 566 sec latency 65.403 ms 2020-04-02T23:46:04.271 INFO:tasks.workunit.client.0.smithi174.stdout: 10 152175 11.92 MB/sec execute 567 sec latency 143.098 ms 2020-04-02T23:46:05.271 INFO:tasks.workunit.client.0.smithi174.stdout: 10 152412 11.91 MB/sec execute 568 sec latency 94.366 ms 2020-04-02T23:46:06.271 INFO:tasks.workunit.client.0.smithi174.stdout: 10 152627 11.92 MB/sec execute 569 sec latency 63.872 ms 2020-04-02T23:46:07.271 INFO:tasks.workunit.client.0.smithi174.stdout: 10 152859 11.93 MB/sec execute 570 sec latency 50.525 ms 2020-04-02T23:46:08.271 INFO:tasks.workunit.client.0.smithi174.stdout: 10 153077 11.93 MB/sec execute 571 sec latency 58.429 ms 2020-04-02T23:46:09.271 INFO:tasks.workunit.client.0.smithi174.stdout: 10 153286 11.92 MB/sec execute 572 sec latency 68.320 ms 2020-04-02T23:46:10.271 INFO:tasks.workunit.client.0.smithi174.stdout: 10 153492 11.92 MB/sec execute 573 sec latency 67.410 ms 2020-04-02T23:46:11.271 INFO:tasks.workunit.client.0.smithi174.stdout: 10 153718 11.92 MB/sec execute 574 sec latency 65.455 ms 2020-04-02T23:46:12.274 INFO:tasks.workunit.client.0.smithi174.stdout: 10 153903 11.91 MB/sec execute 575 sec latency 99.261 ms 2020-04-02T23:46:13.271 INFO:tasks.workunit.client.0.smithi174.stdout: 10 154160 11.91 MB/sec execute 576 sec latency 62.981 ms 2020-04-02T23:46:14.271 INFO:tasks.workunit.client.0.smithi174.stdout: 10 154378 11.91 MB/sec execute 577 sec latency 181.683 ms 2020-04-02T23:46:15.271 INFO:tasks.workunit.client.0.smithi174.stdout: 10 154594 11.91 MB/sec execute 578 sec latency 100.598 ms 2020-04-02T23:46:15.388 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:46:15.408 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:46:15.451 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:46:15.470 INFO:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:46:16.271 INFO:tasks.workunit.client.0.smithi174.stdout: 10 154880 11.92 MB/sec execute 579 sec latency 81.699 ms 2020-04-02T23:46:17.272 INFO:tasks.workunit.client.0.smithi174.stdout: 10 155140 11.92 MB/sec execute 580 sec latency 52.150 ms 2020-04-02T23:46:18.271 INFO:tasks.workunit.client.0.smithi174.stdout: 10 155394 11.94 MB/sec execute 581 sec latency 46.676 ms 2020-04-02T23:46:19.271 INFO:tasks.workunit.client.0.smithi174.stdout: 10 155610 11.93 MB/sec execute 582 sec latency 84.293 ms 2020-04-02T23:46:20.273 INFO:tasks.workunit.client.0.smithi174.stdout: 10 155843 11.93 MB/sec execute 583 sec latency 54.846 ms 2020-04-02T23:46:21.273 INFO:tasks.workunit.client.0.smithi174.stdout: 10 156065 11.93 MB/sec execute 584 sec latency 60.260 ms 2020-04-02T23:46:22.273 INFO:tasks.workunit.client.0.smithi174.stdout: 10 156263 11.93 MB/sec execute 585 sec latency 77.803 ms 2020-04-02T23:46:23.273 INFO:tasks.workunit.client.0.smithi174.stdout: 10 156461 11.93 MB/sec execute 586 sec latency 65.925 ms 2020-04-02T23:46:24.273 INFO:tasks.workunit.client.0.smithi174.stdout: 10 156650 11.93 MB/sec execute 587 sec latency 163.071 ms 2020-04-02T23:46:25.273 INFO:tasks.workunit.client.0.smithi174.stdout: 10 156854 11.92 MB/sec execute 588 sec latency 82.070 ms 2020-04-02T23:46:26.273 INFO:tasks.workunit.client.0.smithi174.stdout: 10 157059 11.92 MB/sec execute 589 sec latency 55.854 ms 2020-04-02T23:46:27.273 INFO:tasks.workunit.client.0.smithi174.stdout: 10 157296 11.93 MB/sec execute 590 sec latency 59.812 ms 2020-04-02T23:46:28.273 INFO:tasks.workunit.client.0.smithi174.stdout: 10 157485 11.92 MB/sec execute 591 sec latency 66.713 ms 2020-04-02T23:46:29.273 INFO:tasks.workunit.client.0.smithi174.stdout: 10 157736 11.91 MB/sec execute 592 sec latency 47.324 ms 2020-04-02T23:46:30.273 INFO:tasks.workunit.client.0.smithi174.stdout: 10 157995 11.92 MB/sec execute 593 sec latency 74.254 ms 2020-04-02T23:46:31.273 INFO:tasks.workunit.client.0.smithi174.stdout: 10 158203 11.92 MB/sec execute 594 sec latency 77.814 ms 2020-04-02T23:46:32.273 INFO:tasks.workunit.client.0.smithi174.stdout: 10 158472 11.92 MB/sec execute 595 sec latency 58.452 ms 2020-04-02T23:46:33.273 INFO:tasks.workunit.client.0.smithi174.stdout: 10 158755 11.93 MB/sec execute 596 sec latency 55.939 ms 2020-04-02T23:46:34.273 INFO:tasks.workunit.client.0.smithi174.stdout: 10 158937 11.92 MB/sec execute 597 sec latency 210.869 ms 2020-04-02T23:46:35.273 INFO:tasks.workunit.client.0.smithi174.stdout: 10 159187 11.94 MB/sec execute 598 sec latency 118.923 ms 2020-04-02T23:46:36.273 INFO:tasks.workunit.client.0.smithi174.stdout: 10 159419 11.93 MB/sec execute 599 sec latency 81.868 ms 2020-04-02T23:46:37.273 INFO:tasks.workunit.client.0.smithi174.stdout: 10 cleanup 600 sec 2020-04-02T23:46:38.274 INFO:tasks.workunit.client.0.smithi174.stdout: 10 cleanup 601 sec 2020-04-02T23:46:39.273 INFO:tasks.workunit.client.0.smithi174.stdout: 8 cleanup 602 sec 2020-04-02T23:46:39.599 INFO:tasks.workunit.client.0.smithi174.stdout: 0 cleanup 602 sec 2020-04-02T23:46:39.600 INFO:tasks.workunit.client.0.smithi174.stdout: 2020-04-02T23:46:39.600 INFO:tasks.workunit.client.0.smithi174.stdout: Operation Count AvgLat MaxLat 2020-04-02T23:46:39.600 INFO:tasks.workunit.client.0.smithi174.stdout: ---------------------------------------- 2020-04-02T23:46:39.600 INFO:tasks.workunit.client.0.smithi174.stdout: NTCreateX 229662 10.277 378.730 2020-04-02T23:46:39.600 INFO:tasks.workunit.client.0.smithi174.stdout: Close 168674 0.201 11.405 2020-04-02T23:46:39.600 INFO:tasks.workunit.client.0.smithi174.stdout: Rename 9724 31.723 441.506 2020-04-02T23:46:39.600 INFO:tasks.workunit.client.0.smithi174.stdout: Unlink 46334 9.281 121.472 2020-04-02T23:46:39.601 INFO:tasks.workunit.client.0.smithi174.stdout: Qpathinfo 208396 7.684 499.201 2020-04-02T23:46:39.601 INFO:tasks.workunit.client.0.smithi174.stdout: Qfileinfo 36384 0.372 9.593 2020-04-02T23:46:39.601 INFO:tasks.workunit.client.0.smithi174.stdout: Qfsinfo 38191 0.918 64.510 2020-04-02T23:46:39.601 INFO:tasks.workunit.client.0.smithi174.stdout: Sfileinfo 18643 3.876 230.232 2020-04-02T23:46:39.601 INFO:tasks.workunit.client.0.smithi174.stdout: Find 80603 6.442 123.507 2020-04-02T23:46:39.601 INFO:tasks.workunit.client.0.smithi174.stdout: WriteX 113574 1.868 142.907 2020-04-02T23:46:39.601 INFO:tasks.workunit.client.0.smithi174.stdout: ReadX 360588 0.007 5.346 2020-04-02T23:46:39.602 INFO:tasks.workunit.client.0.smithi174.stdout: LockX 752 3.504 100.078 2020-04-02T23:46:39.602 INFO:tasks.workunit.client.0.smithi174.stdout: UnlockX 752 2.752 27.751 2020-04-02T23:46:39.602 INFO:tasks.workunit.client.0.smithi174.stdout: Flush 16070 25.072 322.680 2020-04-02T23:46:39.602 INFO:tasks.workunit.client.0.smithi174.stdout: 2020-04-02T23:46:39.602 INFO:tasks.workunit.client.0.smithi174.stdout:Throughput 11.9333 MB/sec 10 clients 10 procs max_latency=499.210 ms 2020-04-02T23:46:39.856 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:46:40.299 INFO:teuthology.orchestra.run:Running command with timeout 3600 2020-04-02T23:46:40.299 INFO:teuthology.orchestra.run.smithi174:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2020-04-02T23:46:41.529 INFO:tasks.workunit:Stopping ['suites/dbench.sh'] on client.0... 2020-04-02T23:46:41.529 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:46:41.543 INFO:teuthology.orchestra.run.smithi174:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2020-04-02T23:46:43.930 DEBUG:teuthology.parallel:result is None 2020-04-02T23:46:43.931 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:46:43.946 INFO:teuthology.orchestra.run.smithi174:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2020-04-02T23:46:44.026 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2020-04-02T23:46:44.026 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2020-04-02T23:46:44.033 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2020-04-02T23:46:44.033 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:46:44.080 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-02T23:46:44.081 INFO:teuthology.orchestra.run.smithi174:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-04-02T23:46:44.081 INFO:teuthology.orchestra.run.smithi174:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-04-02T23:46:44.156 INFO:teuthology.orchestra.run.smithi174.stdout:fuseblk 2020-04-02T23:46:44.157 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-04-02T23:46:44.157 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:46:44.198 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-02T23:46:44.198 INFO:teuthology.orchestra.run.smithi174:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-04-02T23:46:44.198 INFO:teuthology.orchestra.run.smithi174:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-04-02T23:46:44.256 INFO:teuthology.orchestra.run.smithi174.stdout:fuseblk 2020-04-02T23:46:44.257 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-04-02T23:46:44.257 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi174.front.sepia.ceph.com... 2020-04-02T23:46:44.257 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:46:44.304 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-04-02T23:46:44.305 INFO:teuthology.orchestra.run.smithi174:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2020-04-02T23:46:44.420 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi174.stderr:ceph-fuse[28612]: fuse finished with error 0 and tester_r 0 2020-04-02T23:46:44.462 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:46:44.476 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-02T23:46:44.476 INFO:teuthology.orchestra.run.smithi174:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-04-02T23:46:44.476 INFO:teuthology.orchestra.run.smithi174:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-04-02T23:46:44.535 INFO:teuthology.orchestra.run.smithi174.stdout:ext2/ext3 2020-04-02T23:46:44.535 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2020-04-02T23:46:44.535 INFO:teuthology.orchestra.run:waiting for 900 2020-04-02T23:46:46.167 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:46:46.184 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:46:46.226 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:46:46.243 INFO:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:46:50.636 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:46:50.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-02T23:46:50.653 INFO:teuthology.orchestra.run.smithi174:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2020-04-02T23:46:50.712 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2020-04-02T23:46:50.724 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2020-04-02T23:46:50.724 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:46:50.765 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-02T23:46:51.248 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.246+0000 7ff85e3ce700 1 Processor -- start 2020-04-02T23:46:51.249 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.246+0000 7ff85e3ce700 1 -- start start 2020-04-02T23:46:51.251 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.247+0000 7ff85e3ce700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7ff8580a7a60 0x7ff8581403b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:51.252 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.247+0000 7ff85e3ce700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff8580a2830 0x7ff85805ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:51.252 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.247+0000 7ff85e3ce700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff8580a2cc0 0x7ff85805b060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:51.252 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.247+0000 7ff85e3ce700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff85813fa40 con 0x7ff8580a2830 2020-04-02T23:46:51.252 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.247+0000 7ff85e3ce700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff85813fc70 con 0x7ff8580a7a60 2020-04-02T23:46:51.252 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.247+0000 7ff85e3ce700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff85813ff10 con 0x7ff8580a2cc0 2020-04-02T23:46:51.252 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.247+0000 7ff8577fe700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff8580a2830 0x7ff85805ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:51.252 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.247+0000 7ff8577fe700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff8580a2830 0x7ff85805ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:40388/0 (socket says 172.21.15.174:40388) 2020-04-02T23:46:51.253 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.247+0000 7ff8577fe700 1 -- 172.21.15.174:0/3935515239 learned_addr learned my addr 172.21.15.174:0/3935515239 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:46:51.253 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.247+0000 7ff85c96b700 1 --2- 172.21.15.174:0/3935515239 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff8580a2cc0 0x7ff85805b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:51.253 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.247+0000 7ff857fff700 1 --2- 172.21.15.174:0/3935515239 >> v2:172.21.15.196:3300/0 conn(0x7ff8580a7a60 0x7ff8581403b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:51.253 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.247+0000 7ff8577fe700 1 -- 172.21.15.174:0/3935515239 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff8580a2cc0 msgr2=0x7ff85805b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:46:51.253 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.247+0000 7ff8577fe700 1 --2- 172.21.15.174:0/3935515239 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff8580a2cc0 0x7ff85805b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:51.253 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.247+0000 7ff8577fe700 1 -- 172.21.15.174:0/3935515239 >> v2:172.21.15.196:3300/0 conn(0x7ff8580a7a60 msgr2=0x7ff8581403b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:46:51.253 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.247+0000 7ff8577fe700 1 --2- 172.21.15.174:0/3935515239 >> v2:172.21.15.196:3300/0 conn(0x7ff8580a7a60 0x7ff8581403b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:51.254 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.247+0000 7ff8577fe700 1 -- 172.21.15.174:0/3935515239 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff858140810 con 0x7ff8580a2830 2020-04-02T23:46:51.254 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.247+0000 7ff857fff700 1 --2- 172.21.15.174:0/3935515239 >> v2:172.21.15.196:3300/0 conn(0x7ff8580a7a60 0x7ff8581403b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-02T23:46:51.254 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.247+0000 7ff8577fe700 1 --2- 172.21.15.174:0/3935515239 >> v2:172.21.15.174:3300/0 conn(0x7ff8580a2830 0x7ff85805ac00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff84c002f30 tx=0x7ff84c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:51.254 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.247+0000 7ff8577fe700 1 --2- 172.21.15.174:0/3935515239 >> v2:172.21.15.174:3300/0 conn(0x7ff8580a2830 0x7ff85805ac00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff84c002f30 tx=0x7ff84c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:51.254 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.248+0000 7ff8577fe700 1 --2- 172.21.15.174:0/3935515239 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff8580a2830 0x7ff85805ac00 secure :-1 s=READY pgs=194 cs=0 l=1 rx=0x7ff84c002f30 tx=0x7ff84c007a40).ready entity=mon.0 client_cookie=e6f31d5c2a504fa0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:51.254 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.248+0000 7ff8577fe700 1 --2- 172.21.15.174:0/3935515239 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff8580a2830 0x7ff85805ac00 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7ff84c002f30 tx=0x7ff84c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:51.254 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.248+0000 7ff8577fe700 1 --2- 172.21.15.174:0/3935515239 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff8580a2830 0x7ff85805ac00 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7ff84c002f30 tx=0x7ff84c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:51.254 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.248+0000 7ff856ffd700 1 -- 172.21.15.174:0/3935515239 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff84c011720 con 0x7ff8580a2830 2020-04-02T23:46:51.255 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.248+0000 7ff8577fe700 1 --2- 172.21.15.174:0/3935515239 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff8580a2830 0x7ff85805ac00 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7ff84c002f30 tx=0x7ff84c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:51.255 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.248+0000 7ff856ffd700 1 -- 172.21.15.174:0/3935515239 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff84c011880 con 0x7ff8580a2830 2020-04-02T23:46:51.255 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.248+0000 7ff856ffd700 1 -- 172.21.15.174:0/3935515239 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff84c011c60 con 0x7ff8580a2830 2020-04-02T23:46:51.255 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.248+0000 7ff85e3ce700 1 -- 172.21.15.174:0/3935515239 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff8580a2830 msgr2=0x7ff85805ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:51.255 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.248+0000 7ff85e3ce700 1 --2- 172.21.15.174:0/3935515239 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff8580a2830 0x7ff85805ac00 secure :-1 s=READY pgs=194 cs=0 l=1 rx=0x7ff84c002f30 tx=0x7ff84c007a40).stop 2020-04-02T23:46:51.255 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.248+0000 7ff85e3ce700 1 -- 172.21.15.174:0/3935515239 shutdown_connections 2020-04-02T23:46:51.255 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.248+0000 7ff85e3ce700 1 --2- 172.21.15.174:0/3935515239 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff8580a2cc0 0x7ff85805b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:51.255 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.248+0000 7ff85e3ce700 1 --2- 172.21.15.174:0/3935515239 >> v2:172.21.15.196:3300/0 conn(0x7ff8580a7a60 0x7ff8581403b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:51.256 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.248+0000 7ff85e3ce700 1 --2- 172.21.15.174:0/3935515239 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff8580a2830 0x7ff85805ac00 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:51.256 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.248+0000 7ff85e3ce700 1 -- 172.21.15.174:0/3935515239 >> 172.21.15.174:0/3935515239 conn(0x7ff8580aaf80 msgr2=0x7ff8580a6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:46:51.256 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.248+0000 7ff85e3ce700 1 -- 172.21.15.174:0/3935515239 shutdown_connections 2020-04-02T23:46:51.256 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.248+0000 7ff85e3ce700 1 -- 172.21.15.174:0/3935515239 wait complete. 2020-04-02T23:46:51.256 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.249+0000 7ff85e3ce700 1 Processor -- start 2020-04-02T23:46:51.256 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.249+0000 7ff85e3ce700 1 -- start start 2020-04-02T23:46:51.260 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.250+0000 7ff85e3ce700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7ff8580a2cc0 0x7ff85813cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:51.261 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.250+0000 7ff85e3ce700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8581393c0 con 0x7ff8580a2830 2020-04-02T23:46:51.261 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.250+0000 7ff85e3ce700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8581396c0 con 0x7ff8580a7a60 2020-04-02T23:46:51.261 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.250+0000 7ff85e3ce700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff858134420 con 0x7ff8580a2cc0 2020-04-02T23:46:51.261 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.250+0000 7ff857fff700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7ff8580a2830 0x7ff858130fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:45430/0 (socket says 172.21.15.174:45430) 2020-04-02T23:46:51.261 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.250+0000 7ff857fff700 1 -- 172.21.15.174:0/1790954898 learned_addr learned my addr 172.21.15.174:0/1790954898 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:46:51.261 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.250+0000 7ff8577fe700 1 --2- 172.21.15.174:0/1790954898 >> v2:172.21.15.196:3300/0 conn(0x7ff8580a2cc0 0x7ff85813cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:51.261 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.251+0000 7ff8557fa700 1 -- 172.21.15.174:0/1790954898 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3011787600 0 0) 0x7ff8581393c0 con 0x7ff8580a2830 2020-04-02T23:46:51.262 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.251+0000 7ff8557fa700 1 -- 172.21.15.174:0/1790954898 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff838002fe0 con 0x7ff8580a2830 2020-04-02T23:46:51.262 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.251+0000 7ff8557fa700 1 -- 172.21.15.174:0/1790954898 <== mon.0 v1:172.21.15.174:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2369108883 0 0) 0x7ff838002fe0 con 0x7ff8580a2830 2020-04-02T23:46:51.262 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.251+0000 7ff8557fa700 1 -- 172.21.15.174:0/1790954898 --> v1:172.21.15.174:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff8581393c0 con 0x7ff8580a2830 2020-04-02T23:46:51.262 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.251+0000 7ff8557fa700 1 -- 172.21.15.174:0/1790954898 <== mon.0 v1:172.21.15.174:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2811762909 0 0) 0x7ff8480024c0 con 0x7ff8580a2830 2020-04-02T23:46:51.262 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.251+0000 7ff8557fa700 1 -- 172.21.15.174:0/1790954898 >> v2:172.21.15.196:3300/0 conn(0x7ff8580a2cc0 msgr2=0x7ff85813cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:51.262 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.251+0000 7ff8557fa700 1 --2- 172.21.15.174:0/1790954898 >> v2:172.21.15.196:3300/0 conn(0x7ff8580a2cc0 0x7ff85813cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:51.262 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.251+0000 7ff8557fa700 1 -- 172.21.15.174:0/1790954898 >> v1:172.21.15.196:6789/0 conn(0x7ff8580a7a60 legacy=0x7ff858154070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:51.262 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.251+0000 7ff8557fa700 1 -- 172.21.15.174:0/1790954898 >> v1:172.21.15.174:6789/0 conn(0x7ff8580a2830 legacy=0x7ff858130fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:51.263 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.251+0000 7ff8557fa700 1 --2- 172.21.15.174:0/1790954898 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff8380049b0 0x7ff838004dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:51.263 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.251+0000 7ff8557fa700 1 --2- 172.21.15.174:0/1790954898 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff838003920 0x7ff838003da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:51.263 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.251+0000 7ff8557fa700 1 --2- 172.21.15.174:0/1790954898 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff838004200 0x7ff83800b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:51.263 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.251+0000 7ff8557fa700 1 -- 172.21.15.174:0/1790954898 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff858134420 con 0x7ff8380049b0 2020-04-02T23:46:51.263 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.251+0000 7ff8557fa700 1 -- 172.21.15.174:0/1790954898 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff838004680 con 0x7ff838003920 2020-04-02T23:46:51.263 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.251+0000 7ff8557fa700 1 -- 172.21.15.174:0/1790954898 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff83800bbb0 con 0x7ff838004200 2020-04-02T23:46:51.263 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.251+0000 7ff8577fe700 1 --2- 172.21.15.174:0/1790954898 >> v2:172.21.15.196:3300/0 conn(0x7ff8580a2cc0 0x7ff85813cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:46:51.264 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.251+0000 7ff857fff700 1 --2- 172.21.15.174:0/1790954898 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff8380049b0 0x7ff838004dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:51.264 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.251+0000 7ff85c96b700 1 --2- 172.21.15.174:0/1790954898 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff838004200 0x7ff83800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:51.264 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.251+0000 7ff8577fe700 1 --2- 172.21.15.174:0/1790954898 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff838003920 0x7ff838003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:51.264 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.251+0000 7ff857fff700 1 -- 172.21.15.174:0/1790954898 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff838004200 msgr2=0x7ff83800b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:51.264 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.251+0000 7ff857fff700 1 --2- 172.21.15.174:0/1790954898 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff838004200 0x7ff83800b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:51.264 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.251+0000 7ff857fff700 1 -- 172.21.15.174:0/1790954898 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff838003920 msgr2=0x7ff838003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:51.264 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.251+0000 7ff857fff700 1 --2- 172.21.15.174:0/1790954898 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff838003920 0x7ff838003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:51.265 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.251+0000 7ff857fff700 1 -- 172.21.15.174:0/1790954898 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8581346c0 con 0x7ff8380049b0 2020-04-02T23:46:51.265 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.251+0000 7ff85c96b700 1 -- 172.21.15.174:0/1790954898 reap_dead start 2020-04-02T23:46:51.265 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.251+0000 7ff85e3ce700 1 -- 172.21.15.174:0/1790954898 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff85813cad0 con 0x7ff8380049b0 2020-04-02T23:46:51.265 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.251+0000 7ff857fff700 1 --2- 172.21.15.174:0/1790954898 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff8380049b0 0x7ff838004dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff848007a40 tx=0x7ff838005630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:51.265 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.252+0000 7ff85e3ce700 1 -- 172.21.15.174:0/1790954898 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff858132b50 con 0x7ff8380049b0 2020-04-02T23:46:51.265 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.252+0000 7ff857fff700 1 --2- 172.21.15.174:0/1790954898 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff8380049b0 0x7ff838004dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff848007a40 tx=0x7ff838005630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:51.265 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.252+0000 7ff857fff700 1 --2- 172.21.15.174:0/1790954898 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff8380049b0 0x7ff838004dd0 secure :-1 s=READY pgs=196 cs=0 l=1 rx=0x7ff848007a40 tx=0x7ff838005630).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:51.265 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.252+0000 7ff857fff700 1 --2- 172.21.15.174:0/1790954898 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff8380049b0 0x7ff838004dd0 secure :-1 s=THROTTLE_DONE pgs=196 cs=0 l=1 rx=0x7ff848007a40 tx=0x7ff838005630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:51.266 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.252+0000 7ff8557fa700 1 -- 172.21.15.174:0/1790954898 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff848011e50 con 0x7ff8380049b0 2020-04-02T23:46:51.266 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.252+0000 7ff857fff700 1 --2- 172.21.15.174:0/1790954898 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff8380049b0 0x7ff838004dd0 secure :-1 s=THROTTLE_DONE pgs=196 cs=0 l=1 rx=0x7ff848007a40 tx=0x7ff838005630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:51.266 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.252+0000 7ff8557fa700 1 -- 172.21.15.174:0/1790954898 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8480058b0 con 0x7ff8380049b0 2020-04-02T23:46:51.266 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.252+0000 7ff857fff700 1 --2- 172.21.15.174:0/1790954898 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff8380049b0 0x7ff838004dd0 secure :-1 s=THROTTLE_DONE pgs=196 cs=0 l=1 rx=0x7ff848007a40 tx=0x7ff838005630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:51.266 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.252+0000 7ff8557fa700 1 -- 172.21.15.174:0/1790954898 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff848005cd0 con 0x7ff8380049b0 2020-04-02T23:46:51.268 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.252+0000 7ff857fff700 1 --2- 172.21.15.174:0/1790954898 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff8380049b0 0x7ff838004dd0 secure :-1 s=THROTTLE_DONE pgs=196 cs=0 l=1 rx=0x7ff848007a40 tx=0x7ff838005630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:51.268 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.253+0000 7ff85e3ce700 1 -- 172.21.15.174:0/1790954898 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff834003340 con 0x7ff8380049b0 2020-04-02T23:46:51.268 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.253+0000 7ff8557fa700 1 -- 172.21.15.174:0/1790954898 <== mon.0 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7ff848010250 con 0x7ff8380049b0 2020-04-02T23:46:51.268 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.253+0000 7ff857fff700 1 --2- 172.21.15.174:0/1790954898 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff8380049b0 0x7ff838004dd0 secure :-1 s=THROTTLE_DONE pgs=196 cs=0 l=1 rx=0x7ff848007a40 tx=0x7ff838005630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:51.268 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.253+0000 7ff8557fa700 1 --2- 172.21.15.174:0/1790954898 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7ff838051420 0x7ff8380538e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:51.269 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.253+0000 7ff8557fa700 1 -- 172.21.15.174:0/1790954898 <== mon.0 v2:172.21.15.174:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff848061680 con 0x7ff8380049b0 2020-04-02T23:46:51.269 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.253+0000 7ff8577fe700 1 --2- 172.21.15.174:0/1790954898 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7ff838051420 0x7ff8380538e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:51.269 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.254+0000 7ff8577fe700 1 --2- 172.21.15.174:0/1790954898 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7ff838051420 0x7ff8380538e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff84c002f30 tx=0x7ff84c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:51.269 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.254+0000 7ff8577fe700 1 --2- 172.21.15.174:0/1790954898 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7ff838051420 0x7ff8380538e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff84c002f30 tx=0x7ff84c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:51.269 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.254+0000 7ff8577fe700 1 --2- 172.21.15.174:0/1790954898 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7ff838051420 0x7ff8380538e0 secure :-1 s=READY pgs=114 cs=0 l=1 rx=0x7ff84c002f30 tx=0x7ff84c007a40).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:51.269 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.257+0000 7ff857fff700 1 --2- 172.21.15.174:0/1790954898 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff8380049b0 0x7ff838004dd0 secure :-1 s=THROTTLE_DONE pgs=196 cs=0 l=1 rx=0x7ff848007a40 tx=0x7ff838005630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:51.269 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.257+0000 7ff8557fa700 1 -- 172.21.15.174:0/1790954898 <== mon.0 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7ff84803cd60 con 0x7ff8380049b0 2020-04-02T23:46:51.398 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.396+0000 7ff85e3ce700 1 -- 172.21.15.174:0/1790954898 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff8340021d0 con 0x7ff8380049b0 2020-04-02T23:46:51.399 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.397+0000 7ff857fff700 1 --2- 172.21.15.174:0/1790954898 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff8380049b0 0x7ff838004dd0 secure :-1 s=THROTTLE_DONE pgs=196 cs=0 l=1 rx=0x7ff848007a40 tx=0x7ff838005630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:51.399 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.397+0000 7ff8557fa700 1 -- 172.21.15.174:0/1790954898 <== mon.0 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16134 (secure 0 0 0) 0x7ff848040380 con 0x7ff8380049b0 2020-04-02T23:46:51.399 INFO:teuthology.orchestra.run.smithi174.stdout: 2020-04-02T23:46:51.400 INFO:teuthology.orchestra.run.smithi174.stdout:{"epoch":23,"fsid":"06504ece-4284-40ba-b298-58864abc4224","created":"2020-04-02T23:21:19.153932+0000","modified":"2020-04-02T23:21:41.535533+0000","last_up_change":"2020-04-02T23:21:29.337390+0000","last_in_change":"2020-04-02T23:21:29.337390+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-02T23:21:22.199702+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-02T23:21:35.314601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-04-02T23:21:38.762876+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-04-02T23:21:39.474986+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c9d748ee-c52f-4f21-b8c9-2a53a937be1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":24590},{"type":"v1","addr":"172.21.15.174:6801","nonce":24590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":24590},{"type":"v1","addr":"172.21.15.174:6803","nonce":24590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":24590},{"type":"v1","addr":"172.21.15.174:6807","nonce":24590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":24590},{"type":"v1","addr":"172.21.15.174:6805","nonce":24590}]},"public_addr":"172.21.15.174:6801/24590","cluster_addr":"172.21.15.174:6803/24590","heartbeat_back_addr":"172.21.15.174:6807/24590","heartbeat_front_addr":"172.21.15.174:6805/24590","state":["exists","up"]},{"osd":1,"uuid":"27c05faf-11f5-4cef-9bde-1a6653a9e533","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":24754},{"type":"v1","addr":"172.21.15.174:6809","nonce":24754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":24754},{"type":"v1","addr":"172.21.15.174:6811","nonce":24754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":24754},{"type":"v1","addr":"172.21.15.174:6815","nonce":24754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":24754},{"type":"v1","addr":"172.21.15.174:6813","nonce":24754}]},"public_addr":"172.21.15.174:6809/24754","cluster_addr":"172.21.15.174:6811/24754","heartbeat_back_addr":"172.21.15.174:6815/24754","heartbeat_front_addr":"172.21.15.174:6813/24754","state":["exists","up"]},{"osd":2,"uuid":"02b1b455-b518-4393-b257-40c3a76af157","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":24781},{"type":"v1","addr":"172.21.15.174:6817","nonce":24781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":24781},{"type":"v1","addr":"172.21.15.174:6819","nonce":24781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":24781},{"type":"v1","addr":"172.21.15.174:6823","nonce":24781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":24781},{"type":"v1","addr":"172.21.15.174:6821","nonce":24781}]},"public_addr":"172.21.15.174:6817/24781","cluster_addr":"172.21.15.174:6819/24781","heartbeat_back_addr":"172.21.15.174:6823/24781","heartbeat_front_addr":"172.21.15.174:6821/24781","state":["exists","up"]},{"osd":3,"uuid":"d7fb3499-9e13-4076-b3cf-28f27eb62967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":24972},{"type":"v1","addr":"172.21.15.174:6825","nonce":24972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":24972},{"type":"v1","addr":"172.21.15.174:6827","nonce":24972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":24972},{"type":"v1","addr":"172.21.15.174:6831","nonce":24972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":24972},{"type":"v1","addr":"172.21.15.174:6829","nonce":24972}]},"public_addr":"172.21.15.174:6825/24972","cluster_addr":"172.21.15.174:6827/24972","heartbeat_back_addr":"172.21.15.174:6831/24972","heartbeat_front_addr":"172.21.15.174:6829/24972","state":["exists","up"]},{"osd":4,"uuid":"16923c47-2f21-43ea-9647-5ead4b1b2101","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":24034},{"type":"v1","addr":"172.21.15.196:6803","nonce":24034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":24034},{"type":"v1","addr":"172.21.15.196:6805","nonce":24034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":24034},{"type":"v1","addr":"172.21.15.196:6809","nonce":24034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":24034},{"type":"v1","addr":"172.21.15.196:6807","nonce":24034}]},"public_addr":"172.21.15.196:6803/24034","cluster_addr":"172.21.15.196:6805/24034","heartbeat_back_addr":"172.21.15.196:6809/24034","heartbeat_front_addr":"172.21.15.196:6807/24034","state":["exists","up"]},{"osd":5,"uuid":"7cf2859b-2226-4908-8d70-6e699d1acb0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":24190},{"type":"v1","addr":"172.21.15.196:6811","nonce":24190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":24190},{"type":"v1","addr":"172.21.15.196:6813","nonce":24190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":24190},{"type":"v1","addr":"172.21.15.196:6817","nonce":24190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":24190},{"type":"v1","addr":"172.21.15.196:6815","nonce":24190}]},"public_addr":"172.21.15.196:6811/24190","cluster_addr":"172.21.15.196:6813/24190","heartbeat_back_addr":"172.21.15.196:6817/24190","heartbeat_front_addr":"172.21.15.196:6815/24190","state":["exists","up"]},{"osd":6,"uuid":"441081ef-133a-41ec-8041-094e129707e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":24212},{"type":"v1","addr":"172.21.15.196:6819","nonce":24212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":24212},{"type":"v1","addr":"172.21.15.196:6821","nonce":24212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":24212},{"type":"v1","addr":"172.21.15.196:6825","nonce":24212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":24212},{"type":"v1","addr":"172.21.15.196:6823","nonce":24212}]},"public_addr":"172.21.15.196:6819/24212","cluster_addr":"172.21.15.196:6821/24212","heartbeat_back_addr":"172.21.15.196:6825/24212","heartbeat_front_addr":"172.21.15.196:6823/24212","state":["exists","up"]},{"osd":7,"uuid":"17ee8d46-46bf-4ef0-8d02-82cbc4ef5a5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":24408},{"type":"v1","addr":"172.21.15.196:6827","nonce":24408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":24408},{"type":"v1","addr":"172.21.15.196:6829","nonce":24408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":24408},{"type":"v1","addr":"172.21.15.196:6833","nonce":24408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":24408},{"type":"v1","addr":"172.21.15.196:6831","nonce":24408}]},"public_addr":"172.21.15.196:6827/24408","cluster_addr":"172.21.15.196:6829/24408","heartbeat_back_addr":"172.21.15.196:6833/24408","heartbeat_front_addr":"172.21.15.196:6831/24408","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.725574+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.732598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.775890+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.854998+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.545334+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.591623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.627501+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.614807+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-02T23:46:51.401 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.398+0000 7ff85e3ce700 1 -- 172.21.15.174:0/1790954898 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7ff838051420 msgr2=0x7ff8380538e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:51.401 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.398+0000 7ff85e3ce700 1 --2- 172.21.15.174:0/1790954898 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7ff838051420 0x7ff8380538e0 secure :-1 s=READY pgs=114 cs=0 l=1 rx=0x7ff84c002f30 tx=0x7ff84c007a40).stop 2020-04-02T23:46:51.401 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.398+0000 7ff85e3ce700 1 -- 172.21.15.174:0/1790954898 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff8380049b0 msgr2=0x7ff838004dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:51.401 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.398+0000 7ff85e3ce700 1 --2- 172.21.15.174:0/1790954898 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff8380049b0 0x7ff838004dd0 secure :-1 s=READY pgs=196 cs=0 l=1 rx=0x7ff848007a40 tx=0x7ff838005630).stop 2020-04-02T23:46:51.401 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.398+0000 7ff85e3ce700 1 -- 172.21.15.174:0/1790954898 shutdown_connections 2020-04-02T23:46:51.402 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.398+0000 7ff85e3ce700 1 --2- 172.21.15.174:0/1790954898 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7ff838051420 0x7ff8380538e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:51.402 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.398+0000 7ff85e3ce700 1 --2- 172.21.15.174:0/1790954898 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff8380049b0 0x7ff838004dd0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:51.402 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.398+0000 7ff85e3ce700 1 -- 172.21.15.174:0/1790954898 >> 172.21.15.174:0/1790954898 conn(0x7ff8580aaf80 msgr2=0x7ff8580695c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:46:51.402 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.398+0000 7ff85e3ce700 1 -- 172.21.15.174:0/1790954898 shutdown_connections 2020-04-02T23:46:51.402 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.398+0000 7ff85e3ce700 1 -- 172.21.15.174:0/1790954898 wait complete. 2020-04-02T23:46:51.412 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:46:51.425 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-04-02T23:46:51.571 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.569+0000 7fda33277700 1 Processor -- start 2020-04-02T23:46:51.571 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.569+0000 7fda33277700 1 -- start start 2020-04-02T23:46:51.574 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.570+0000 7fda33277700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fda2c13b600 0x7fda2c13ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:51.574 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.570+0000 7fda33277700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda2c0a9150 con 0x7fda2c0a62e0 2020-04-02T23:46:51.575 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.570+0000 7fda33277700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda2c05c3b0 con 0x7fda2c0a5f00 2020-04-02T23:46:51.575 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.570+0000 7fda33277700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda2c0aa720 con 0x7fda2c13b600 2020-04-02T23:46:51.575 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.570+0000 7fda31814700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fda2c13b600 0x7fda2c13ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:51.575 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.570+0000 7fda31814700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fda2c13b600 0x7fda2c13ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:40404/0 (socket says 172.21.15.174:40404) 2020-04-02T23:46:51.575 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.570+0000 7fda31814700 1 -- 172.21.15.174:0/3129074399 learned_addr learned my addr 172.21.15.174:0/3129074399 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:46:51.575 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.570+0000 7fda30812700 1 --1- 172.21.15.174:0/3129074399 >> v1:172.21.15.174:6789/0 conn(0x7fda2c0a62e0 0x7fda2c05ffc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:45442/0 (socket says 172.21.15.174:45442) 2020-04-02T23:46:51.575 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.570+0000 7fda31814700 1 -- 172.21.15.174:0/3129074399 >> v1:172.21.15.196:6789/0 conn(0x7fda2c0a5f00 legacy=0x7fda2c0a9a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:51.576 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.570+0000 7fda31814700 1 -- 172.21.15.174:0/3129074399 >> v1:172.21.15.174:6789/0 conn(0x7fda2c0a62e0 legacy=0x7fda2c05ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:51.576 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.570+0000 7fda31814700 1 -- 172.21.15.174:0/3129074399 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda2c05c650 con 0x7fda2c13b600 2020-04-02T23:46:51.576 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.570+0000 7fda31814700 1 --2- 172.21.15.174:0/3129074399 >> v2:172.21.15.174:3300/0 conn(0x7fda2c13b600 0x7fda2c13ba20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fda240032b0 tx=0x7fda24007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:51.576 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.571+0000 7fda31814700 1 --2- 172.21.15.174:0/3129074399 >> v2:172.21.15.174:3300/0 conn(0x7fda2c13b600 0x7fda2c13ba20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fda240032b0 tx=0x7fda24007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:51.576 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.571+0000 7fda31814700 1 --2- 172.21.15.174:0/3129074399 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda2c13b600 0x7fda2c13ba20 secure :-1 s=READY pgs=198 cs=0 l=1 rx=0x7fda240032b0 tx=0x7fda24007dc0).ready entity=mon.0 client_cookie=f41b436b83654c1a server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:51.576 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.571+0000 7fda31814700 1 --2- 172.21.15.174:0/3129074399 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda2c13b600 0x7fda2c13ba20 secure :-1 s=THROTTLE_DONE pgs=198 cs=0 l=1 rx=0x7fda240032b0 tx=0x7fda24007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:51.576 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.571+0000 7fda1bfff700 1 -- 172.21.15.174:0/3129074399 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda2400a160 con 0x7fda2c13b600 2020-04-02T23:46:51.576 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.571+0000 7fda31814700 1 --2- 172.21.15.174:0/3129074399 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda2c13b600 0x7fda2c13ba20 secure :-1 s=THROTTLE_DONE pgs=198 cs=0 l=1 rx=0x7fda240032b0 tx=0x7fda24007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:51.577 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.571+0000 7fda31814700 1 --2- 172.21.15.174:0/3129074399 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda2c13b600 0x7fda2c13ba20 secure :-1 s=THROTTLE_DONE pgs=198 cs=0 l=1 rx=0x7fda240032b0 tx=0x7fda24007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:51.577 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.571+0000 7fda1bfff700 1 -- 172.21.15.174:0/3129074399 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda2400a2c0 con 0x7fda2c13b600 2020-04-02T23:46:51.577 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.571+0000 7fda1bfff700 1 -- 172.21.15.174:0/3129074399 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda2400a6a0 con 0x7fda2c13b600 2020-04-02T23:46:51.577 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.571+0000 7fda33277700 1 -- 172.21.15.174:0/3129074399 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda2c13b600 msgr2=0x7fda2c13ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:51.577 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.571+0000 7fda33277700 1 --2- 172.21.15.174:0/3129074399 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda2c13b600 0x7fda2c13ba20 secure :-1 s=READY pgs=198 cs=0 l=1 rx=0x7fda240032b0 tx=0x7fda24007dc0).stop 2020-04-02T23:46:51.577 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.571+0000 7fda33277700 1 -- 172.21.15.174:0/3129074399 shutdown_connections 2020-04-02T23:46:51.577 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.571+0000 7fda33277700 1 --2- 172.21.15.174:0/3129074399 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda2c13b600 0x7fda2c13ba20 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:51.578 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.571+0000 7fda33277700 1 -- 172.21.15.174:0/3129074399 >> 172.21.15.174:0/3129074399 conn(0x7fda2c0ab320 msgr2=0x7fda2c0ab730 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:46:51.578 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.571+0000 7fda33277700 1 -- 172.21.15.174:0/3129074399 shutdown_connections 2020-04-02T23:46:51.578 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.571+0000 7fda33277700 1 -- 172.21.15.174:0/3129074399 wait complete. 2020-04-02T23:46:51.578 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.572+0000 7fda33277700 1 Processor -- start 2020-04-02T23:46:51.578 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.572+0000 7fda33277700 1 -- start start 2020-04-02T23:46:51.581 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.573+0000 7fda33277700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fda2c0a62e0 0x7fda2c136370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:51.581 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.573+0000 7fda33277700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fda2c13b600 0x7fda2c12c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:51.582 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.573+0000 7fda33277700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda2c1368f0 con 0x7fda2c0a5f00 2020-04-02T23:46:51.582 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.573+0000 7fda33277700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda2c1377d0 con 0x7fda2c0a62e0 2020-04-02T23:46:51.582 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.573+0000 7fda33277700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda2c0a79f0 con 0x7fda2c13b600 2020-04-02T23:46:51.582 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.573+0000 7fda30812700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fda2c0a62e0 0x7fda2c136370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:51.582 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.573+0000 7fda30812700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fda2c0a62e0 0x7fda2c136370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:40410/0 (socket says 172.21.15.174:40410) 2020-04-02T23:46:51.582 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.573+0000 7fda30812700 1 -- 172.21.15.174:0/4069466540 learned_addr learned my addr 172.21.15.174:0/4069466540 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:46:51.582 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.573+0000 7fda31814700 1 --2- 172.21.15.174:0/4069466540 >> v2:172.21.15.196:3300/0 conn(0x7fda2c13b600 0x7fda2c12c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:51.582 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.573+0000 7fda30812700 1 -- 172.21.15.174:0/4069466540 >> v2:172.21.15.196:3300/0 conn(0x7fda2c13b600 msgr2=0x7fda2c12c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:51.583 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.573+0000 7fda30812700 1 --2- 172.21.15.174:0/4069466540 >> v2:172.21.15.196:3300/0 conn(0x7fda2c13b600 0x7fda2c12c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:51.583 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.573+0000 7fda30812700 1 -- 172.21.15.174:0/4069466540 >> v1:172.21.15.196:6789/0 conn(0x7fda2c0a5f00 legacy=0x7fda2c0a6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:51.583 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.573+0000 7fda30812700 1 -- 172.21.15.174:0/4069466540 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda2c0a7c90 con 0x7fda2c0a62e0 2020-04-02T23:46:51.583 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.573+0000 7fda30812700 1 --2- 172.21.15.174:0/4069466540 >> v2:172.21.15.174:3300/0 conn(0x7fda2c0a62e0 0x7fda2c136370 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fda2c05b340 tx=0x7fda28001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:51.583 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.573+0000 7fda30812700 1 --2- 172.21.15.174:0/4069466540 >> v2:172.21.15.174:3300/0 conn(0x7fda2c0a62e0 0x7fda2c136370 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fda2c05b340 tx=0x7fda28001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:51.583 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.573+0000 7fda30812700 1 --2- 172.21.15.174:0/4069466540 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda2c0a62e0 0x7fda2c136370 secure :-1 s=READY pgs=199 cs=0 l=1 rx=0x7fda2c05b340 tx=0x7fda28001e40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:51.583 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.573+0000 7fda30812700 1 --2- 172.21.15.174:0/4069466540 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda2c0a62e0 0x7fda2c136370 secure :-1 s=THROTTLE_DONE pgs=199 cs=0 l=1 rx=0x7fda2c05b340 tx=0x7fda28001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:51.584 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.573+0000 7fda30812700 1 --2- 172.21.15.174:0/4069466540 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda2c0a62e0 0x7fda2c136370 secure :-1 s=THROTTLE_DONE pgs=199 cs=0 l=1 rx=0x7fda2c05b340 tx=0x7fda28001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:51.584 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.573+0000 7fda30812700 1 --2- 172.21.15.174:0/4069466540 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda2c0a62e0 0x7fda2c136370 secure :-1 s=THROTTLE_DONE pgs=199 cs=0 l=1 rx=0x7fda2c05b340 tx=0x7fda28001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:51.584 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.573+0000 7fda1a7fc700 1 -- 172.21.15.174:0/4069466540 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda2800c970 con 0x7fda2c0a62e0 2020-04-02T23:46:51.584 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.573+0000 7fda1a7fc700 1 -- 172.21.15.174:0/4069466540 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda2800cad0 con 0x7fda2c0a62e0 2020-04-02T23:46:51.584 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.573+0000 7fda1a7fc700 1 -- 172.21.15.174:0/4069466540 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda280044f0 con 0x7fda2c0a62e0 2020-04-02T23:46:51.584 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.573+0000 7fda33277700 1 -- 172.21.15.174:0/4069466540 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda2c1308c0 con 0x7fda2c0a62e0 2020-04-02T23:46:51.584 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.574+0000 7fda33277700 1 -- 172.21.15.174:0/4069466540 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda2c13a960 con 0x7fda2c0a62e0 2020-04-02T23:46:51.584 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.574+0000 7fda30812700 1 --2- 172.21.15.174:0/4069466540 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda2c0a62e0 0x7fda2c136370 secure :-1 s=THROTTLE_DONE pgs=199 cs=0 l=1 rx=0x7fda2c05b340 tx=0x7fda28001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:51.585 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.574+0000 7fda1a7fc700 1 -- 172.21.15.174:0/4069466540 <== mon.0 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fda28004760 con 0x7fda2c0a62e0 2020-04-02T23:46:51.585 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.574+0000 7fda30812700 1 --2- 172.21.15.174:0/4069466540 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda2c0a62e0 0x7fda2c136370 secure :-1 s=THROTTLE_DONE pgs=199 cs=0 l=1 rx=0x7fda2c05b340 tx=0x7fda28001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:51.585 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.574+0000 7fda33277700 1 -- 172.21.15.174:0/4069466540 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda2c056c50 con 0x7fda2c0a62e0 2020-04-02T23:46:51.585 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.575+0000 7fda1a7fc700 1 --2- 172.21.15.174:0/4069466540 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fda0c04d500 0x7fda0c04f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:51.585 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.575+0000 7fda1a7fc700 1 -- 172.21.15.174:0/4069466540 <== mon.0 v2:172.21.15.174:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fda28060b50 con 0x7fda2c0a62e0 2020-04-02T23:46:51.585 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.575+0000 7fda31013700 1 --2- 172.21.15.174:0/4069466540 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fda0c04d500 0x7fda0c04f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:51.585 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.575+0000 7fda31013700 1 --2- 172.21.15.174:0/4069466540 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fda0c04d500 0x7fda0c04f9c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fda2c1307f0 tx=0x7fda2c0445b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:51.586 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.575+0000 7fda31013700 1 --2- 172.21.15.174:0/4069466540 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fda0c04d500 0x7fda0c04f9c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fda2c1307f0 tx=0x7fda2c0445b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:51.586 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.575+0000 7fda31013700 1 --2- 172.21.15.174:0/4069466540 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fda0c04d500 0x7fda0c04f9c0 secure :-1 s=READY pgs=115 cs=0 l=1 rx=0x7fda2c1307f0 tx=0x7fda2c0445b0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:51.586 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.578+0000 7fda30812700 1 --2- 172.21.15.174:0/4069466540 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda2c0a62e0 0x7fda2c136370 secure :-1 s=THROTTLE_DONE pgs=199 cs=0 l=1 rx=0x7fda2c05b340 tx=0x7fda28001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:51.586 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.578+0000 7fda1a7fc700 1 -- 172.21.15.174:0/4069466540 <== mon.0 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fda2803c1f0 con 0x7fda2c0a62e0 2020-04-02T23:46:51.714 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.712+0000 7fda33277700 1 -- 172.21.15.174:0/4069466540 --> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fda2c05a690 con 0x7fda0c04d500 2020-04-02T23:46:51.720 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.717+0000 7fda31013700 1 --2- 172.21.15.174:0/4069466540 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fda0c04d500 0x7fda0c04f9c0 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7fda2c1307f0 tx=0x7fda2c0445b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:51.720 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.717+0000 7fda1a7fc700 1 -- 172.21.15.174:0/4069466540 <== mgr.4102 v2:172.21.15.196:6800/23210 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+106936 (secure 0 0 0) 0x7fda2c05a690 con 0x7fda0c04d500 2020-04-02T23:46:51.720 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.718+0000 7fda33277700 1 -- 172.21.15.174:0/4069466540 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fda0c04d500 msgr2=0x7fda0c04f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:51.720 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.718+0000 7fda33277700 1 --2- 172.21.15.174:0/4069466540 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fda0c04d500 0x7fda0c04f9c0 secure :-1 s=READY pgs=115 cs=0 l=1 rx=0x7fda2c1307f0 tx=0x7fda2c0445b0).stop 2020-04-02T23:46:51.720 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.718+0000 7fda33277700 1 -- 172.21.15.174:0/4069466540 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda2c0a62e0 msgr2=0x7fda2c136370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:51.721 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.718+0000 7fda33277700 1 --2- 172.21.15.174:0/4069466540 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda2c0a62e0 0x7fda2c136370 secure :-1 s=READY pgs=199 cs=0 l=1 rx=0x7fda2c05b340 tx=0x7fda28001e40).stop 2020-04-02T23:46:51.721 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.718+0000 7fda33277700 1 -- 172.21.15.174:0/4069466540 shutdown_connections 2020-04-02T23:46:51.721 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.718+0000 7fda33277700 1 --2- 172.21.15.174:0/4069466540 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fda0c04d500 0x7fda0c04f9c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:51.721 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.718+0000 7fda33277700 1 --2- 172.21.15.174:0/4069466540 >> v2:172.21.15.196:3300/0 conn(0x7fda2c13b600 0x7fda2c12c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:51.721 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.718+0000 7fda33277700 1 --2- 172.21.15.174:0/4069466540 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda2c0a62e0 0x7fda2c136370 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:51.721 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.718+0000 7fda33277700 1 -- 172.21.15.174:0/4069466540 >> 172.21.15.174:0/4069466540 conn(0x7fda2c0ab320 msgr2=0x7fda2c0ad1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:46:51.721 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.718+0000 7fda33277700 1 -- 172.21.15.174:0/4069466540 shutdown_connections 2020-04-02T23:46:51.722 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.718+0000 7fda33277700 1 -- 172.21.15.174:0/4069466540 wait complete. 2020-04-02T23:46:51.722 INFO:teuthology.orchestra.run.smithi174.stdout: 2020-04-02T23:46:51.723 INFO:teuthology.orchestra.run.smithi174.stderr:dumped all 2020-04-02T23:46:51.730 INFO:teuthology.orchestra.run.smithi174.stdout:{"pg_ready":true,"pg_map":{"version":784,"stamp":"2020-04-02T23:46:50.444074+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":182244307,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":3275,"num_read_kb":10589,"num_write":316327,"num_write_kb":6259893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160658,"ondisk_log_size":160658,"up":50,"acting":50,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":749595040,"kb_used":6966180,"kb_used_data":742630292,"kb_used_omap":319316,"kb_used_meta":0,"kb_avail":742628860,"statfs":{"total":767585320960,"available":760451952640,"internally_reserved":1466368,"allocated":760453419008,"data_stored":760453419008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":326980220,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-225720352,"num_objects":-884,"num_object_clones":0,"num_object_copies":-1768,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-884,"num_whiteouts":0,"num_read":23,"num_read_kb":125,"num_write":1690,"num_write_kb":19433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-112,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002899"},"pg_stats":[{"pgid":"4.2","version":"23'23015","reported_seq":"23024","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:46:43.939898+0000","last_change":"2020-04-02T23:21:40.541967+0000","last_active":"2020-04-02T23:46:43.939898+0000","last_peered":"2020-04-02T23:46:43.939898+0000","last_clean":"2020-04-02T23:46:43.939898+0000","last_became_active":"2020-04-02T23:21:40.541485+0000","last_became_peered":"2020-04-02T23:21:40.541485+0000","last_unstale":"2020-04-02T23:46:43.939898+0000","last_undegraded":"2020-04-02T23:46:43.939898+0000","last_fullsized":"2020-04-02T23:46:43.939898+0000","mapping_epoch":21,"log_start":"23'13000","ondisk_log_start":"23'13000","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:40.142809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:40.142809+0000","last_clean_scrub_stamp":"2020-04-02T23:21:40.142809+0000","log_size":10015,"ondisk_log_size":10015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17420,"num_write_kb":364698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"12","reported_epoch":"22","state":"active+clean","last_fresh":"2020-04-02T23:21:40.539398+0000","last_change":"2020-04-02T23:21:37.552581+0000","last_active":"2020-04-02T23:21:40.539398+0000","last_peered":"2020-04-02T23:21:40.539398+0000","last_clean":"2020-04-02T23:21:40.539398+0000","last_became_active":"2020-04-02T23:21:37.552244+0000","last_became_peered":"2020-04-02T23:21:37.552244+0000","last_unstale":"2020-04-02T23:21:40.539398+0000","last_undegraded":"2020-04-02T23:21:40.539398+0000","last_fullsized":"2020-04-02T23:21:40.539398+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:36.120823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:36.120823+0000","last_clean_scrub_stamp":"2020-04-02T23:21:36.120823+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"23'27517","reported_seq":"27527","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:46:44.021435+0000","last_change":"2020-04-02T23:21:40.162228+0000","last_active":"2020-04-02T23:46:44.021435+0000","last_peered":"2020-04-02T23:46:44.021435+0000","last_clean":"2020-04-02T23:46:44.021435+0000","last_became_active":"2020-04-02T23:21:40.161797+0000","last_became_peered":"2020-04-02T23:21:40.161797+0000","last_unstale":"2020-04-02T23:46:44.021435+0000","last_undegraded":"2020-04-02T23:46:44.021435+0000","last_fullsized":"2020-04-02T23:46:44.021435+0000","mapping_epoch":20,"log_start":"23'17500","ondisk_log_start":"23'17500","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:39.137888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:39.137888+0000","last_clean_scrub_stamp":"2020-04-02T23:21:39.137888+0000","log_size":10017,"ondisk_log_size":10017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20971680,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27527,"num_write_kb":139084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"23'24404","reported_seq":"24413","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:46:44.010353+0000","last_change":"2020-04-02T23:21:40.542743+0000","last_active":"2020-04-02T23:46:44.010353+0000","last_peered":"2020-04-02T23:46:44.010353+0000","last_clean":"2020-04-02T23:46:44.010353+0000","last_became_active":"2020-04-02T23:21:40.542398+0000","last_became_peered":"2020-04-02T23:21:40.542398+0000","last_unstale":"2020-04-02T23:46:44.010353+0000","last_undegraded":"2020-04-02T23:46:44.010353+0000","last_fullsized":"2020-04-02T23:46:44.010353+0000","mapping_epoch":21,"log_start":"23'14400","ondisk_log_start":"23'14400","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:40.142809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:40.142809+0000","last_clean_scrub_stamp":"2020-04-02T23:21:40.142809+0000","log_size":10004,"ondisk_log_size":10004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18960,"num_write_kb":915362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"12","reported_epoch":"22","state":"active+clean","last_fresh":"2020-04-02T23:21:40.536883+0000","last_change":"2020-04-02T23:21:37.552581+0000","last_active":"2020-04-02T23:21:40.536883+0000","last_peered":"2020-04-02T23:21:40.536883+0000","last_clean":"2020-04-02T23:21:40.536883+0000","last_became_active":"2020-04-02T23:21:37.552288+0000","last_became_peered":"2020-04-02T23:21:37.552288+0000","last_unstale":"2020-04-02T23:21:40.536883+0000","last_undegraded":"2020-04-02T23:21:40.536883+0000","last_fullsized":"2020-04-02T23:21:40.536883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:36.120823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:36.120823+0000","last_clean_scrub_stamp":"2020-04-02T23:21:36.120823+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"23'22417","reported_seq":"22427","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:46:43.040389+0000","last_change":"2020-04-02T23:21:40.158169+0000","last_active":"2020-04-02T23:46:43.040389+0000","last_peered":"2020-04-02T23:46:43.040389+0000","last_clean":"2020-04-02T23:46:43.040389+0000","last_became_active":"2020-04-02T23:21:40.157809+0000","last_became_peered":"2020-04-02T23:21:40.157809+0000","last_unstale":"2020-04-02T23:46:43.040389+0000","last_undegraded":"2020-04-02T23:46:43.040389+0000","last_fullsized":"2020-04-02T23:46:43.040389+0000","mapping_epoch":20,"log_start":"23'12400","ondisk_log_start":"23'12400","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:39.137888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:39.137888+0000","last_clean_scrub_stamp":"2020-04-02T23:21:39.137888+0000","log_size":10017,"ondisk_log_size":10017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":33554466,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22437,"num_write_kb":119909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"23'22440","reported_seq":"22449","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:46:43.977248+0000","last_change":"2020-04-02T23:21:40.551966+0000","last_active":"2020-04-02T23:46:43.977248+0000","last_peered":"2020-04-02T23:46:43.977248+0000","last_clean":"2020-04-02T23:46:43.977248+0000","last_became_active":"2020-04-02T23:21:40.551607+0000","last_became_peered":"2020-04-02T23:21:40.551607+0000","last_unstale":"2020-04-02T23:46:43.977248+0000","last_undegraded":"2020-04-02T23:46:43.977248+0000","last_fullsized":"2020-04-02T23:46:43.977248+0000","mapping_epoch":21,"log_start":"23'12400","ondisk_log_start":"23'12400","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:40.142809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:40.142809+0000","last_clean_scrub_stamp":"2020-04-02T23:21:40.142809+0000","log_size":10040,"ondisk_log_size":10040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16873,"num_write_kb":829941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"12","reported_epoch":"22","state":"active+clean","last_fresh":"2020-04-02T23:21:40.537856+0000","last_change":"2020-04-02T23:21:37.135095+0000","last_active":"2020-04-02T23:21:40.537856+0000","last_peered":"2020-04-02T23:21:40.537856+0000","last_clean":"2020-04-02T23:21:40.537856+0000","last_became_active":"2020-04-02T23:21:37.134712+0000","last_became_peered":"2020-04-02T23:21:37.134712+0000","last_unstale":"2020-04-02T23:21:40.537856+0000","last_undegraded":"2020-04-02T23:21:40.537856+0000","last_fullsized":"2020-04-02T23:21:40.537856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:36.120823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:36.120823+0000","last_clean_scrub_stamp":"2020-04-02T23:21:36.120823+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"23'23910","reported_seq":"23920","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:46:43.028296+0000","last_change":"2020-04-02T23:21:40.162349+0000","last_active":"2020-04-02T23:46:43.028296+0000","last_peered":"2020-04-02T23:46:43.028296+0000","last_clean":"2020-04-02T23:46:43.028296+0000","last_became_active":"2020-04-02T23:21:40.161970+0000","last_became_peered":"2020-04-02T23:21:40.161970+0000","last_unstale":"2020-04-02T23:46:43.028296+0000","last_undegraded":"2020-04-02T23:46:43.028296+0000","last_fullsized":"2020-04-02T23:46:43.028296+0000","mapping_epoch":20,"log_start":"23'13900","ondisk_log_start":"23'13900","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:39.137888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:39.137888+0000","last_clean_scrub_stamp":"2020-04-02T23:21:39.137888+0000","log_size":10010,"ondisk_log_size":10010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":29360128,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23937,"num_write_kb":128370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"23'23333","reported_seq":"23342","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:46:43.994326+0000","last_change":"2020-04-02T23:21:40.550015+0000","last_active":"2020-04-02T23:46:43.994326+0000","last_peered":"2020-04-02T23:46:43.994326+0000","last_clean":"2020-04-02T23:46:43.994326+0000","last_became_active":"2020-04-02T23:21:40.549758+0000","last_became_peered":"2020-04-02T23:21:40.549758+0000","last_unstale":"2020-04-02T23:46:43.994326+0000","last_undegraded":"2020-04-02T23:46:43.994326+0000","last_fullsized":"2020-04-02T23:46:43.994326+0000","mapping_epoch":21,"log_start":"23'13300","ondisk_log_start":"23'13300","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:40.142809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:40.142809+0000","last_clean_scrub_stamp":"2020-04-02T23:21:40.142809+0000","log_size":10033,"ondisk_log_size":10033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17769,"num_write_kb":673677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"12","reported_epoch":"22","state":"active+clean","last_fresh":"2020-04-02T23:21:40.536894+0000","last_change":"2020-04-02T23:21:37.691403+0000","last_active":"2020-04-02T23:21:40.536894+0000","last_peered":"2020-04-02T23:21:40.536894+0000","last_clean":"2020-04-02T23:21:40.536894+0000","last_became_active":"2020-04-02T23:21:37.691080+0000","last_became_peered":"2020-04-02T23:21:37.691080+0000","last_unstale":"2020-04-02T23:21:40.536894+0000","last_undegraded":"2020-04-02T23:21:40.536894+0000","last_fullsized":"2020-04-02T23:21:40.536894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:36.120823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:36.120823+0000","last_clean_scrub_stamp":"2020-04-02T23:21:36.120823+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'2","reported_seq":"16","reported_epoch":"22","state":"active+clean","last_fresh":"2020-04-02T23:21:40.549160+0000","last_change":"2020-04-02T23:21:30.497862+0000","last_active":"2020-04-02T23:21:40.549160+0000","last_peered":"2020-04-02T23:21:40.549160+0000","last_clean":"2020-04-02T23:21:40.549160+0000","last_became_active":"2020-04-02T23:21:30.497574+0000","last_became_peered":"2020-04-02T23:21:30.497574+0000","last_unstale":"2020-04-02T23:21:40.549160+0000","last_undegraded":"2020-04-02T23:21:40.549160+0000","last_fullsized":"2020-04-02T23:21:40.549160+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":3,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:23.179251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:23.179251+0000","last_clean_scrub_stamp":"2020-04-02T23:21:23.179251+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"23'24592","reported_seq":"24602","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:46:43.023812+0000","last_change":"2020-04-02T23:21:40.158129+0000","last_active":"2020-04-02T23:46:43.023812+0000","last_peered":"2020-04-02T23:46:43.023812+0000","last_clean":"2020-04-02T23:46:43.023812+0000","last_became_active":"2020-04-02T23:21:40.157383+0000","last_became_peered":"2020-04-02T23:21:40.157383+0000","last_unstale":"2020-04-02T23:46:43.023812+0000","last_undegraded":"2020-04-02T23:46:43.023812+0000","last_fullsized":"2020-04-02T23:46:43.023812+0000","mapping_epoch":20,"log_start":"23'14500","ondisk_log_start":"23'14500","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:39.137888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:39.137888+0000","last_clean_scrub_stamp":"2020-04-02T23:21:39.137888+0000","log_size":10092,"ondisk_log_size":10092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":24605,"num_write_kb":128888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.6","version":"23'22311","reported_seq":"22320","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:46:42.155320+0000","last_change":"2020-04-02T23:21:40.541839+0000","last_active":"2020-04-02T23:46:42.155320+0000","last_peered":"2020-04-02T23:46:42.155320+0000","last_clean":"2020-04-02T23:46:42.155320+0000","last_became_active":"2020-04-02T23:21:40.541400+0000","last_became_peered":"2020-04-02T23:21:40.541400+0000","last_unstale":"2020-04-02T23:46:42.155320+0000","last_undegraded":"2020-04-02T23:46:42.155320+0000","last_fullsized":"2020-04-02T23:46:42.155320+0000","mapping_epoch":21,"log_start":"23'12300","ondisk_log_start":"23'12300","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:40.142809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:40.142809+0000","last_clean_scrub_stamp":"2020-04-02T23:21:40.142809+0000","log_size":10011,"ondisk_log_size":10011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16691,"num_write_kb":542620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"12","reported_epoch":"22","state":"active+clean","last_fresh":"2020-04-02T23:21:40.536882+0000","last_change":"2020-04-02T23:21:37.134760+0000","last_active":"2020-04-02T23:21:40.536882+0000","last_peered":"2020-04-02T23:21:40.536882+0000","last_clean":"2020-04-02T23:21:40.536882+0000","last_became_active":"2020-04-02T23:21:37.134489+0000","last_became_peered":"2020-04-02T23:21:37.134489+0000","last_unstale":"2020-04-02T23:21:40.536882+0000","last_undegraded":"2020-04-02T23:21:40.536882+0000","last_fullsized":"2020-04-02T23:21:40.536882+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:36.120823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:36.120823+0000","last_clean_scrub_stamp":"2020-04-02T23:21:36.120823+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"23'18082","reported_seq":"20214","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:46:43.034590+0000","last_change":"2020-04-02T23:21:40.160984+0000","last_active":"2020-04-02T23:46:43.034590+0000","last_peered":"2020-04-02T23:46:43.034590+0000","last_clean":"2020-04-02T23:46:43.034590+0000","last_became_active":"2020-04-02T23:21:40.160398+0000","last_became_peered":"2020-04-02T23:21:40.160398+0000","last_unstale":"2020-04-02T23:46:43.034590+0000","last_undegraded":"2020-04-02T23:46:43.034590+0000","last_fullsized":"2020-04-02T23:46:43.034590+0000","mapping_epoch":20,"log_start":"23'8000","ondisk_log_start":"23'8000","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:39.137888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:39.137888+0000","last_clean_scrub_stamp":"2020-04-02T23:21:39.137888+0000","log_size":10082,"ondisk_log_size":10082,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2122,"num_read_kb":5519,"num_write":18089,"num_write_kb":94359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"23'23329","reported_seq":"23338","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:46:44.005930+0000","last_change":"2020-04-02T23:21:40.550387+0000","last_active":"2020-04-02T23:46:44.005930+0000","last_peered":"2020-04-02T23:46:44.005930+0000","last_clean":"2020-04-02T23:46:44.005930+0000","last_became_active":"2020-04-02T23:21:40.550121+0000","last_became_peered":"2020-04-02T23:21:40.550121+0000","last_unstale":"2020-04-02T23:46:44.005930+0000","last_undegraded":"2020-04-02T23:46:44.005930+0000","last_fullsized":"2020-04-02T23:46:44.005930+0000","mapping_epoch":21,"log_start":"23'13300","ondisk_log_start":"23'13300","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:40.142809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:40.142809+0000","last_clean_scrub_stamp":"2020-04-02T23:21:40.142809+0000","log_size":10029,"ondisk_log_size":10029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":520192,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17592,"num_write_kb":769580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"12","reported_epoch":"22","state":"active+clean","last_fresh":"2020-04-02T23:21:40.537250+0000","last_change":"2020-04-02T23:21:37.134441+0000","last_active":"2020-04-02T23:21:40.537250+0000","last_peered":"2020-04-02T23:21:40.537250+0000","last_clean":"2020-04-02T23:21:40.537250+0000","last_became_active":"2020-04-02T23:21:37.134185+0000","last_became_peered":"2020-04-02T23:21:37.134185+0000","last_unstale":"2020-04-02T23:21:40.537250+0000","last_undegraded":"2020-04-02T23:21:40.537250+0000","last_fullsized":"2020-04-02T23:21:40.537250+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:36.120823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:36.120823+0000","last_clean_scrub_stamp":"2020-04-02T23:21:36.120823+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"23'21891","reported_seq":"21941","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:46:44.919251+0000","last_change":"2020-04-02T23:21:40.160705+0000","last_active":"2020-04-02T23:46:44.919251+0000","last_peered":"2020-04-02T23:46:44.919251+0000","last_clean":"2020-04-02T23:46:44.919251+0000","last_became_active":"2020-04-02T23:21:40.160330+0000","last_became_peered":"2020-04-02T23:21:40.160330+0000","last_unstale":"2020-04-02T23:46:44.919251+0000","last_undegraded":"2020-04-02T23:46:44.919251+0000","last_fullsized":"2020-04-02T23:46:44.919251+0000","mapping_epoch":20,"log_start":"23'11800","ondisk_log_start":"23'11800","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:39.137888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:39.137888+0000","last_clean_scrub_stamp":"2020-04-02T23:21:39.137888+0000","log_size":10091,"ondisk_log_size":10091,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25345175,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":40,"num_read_kb":202,"num_write":21901,"num_write_kb":115844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"23'23883","reported_seq":"23892","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:46:44.005612+0000","last_change":"2020-04-02T23:21:40.549980+0000","last_active":"2020-04-02T23:46:44.005612+0000","last_peered":"2020-04-02T23:46:44.005612+0000","last_clean":"2020-04-02T23:46:44.005612+0000","last_became_active":"2020-04-02T23:21:40.549674+0000","last_became_peered":"2020-04-02T23:21:40.549674+0000","last_unstale":"2020-04-02T23:46:44.005612+0000","last_undegraded":"2020-04-02T23:46:44.005612+0000","last_fullsized":"2020-04-02T23:46:44.005612+0000","mapping_epoch":21,"log_start":"23'13800","ondisk_log_start":"23'13800","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:40.142809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:40.142809+0000","last_clean_scrub_stamp":"2020-04-02T23:21:40.142809+0000","log_size":10083,"ondisk_log_size":10083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":64,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18291,"num_write_kb":701037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"23'14162","reported_seq":"15284","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:46:43.013133+0000","last_change":"2020-04-02T23:21:40.162904+0000","last_active":"2020-04-02T23:46:43.013133+0000","last_peered":"2020-04-02T23:46:43.013133+0000","last_clean":"2020-04-02T23:46:43.013133+0000","last_became_active":"2020-04-02T23:21:40.162580+0000","last_became_peered":"2020-04-02T23:21:40.162580+0000","last_unstale":"2020-04-02T23:46:43.013133+0000","last_undegraded":"2020-04-02T23:46:43.013133+0000","last_fullsized":"2020-04-02T23:46:43.013133+0000","mapping_epoch":20,"log_start":"23'4100","ondisk_log_start":"23'4100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:39.137888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:39.137888+0000","last_clean_scrub_stamp":"2020-04-02T23:21:39.137888+0000","log_size":10062,"ondisk_log_size":10062,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12583478,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1112,"num_read_kb":4868,"num_write":14188,"num_write_kb":75851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"13","reported_epoch":"22","state":"active+clean","last_fresh":"2020-04-02T23:21:40.540437+0000","last_change":"2020-04-02T23:21:37.743494+0000","last_active":"2020-04-02T23:21:40.540437+0000","last_peered":"2020-04-02T23:21:40.540437+0000","last_clean":"2020-04-02T23:21:40.540437+0000","last_became_active":"2020-04-02T23:21:37.743135+0000","last_became_peered":"2020-04-02T23:21:37.743135+0000","last_unstale":"2020-04-02T23:21:40.540437+0000","last_undegraded":"2020-04-02T23:21:40.540437+0000","last_fullsized":"2020-04-02T23:21:40.540437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:36.120823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:36.120823+0000","last_clean_scrub_stamp":"2020-04-02T23:21:36.120823+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"23'23262","reported_seq":"23271","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:46:44.010581+0000","last_change":"2020-04-02T23:21:40.540076+0000","last_active":"2020-04-02T23:46:44.010581+0000","last_peered":"2020-04-02T23:46:44.010581+0000","last_clean":"2020-04-02T23:46:44.010581+0000","last_became_active":"2020-04-02T23:21:40.539853+0000","last_became_peered":"2020-04-02T23:21:40.539853+0000","last_unstale":"2020-04-02T23:46:44.010581+0000","last_undegraded":"2020-04-02T23:46:44.010581+0000","last_fullsized":"2020-04-02T23:46:44.010581+0000","mapping_epoch":21,"log_start":"23'13200","ondisk_log_start":"23'13200","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:40.142809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:40.142809+0000","last_clean_scrub_stamp":"2020-04-02T23:21:40.142809+0000","log_size":10062,"ondisk_log_size":10062,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17651,"num_write_kb":545191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"12","reported_epoch":"22","state":"active+clean","last_fresh":"2020-04-02T23:21:40.536908+0000","last_change":"2020-04-02T23:21:37.743177+0000","last_active":"2020-04-02T23:21:40.536908+0000","last_peered":"2020-04-02T23:21:40.536908+0000","last_clean":"2020-04-02T23:21:40.536908+0000","last_became_active":"2020-04-02T23:21:37.742857+0000","last_became_peered":"2020-04-02T23:21:37.742857+0000","last_unstale":"2020-04-02T23:21:40.536908+0000","last_undegraded":"2020-04-02T23:21:40.536908+0000","last_fullsized":"2020-04-02T23:21:40.536908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:36.120823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:36.120823+0000","last_clean_scrub_stamp":"2020-04-02T23:21:36.120823+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'21808","reported_seq":"21818","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:46:44.425944+0000","last_change":"2020-04-02T23:21:40.162268+0000","last_active":"2020-04-02T23:46:44.425944+0000","last_peered":"2020-04-02T23:46:44.425944+0000","last_clean":"2020-04-02T23:46:44.425944+0000","last_became_active":"2020-04-02T23:21:40.161928+0000","last_became_peered":"2020-04-02T23:21:40.161928+0000","last_unstale":"2020-04-02T23:46:44.425944+0000","last_undegraded":"2020-04-02T23:46:44.425944+0000","last_fullsized":"2020-04-02T23:46:44.425944+0000","mapping_epoch":20,"log_start":"23'11800","ondisk_log_start":"23'11800","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:39.137888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:39.137888+0000","last_clean_scrub_stamp":"2020-04-02T23:21:39.137888+0000","log_size":10008,"ondisk_log_size":10008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":17966084,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22394,"num_write_kb":115472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":520256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141247,"num_write_kb":5342106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80277,"ondisk_log_size":80277,"up":16,"acting":16,"num_store_stats":0},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":181724051,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":3275,"num_read_kb":10589,"num_write":175078,"num_write_kb":917777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80379,"ondisk_log_size":80379,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542451,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":870224,"kb_used_data":92829620,"kb_used_omap":56722,"kb_used_meta":0,"kb_avail":92829156,"statfs":{"total":95948165120,"available":95057055744,"internally_reserved":475136,"allocated":95057530880,"data_stored":95057530880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58083739,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 2 23:46:17 2020","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.39400000000000002,"15min":0.36599999999999999},"min":{"1min":0.20100000000000001,"5min":0.185,"15min":0.17599999999999999},"max":{"1min":0.61899999999999999,"5min":3.6829999999999998,"15min":3.6829999999999998},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39300000000000002,"15min":0.41899999999999998},"min":{"1min":0.215,"5min":0.19400000000000001,"15min":0.193},"max":{"1min":1.3129999999999999,"5min":2.669,"15min":9.5700000000000003},"last":0.43099999999999999}]},{"osd":1,"last update":"Thu Apr 2 23:46:17 2020","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.47399999999999998,"15min":0.45000000000000001},"min":{"1min":0.23599999999999999,"5min":0.20699999999999999,"15min":0.192},"max":{"1min":0.57399999999999995,"5min":3.7250000000000001,"15min":3.7250000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.53200000000000003,"15min":0.47999999999999998},"min":{"1min":0.221,"5min":0.20399999999999999,"15min":0.189},"max":{"1min":1.341,"5min":5.306,"15min":9.5280000000000005},"last":0.58899999999999997}]},{"osd":2,"last update":"Thu Apr 2 23:46:17 2020","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.51700000000000002,"15min":0.433},"min":{"1min":0.22600000000000001,"5min":0.215,"15min":0.20999999999999999},"max":{"1min":3.8900000000000001,"5min":4.1100000000000003,"15min":4.1100000000000003},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.52300000000000002,"15min":0.46700000000000003},"min":{"1min":0.219,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.67600000000000005,"5min":3.7970000000000002,"15min":3.7970000000000002},"last":0.67700000000000005}]},{"osd":3,"last update":"Thu Apr 2 23:46:17 2020","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.55900000000000005,"15min":0.47699999999999998},"min":{"1min":0.26400000000000001,"5min":0.224,"15min":0.221},"max":{"1min":1.5820000000000001,"5min":4.2009999999999996,"15min":4.2009999999999996},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.57299999999999995,"15min":0.54800000000000004},"min":{"1min":0.311,"5min":0.29199999999999998,"15min":0.253},"max":{"1min":0.71199999999999997,"5min":3.7629999999999999,"15min":4.9199999999999999},"last":0.47599999999999998}]},{"osd":4,"last update":"Thu Apr 2 23:46:17 2020","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.63500000000000001,"15min":0.505},"min":{"1min":0.214,"5min":0.214,"15min":0.20000000000000001},"max":{"1min":2.5739999999999998,"5min":5.7910000000000004,"15min":5.7910000000000004},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.434,"5min":0.52400000000000002,"15min":0.45100000000000001},"min":{"1min":0.247,"5min":0.23699999999999999,"15min":0.22600000000000001},"max":{"1min":0.63400000000000001,"5min":4.1639999999999997,"15min":4.1639999999999997},"last":0.63400000000000001}]},{"osd":5,"last update":"Thu Apr 2 23:46:17 2020","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.56799999999999995,"15min":0.52200000000000002},"min":{"1min":0.252,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.76700000000000002,"5min":4.0750000000000002,"15min":4.0750000000000002},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.64300000000000002,"15min":0.54900000000000004},"min":{"1min":0.33000000000000002,"5min":0.26100000000000001,"15min":0.24299999999999999},"max":{"1min":2.617,"5min":5.8310000000000004,"15min":5.8310000000000004},"last":0.69399999999999995}]},{"osd":6,"last update":"Thu Apr 2 23:46:17 2020","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.72199999999999998,"15min":0.58899999999999997},"min":{"1min":0.318,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":3.1960000000000002,"5min":5.8700000000000001,"15min":5.8700000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.56799999999999995,"15min":0.52300000000000002},"min":{"1min":0.34899999999999998,"5min":0.28699999999999998,"15min":0.215},"max":{"1min":0.78000000000000003,"5min":4.2370000000000001,"15min":4.2370000000000001},"last":0.57099999999999995}]}]},{"osd":6,"up_from":14,"seq":60129542451,"num_pgs":10,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":954868,"kb_used_data":92744752,"kb_used_omap":54813,"kb_used_meta":0,"kb_avail":92744512,"statfs":{"total":95948165120,"available":94970380288,"internally_reserved":245760,"allocated":94970626048,"data_stored":94970626048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":56128735,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 2 23:46:06 2020","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.46500000000000002,"15min":0.374},"min":{"1min":0.191,"5min":0.16900000000000001,"15min":0.156},"max":{"1min":3.927,"5min":5.6079999999999997,"15min":5.6079999999999997},"last":0.23599999999999999},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.46300000000000002,"15min":0.436},"min":{"1min":0.218,"5min":0.20399999999999999,"15min":0.17199999999999999},"max":{"1min":0.60099999999999998,"5min":3.411,"15min":4.4950000000000001},"last":0.35999999999999999}]},{"osd":1,"last update":"Thu Apr 2 23:46:06 2020","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.443,"15min":0.44400000000000001},"min":{"1min":0.23400000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":3.976,"5min":3.976,"15min":3.976},"last":0.44},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.53300000000000003,"15min":0.47199999999999998},"min":{"1min":0.23599999999999999,"5min":0.218,"15min":0.188},"max":{"1min":4.0010000000000003,"5min":5.532,"15min":5.532},"last":0.42099999999999999}]},{"osd":2,"last update":"Thu Apr 2 23:46:06 2020","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.47699999999999998,"15min":0.45600000000000002},"min":{"1min":0.218,"5min":0.218,"15min":0.20499999999999999},"max":{"1min":4.0300000000000002,"5min":4.0300000000000002,"15min":4.0300000000000002},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.57599999999999996,"15min":0.46899999999999997},"min":{"1min":0.28100000000000003,"5min":0.221,"15min":0.216},"max":{"1min":4.056,"5min":5.5599999999999996,"15min":5.5599999999999996},"last":0.28100000000000003}]},{"osd":3,"last update":"Thu Apr 2 23:46:06 2020","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.55200000000000005,"15min":0.51300000000000001},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.20799999999999999},"max":{"1min":0.61299999999999999,"5min":3.4990000000000001,"15min":4.6130000000000004},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.59499999999999997,"15min":0.56100000000000005},"min":{"1min":0.29999999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":4.133,"5min":4.133,"15min":4.133},"last":0.51200000000000001}]},{"osd":4,"last update":"Thu Apr 2 23:46:06 2020","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.53600000000000003,"15min":0.45600000000000002},"min":{"1min":0.26400000000000001,"5min":0.249,"15min":0.189},"max":{"1min":4.1139999999999999,"5min":5.4509999999999996,"15min":5.4509999999999996},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.57099999999999995,"15min":0.51700000000000002},"min":{"1min":0.33200000000000002,"5min":0.26800000000000002,"15min":0.23100000000000001},"max":{"1min":4.0910000000000002,"5min":4.0910000000000002,"15min":4.0910000000000002},"last":0.59999999999999998}]},{"osd":5,"last update":"Thu Apr 2 23:46:06 2020","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.55700000000000005,"15min":0.54900000000000004},"min":{"1min":0.35499999999999998,"5min":0.25700000000000001,"15min":0.224},"max":{"1min":4.1719999999999997,"5min":4.1719999999999997,"15min":5.1970000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.628,"15min":0.57399999999999995},"min":{"1min":0.29899999999999999,"5min":0.27100000000000002,"15min":0.224},"max":{"1min":4.1529999999999996,"5min":5.4989999999999997,"15min":5.4989999999999997},"last":0.54300000000000004}]},{"osd":7,"last update":"Thu Apr 2 23:46:06 2020","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.59599999999999997,"15min":0.55900000000000005},"min":{"1min":0.30299999999999999,"5min":0.28799999999999998,"15min":0.22800000000000001},"max":{"1min":0.72799999999999998,"5min":3.464,"15min":4.6539999999999999},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.64400000000000002,"15min":0.621},"min":{"1min":0.40600000000000003,"5min":0.33100000000000002,"15min":0.32600000000000001},"max":{"1min":4.202,"5min":4.202,"15min":4.5300000000000002},"last":0.63800000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542450,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796196,"kb_used_data":92903244,"kb_used_omap":25683,"kb_used_meta":0,"kb_avail":92903184,"statfs":{"total":95948165120,"available":95132860416,"internally_reserved":61440,"allocated":95132921856,"data_stored":95132921856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26299877,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 2 23:46:24 2020","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.33600000000000002,"15min":0.30499999999999999},"min":{"1min":0.17199999999999999,"5min":0.16400000000000001,"15min":0.155},"max":{"1min":4.5439999999999996,"5min":4.5439999999999996,"15min":4.5439999999999996},"last":0.441},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.32600000000000001,"15min":0.317},"min":{"1min":0.153,"5min":0.153,"15min":0.153},"max":{"1min":0.54900000000000004,"5min":0.64500000000000002,"15min":0.748},"last":0.185}]},{"osd":2,"last update":"Thu Apr 2 23:46:24 2020","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.505,"15min":0.39900000000000002},"min":{"1min":0.188,"5min":0.183,"15min":0.17199999999999999},"max":{"1min":3.5710000000000002,"5min":5.2240000000000002,"15min":5.2240000000000002},"last":0.23200000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.45700000000000002,"15min":0.38700000000000001},"min":{"1min":0.224,"5min":0.20000000000000001,"15min":0.16900000000000001},"max":{"1min":4.6310000000000002,"5min":5.1609999999999996,"15min":5.1609999999999996},"last":0.20300000000000001}]},{"osd":3,"last update":"Thu Apr 2 23:46:24 2020","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.39400000000000002,"15min":0.376},"min":{"1min":0.19900000000000001,"5min":0.19700000000000001,"15min":0.189},"max":{"1min":0.623,"5min":3.27,"15min":6.9539999999999997},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.46100000000000002,"15min":0.46300000000000002},"min":{"1min":0.22800000000000001,"5min":0.20399999999999999,"15min":0.17899999999999999},"max":{"1min":1.22,"5min":5.181,"15min":5.181},"last":0.32800000000000001}]},{"osd":4,"last update":"Thu Apr 2 23:46:24 2020","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.63,"15min":0.51400000000000001},"min":{"1min":0.27100000000000002,"5min":0.245,"15min":0.245},"max":{"1min":4.601,"5min":4.992,"15min":4.992},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.46000000000000002,"15min":0.439},"min":{"1min":0.25600000000000001,"5min":0.253,"15min":0.23000000000000001},"max":{"1min":0.59299999999999997,"5min":3.1619999999999999,"15min":3.1619999999999999},"last":0.38500000000000001}]},{"osd":5,"last update":"Thu Apr 2 23:46:24 2020","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.48799999999999999,"15min":0.48099999999999998},"min":{"1min":0.26400000000000001,"5min":0.25700000000000001,"15min":0.24099999999999999},"max":{"1min":0.64100000000000001,"5min":3.2069999999999999,"15min":3.7490000000000001},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.56799999999999995,"15min":0.51500000000000001},"min":{"1min":0.36599999999999999,"5min":0.254,"15min":0.246},"max":{"1min":4.0190000000000001,"5min":5.2770000000000001,"15min":5.2770000000000001},"last":0.48199999999999998}]},{"osd":6,"last update":"Thu Apr 2 23:46:24 2020","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.65600000000000003,"15min":0.58199999999999996},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":4.5030000000000001,"5min":5.0609999999999999,"15min":5.0609999999999999},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.59899999999999998,"15min":0.54200000000000004},"min":{"1min":0.308,"5min":0.28299999999999997,"15min":0.26700000000000002},"max":{"1min":1.5209999999999999,"5min":3.6269999999999998,"15min":3.6269999999999998},"last":0.46200000000000002}]},{"osd":7,"last update":"Thu Apr 2 23:46:24 2020","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.66900000000000004,"15min":0.56200000000000006},"min":{"1min":0.35499999999999998,"5min":0.311,"15min":0.28100000000000003},"max":{"1min":4.3520000000000003,"5min":5.3099999999999996,"15min":5.3099999999999996},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.80800000000000005,"15min":0.66400000000000003},"min":{"1min":0.36099999999999999,"5min":0.35499999999999998,"15min":0.33300000000000002},"max":{"1min":4.569,"5min":5.1299999999999999,"15min":7.8810000000000002},"last":0.31}]}]},{"osd":0,"up_from":14,"seq":60129542451,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":829168,"kb_used_data":92870220,"kb_used_omap":37270,"kb_used_meta":0,"kb_avail":92870212,"statfs":{"total":95948165120,"available":95099097088,"internally_reserved":8192,"allocated":95099105280,"data_stored":95099105280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":38165122,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 2 23:46:24 2020","interfaces":[{"interface":"back","average":{"1min":0.29699999999999999,"5min":0.35499999999999998,"15min":0.30499999999999999},"min":{"1min":0.17199999999999999,"5min":0.156,"15min":0.155},"max":{"1min":0.61899999999999999,"5min":7.1180000000000003,"15min":7.1180000000000003},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.193,"5min":0.16900000000000001,"15min":0.16200000000000001},"max":{"1min":0.57899999999999996,"5min":0.97699999999999998,"15min":3.46},"last":0.47699999999999998}]},{"osd":2,"last update":"Thu Apr 2 23:46:24 2020","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.44600000000000001,"15min":0.39900000000000002},"min":{"1min":0.17999999999999999,"5min":0.17999999999999999,"15min":0.159},"max":{"1min":0.59599999999999997,"5min":4.3200000000000003,"15min":4.3200000000000003},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.32700000000000001,"15min":0.35599999999999998},"min":{"1min":0.192,"5min":0.16300000000000001,"15min":0.16300000000000001},"max":{"1min":4.2889999999999997,"5min":4.2889999999999997,"15min":4.2999999999999998},"last":0.28100000000000003}]},{"osd":3,"last update":"Thu Apr 2 23:46:24 2020","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.434,"15min":0.40899999999999997},"min":{"1min":0.222,"5min":0.19800000000000001,"15min":0.182},"max":{"1min":0.76100000000000001,"5min":3.113,"15min":3.113},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.44400000000000001,"15min":0.433},"min":{"1min":0.22800000000000001,"5min":0.20799999999999999,"15min":0.20599999999999999},"max":{"1min":0.751,"5min":3.1000000000000001,"15min":3.6850000000000001},"last":0.38500000000000001}]},{"osd":4,"last update":"Thu Apr 2 23:46:24 2020","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.442,"15min":0.44700000000000001},"min":{"1min":0.27000000000000002,"5min":0.247,"15min":0.22600000000000001},"max":{"1min":0.745,"5min":1.048,"15min":3.9420000000000002},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.503,"15min":0.47999999999999998},"min":{"1min":0.26300000000000001,"5min":0.24299999999999999,"15min":0.22700000000000001},"max":{"1min":0.74099999999999999,"5min":6.1479999999999997,"15min":6.1479999999999997},"last":0.52100000000000002}]},{"osd":5,"last update":"Thu Apr 2 23:46:24 2020","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.45800000000000002,"15min":0.47699999999999998},"min":{"1min":0.27600000000000002,"5min":0.24299999999999999,"15min":0.23100000000000001},"max":{"1min":4.3849999999999998,"5min":4.3849999999999998,"15min":4.423},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.50600000000000001,"15min":0.49099999999999999},"min":{"1min":0.31900000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.73599999999999999,"5min":1.254,"15min":2.6899999999999999},"last":0.502}]},{"osd":6,"last update":"Thu Apr 2 23:46:24 2020","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.57699999999999996,"15min":0.55800000000000005},"min":{"1min":0.28999999999999998,"5min":0.27500000000000002,"15min":0.26900000000000002},"max":{"1min":0.82599999999999996,"5min":5.2720000000000002,"15min":5.2720000000000002},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.61099999999999999,"15min":0.56000000000000005},"min":{"1min":0.315,"5min":0.26600000000000001,"15min":0.26500000000000001},"max":{"1min":4.3470000000000004,"5min":7.0979999999999999,"15min":7.0979999999999999},"last":0.54900000000000004}]},{"osd":7,"last update":"Thu Apr 2 23:46:24 2020","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.625,"15min":0.56999999999999995},"min":{"1min":0.35499999999999998,"5min":0.30299999999999999,"15min":0.25},"max":{"1min":4.4119999999999999,"5min":7.1539999999999999,"15min":7.1539999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.54400000000000004,"15min":0.52000000000000002},"min":{"1min":0.36299999999999999,"5min":0.34699999999999998,"15min":0.33700000000000002},"max":{"1min":0.78900000000000003,"5min":1.0840000000000001,"15min":2.7930000000000001},"last":0.63600000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542450,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":958152,"kb_used_data":92741400,"kb_used_omap":17189,"kb_used_meta":0,"kb_avail":92741228,"statfs":{"total":95948165120,"available":94967017472,"internally_reserved":176128,"allocated":94967193600,"data_stored":94967193600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17601650,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 2 23:46:15 2020","interfaces":[{"interface":"back","average":{"1min":0.30299999999999999,"5min":0.31,"15min":0.32900000000000001},"min":{"1min":0.159,"5min":0.14000000000000001,"15min":0.14000000000000001},"max":{"1min":0.63600000000000001,"5min":3.2090000000000001,"15min":4.3929999999999998},"last":0.215},{"interface":"front","average":{"1min":0.28599999999999998,"5min":0.308,"15min":0.28999999999999998},"min":{"1min":0.161,"5min":0.161,"15min":0.161},"max":{"1min":0.64100000000000001,"5min":0.84999999999999998,"15min":0.97499999999999998},"last":0.23300000000000001}]},{"osd":1,"last update":"Thu Apr 2 23:46:15 2020","interfaces":[{"interface":"back","average":{"1min":0.28699999999999998,"5min":0.45000000000000001,"15min":0.40400000000000003},"min":{"1min":0.184,"5min":0.17899999999999999,"15min":0.16700000000000001},"max":{"1min":0.49299999999999999,"5min":4.4000000000000004,"15min":4.4000000000000004},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.443,"15min":0.41699999999999998},"min":{"1min":0.186,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.52700000000000002,"5min":4.7839999999999998,"15min":4.7839999999999998},"last":0.25800000000000001}]},{"osd":3,"last update":"Thu Apr 2 23:46:15 2020","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.47499999999999998,"15min":0.40100000000000002},"min":{"1min":0.221,"5min":0.188,"15min":0.182},"max":{"1min":0.91100000000000003,"5min":4.3499999999999996,"15min":4.3499999999999996},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.441,"5min":0.47899999999999998,"15min":0.45300000000000001},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":1.0169999999999999,"5min":3.387,"15min":4.6269999999999998},"last":0.32000000000000001}]},{"osd":4,"last update":"Thu Apr 2 23:46:15 2020","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.52400000000000002,"15min":0.497},"min":{"1min":0.28299999999999997,"5min":0.23200000000000001,"15min":0.22700000000000001},"max":{"1min":0.63400000000000001,"5min":3.5699999999999998,"15min":4.5570000000000004},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.47999999999999998,"15min":0.44900000000000001},"min":{"1min":0.251,"5min":0.251,"15min":0.23499999999999999},"max":{"1min":0.54600000000000004,"5min":3.1669999999999998,"15min":5.3230000000000004},"last":0.35199999999999998}]},{"osd":5,"last update":"Thu Apr 2 23:46:15 2020","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.502,"15min":0.47199999999999998},"min":{"1min":0.27900000000000003,"5min":0.26400000000000001,"15min":0.246},"max":{"1min":0.72099999999999997,"5min":4.5359999999999996,"15min":4.5359999999999996},"last":0.376},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.57399999999999995,"15min":0.55100000000000005},"min":{"1min":0.26000000000000001,"5min":0.255,"15min":0.254},"max":{"1min":3.8919999999999999,"5min":3.8919999999999999,"15min":4.5960000000000001},"last":0.36399999999999999}]},{"osd":6,"last update":"Thu Apr 2 23:46:15 2020","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.54800000000000004,"15min":0.48999999999999999},"min":{"1min":0.28599999999999998,"5min":0.28399999999999997,"15min":0.27100000000000002},"max":{"1min":0.60599999999999998,"5min":4.8360000000000003,"15min":4.8360000000000003},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.64400000000000002,"15min":0.56399999999999995},"min":{"1min":0.30299999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.69299999999999995,"5min":4.984,"15min":5.2690000000000001},"last":2.7170000000000001}]},{"osd":7,"last update":"Thu Apr 2 23:46:15 2020","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.56100000000000005,"15min":0.51400000000000001},"min":{"1min":0.35399999999999998,"5min":0.32600000000000001,"15min":0.26900000000000002},"max":{"1min":0.65500000000000003,"5min":3.4119999999999999,"15min":3.4119999999999999},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.68799999999999994,"15min":0.59699999999999998},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.30399999999999999},"max":{"1min":3.8100000000000001,"5min":4.5750000000000002,"15min":5.2439999999999998},"last":0.41999999999999998}]}]},{"osd":3,"up_from":14,"seq":60129542450,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796132,"kb_used_data":92903248,"kb_used_omap":37812,"kb_used_meta":0,"kb_avail":92903248,"statfs":{"total":95948165120,"available":95132925952,"internally_reserved":0,"allocated":95132925952,"data_stored":95132925952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":38719574,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 2 23:46:10 2020","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.34100000000000003,"15min":0.314},"min":{"1min":0.17100000000000001,"5min":0.161,"15min":0.154},"max":{"1min":3.129,"5min":3.129,"15min":4.3159999999999998},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.46200000000000002,"15min":0.39000000000000001},"min":{"1min":0.192,"5min":0.186,"15min":0.186},"max":{"1min":3.258,"5min":6.7939999999999996,"15min":6.7939999999999996},"last":0.39000000000000001}]},{"osd":1,"last update":"Thu Apr 2 23:46:10 2020","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.45100000000000001,"15min":0.34300000000000003},"min":{"1min":0.185,"5min":0.16900000000000001,"15min":0.16800000000000001},"max":{"1min":2.3919999999999999,"5min":4.4850000000000003,"15min":4.4850000000000003},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.40699999999999997,"15min":0.38500000000000001},"min":{"1min":0.26500000000000001,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":2.927,"5min":2.927,"15min":2.927},"last":0.49299999999999999}]},{"osd":2,"last update":"Thu Apr 2 23:46:10 2020","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.42599999999999999,"15min":0.39400000000000002},"min":{"1min":0.188,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":3.0299999999999998,"5min":3.0299999999999998,"15min":3.0299999999999998},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.58999999999999997,"15min":0.45000000000000001},"min":{"1min":0.20499999999999999,"5min":0.19600000000000001,"15min":0.17699999999999999},"max":{"1min":4.6260000000000003,"5min":6.8179999999999996,"15min":6.8179999999999996},"last":0.32300000000000001}]},{"osd":4,"last update":"Thu Apr 2 23:46:10 2020","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.438},"min":{"1min":0.251,"5min":0.23000000000000001,"15min":0.21199999999999999},"max":{"1min":2.452,"5min":4.5309999999999997,"15min":4.5309999999999997},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.53200000000000003,"15min":0.49299999999999999},"min":{"1min":0.28799999999999998,"5min":0.247,"15min":0.23599999999999999},"max":{"1min":2.9620000000000002,"5min":2.9620000000000002,"15min":2.9620000000000002},"last":0.54700000000000004}]},{"osd":5,"last update":"Thu Apr 2 23:46:10 2020","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.64200000000000002,"15min":0.57599999999999996},"min":{"1min":0.32600000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":3.5299999999999998,"5min":6.7229999999999999,"15min":6.7229999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.629,"15min":0.495},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.251},"max":{"1min":2.5070000000000001,"5min":4.5679999999999996,"15min":4.5679999999999996},"last":0.47699999999999998}]},{"osd":6,"last update":"Thu Apr 2 23:46:10 2020","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.59099999999999997,"15min":0.54200000000000004},"min":{"1min":0.36199999999999999,"5min":0.28000000000000003,"15min":0.27000000000000002},"max":{"1min":3.0739999999999998,"5min":3.0739999999999998,"15min":3.8639999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.67000000000000004,"15min":0.57699999999999996},"min":{"1min":0.29899999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":3.5579999999999998,"5min":6.6680000000000001,"15min":6.6680000000000001},"last":0.46800000000000003}]},{"osd":7,"last update":"Thu Apr 2 23:46:10 2020","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.60599999999999998,"15min":0.55700000000000005},"min":{"1min":0.39100000000000001,"5min":0.32600000000000001,"15min":0.32100000000000001},"max":{"1min":2.992,"5min":4.7839999999999998,"15min":4.7839999999999998},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.67700000000000005,"15min":0.58999999999999997},"min":{"1min":0.374,"5min":0.31900000000000001,"15min":0.28199999999999997},"max":{"1min":3.4990000000000001,"5min":6.7599999999999998,"15min":6.7599999999999998},"last":0.55900000000000005}]}]},{"osd":4,"up_from":14,"seq":60129542450,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":877184,"kb_used_data":92822568,"kb_used_omap":52307,"kb_used_meta":0,"kb_avail":92822196,"statfs":{"total":95948165120,"available":95049928704,"internally_reserved":380928,"allocated":95050309632,"data_stored":95050309632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":53563362,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 2 23:46:20 2020","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.371,"15min":0.35499999999999998},"min":{"1min":0.191,"5min":0.184,"15min":0.17199999999999999},"max":{"1min":3.5129999999999999,"5min":3.5129999999999999,"15min":3.758},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41699999999999998,"15min":0.41499999999999998},"min":{"1min":0.251,"5min":0.216,"15min":0.185},"max":{"1min":0.63400000000000001,"5min":2.5800000000000001,"15min":4.1189999999999998},"last":0.29399999999999998}]},{"osd":1,"last update":"Thu Apr 2 23:46:20 2020","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.40799999999999997},"min":{"1min":0.24399999999999999,"5min":0.189,"15min":0.17299999999999999},"max":{"1min":0.66100000000000003,"5min":1.137,"15min":4.1559999999999997},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.24199999999999999,"5min":0.22700000000000001,"15min":0.19700000000000001},"max":{"1min":3.891,"5min":3.891,"15min":4.1970000000000001},"last":0.254}]},{"osd":2,"last update":"Thu Apr 2 23:46:20 2020","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.221,"5min":0.20999999999999999,"15min":0.20399999999999999},"max":{"1min":3.8570000000000002,"5min":3.8570000000000002,"15min":4.2489999999999997},"last":0.308},{"interface":"front","average":{"1min":0.751,"5min":0.48699999999999999,"15min":0.437},"min":{"1min":0.222,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":4.7160000000000002,"5min":4.7160000000000002,"15min":4.7160000000000002},"last":0.66000000000000003}]},{"osd":3,"last update":"Thu Apr 2 23:46:20 2020","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.501,"15min":0.51400000000000001},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.72799999999999998,"5min":3.4769999999999999,"15min":5.3780000000000001},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.52100000000000002,"15min":0.55100000000000005},"min":{"1min":0.32700000000000001,"5min":0.27900000000000003,"15min":0.26200000000000001},"max":{"1min":3.956,"5min":3.956,"15min":5.359},"last":0.376}]},{"osd":5,"last update":"Thu Apr 2 23:46:20 2020","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.45200000000000001,"15min":0.439},"min":{"1min":0.27200000000000002,"5min":0.22,"15min":0.217},"max":{"1min":3.5449999999999999,"5min":3.5449999999999999,"15min":3.8029999999999999},"last":0.626},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.54900000000000004,"15min":0.498},"min":{"1min":0.23699999999999999,"5min":0.23000000000000001,"15min":0.21299999999999999},"max":{"1min":5.1900000000000004,"5min":5.1900000000000004,"15min":5.1900000000000004},"last":0.39500000000000002}]},{"osd":6,"last update":"Thu Apr 2 23:46:20 2020","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.52600000000000002,"15min":0.51800000000000002},"min":{"1min":0.25700000000000001,"5min":0.23699999999999999,"15min":0.20000000000000001},"max":{"1min":3.7999999999999998,"5min":3.7999999999999998,"15min":4.29},"last":0.755},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.56399999999999995,"15min":0.54800000000000004},"min":{"1min":0.29099999999999998,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":3.4700000000000002,"5min":3.4700000000000002,"15min":5.9420000000000002},"last":0.80800000000000005}]},{"osd":7,"last update":"Thu Apr 2 23:46:20 2020","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.53000000000000003,"15min":0.56499999999999995},"min":{"1min":0.255,"5min":0.255,"15min":0.22600000000000001},"max":{"1min":0.76400000000000001,"5min":1.0429999999999999,"15min":4.1870000000000003},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.53800000000000003,"15min":0.58799999999999997},"min":{"1min":0.315,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":3.927,"5min":3.927,"15min":4.4429999999999996},"last":0.34200000000000003}]}]},{"osd":5,"up_from":14,"seq":60129542450,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":884256,"kb_used_data":92815240,"kb_used_omap":37517,"kb_used_meta":0,"kb_avail":92815124,"statfs":{"total":95948165120,"available":95042686976,"internally_reserved":118784,"allocated":95042805760,"data_stored":95042805760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":38418161,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 2 23:46:25 2020","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.34899999999999998,"15min":0.34200000000000003},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.16700000000000001},"max":{"1min":1.2929999999999999,"5min":1.607,"15min":3.2669999999999999},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.47599999999999998,"15min":0.46100000000000002},"min":{"1min":0.221,"5min":0.19800000000000001,"15min":0.191},"max":{"1min":1.321,"5min":5.0970000000000004,"15min":5.0970000000000004},"last":0.56399999999999995}]},{"osd":1,"last update":"Thu Apr 2 23:46:25 2020","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.54900000000000004,"15min":0.502},"min":{"1min":0.23400000000000001,"5min":0.214,"15min":0.159},"max":{"1min":4.2530000000000001,"5min":5.1360000000000001,"15min":5.1360000000000001},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.48099999999999998,"15min":0.44600000000000001},"min":{"1min":0.217,"5min":0.20799999999999999,"15min":0.20599999999999999},"max":{"1min":1.593,"5min":4.1879999999999997,"15min":4.9790000000000001},"last":0.58599999999999997}]},{"osd":2,"last update":"Thu Apr 2 23:46:25 2020","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.53600000000000003,"15min":0.50600000000000001},"min":{"1min":0.23799999999999999,"5min":0.23100000000000001,"15min":0.223},"max":{"1min":0.70999999999999996,"5min":4.4409999999999998,"15min":4.9509999999999996},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.47199999999999998,"15min":0.433},"min":{"1min":0.255,"5min":0.224,"15min":0.20999999999999999},"max":{"1min":1.262,"5min":4.1609999999999996,"15min":4.1609999999999996},"last":0.44400000000000001}]},{"osd":3,"last update":"Thu Apr 2 23:46:25 2020","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.69599999999999995,"15min":0.59499999999999997},"min":{"1min":0.27700000000000002,"5min":0.27000000000000002,"15min":0.22700000000000001},"max":{"1min":4.1840000000000002,"5min":5.1630000000000003,"15min":5.1630000000000003},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.51300000000000001,"15min":0.50700000000000001},"min":{"1min":0.27600000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.61599999999999999,"5min":4.4960000000000004,"15min":4.9240000000000004},"last":0.54800000000000004}]},{"osd":4,"last update":"Thu Apr 2 23:46:25 2020","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.46700000000000003,"15min":0.433},"min":{"1min":0.252,"5min":0.23200000000000001,"15min":0.20999999999999999},"max":{"1min":1.222,"5min":2.1419999999999999,"15min":4.8540000000000001},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.626,"15min":0.58799999999999997},"min":{"1min":0.32200000000000001,"5min":0.26900000000000002,"15min":0.23100000000000001},"max":{"1min":4.2779999999999996,"5min":5.1909999999999998,"15min":5.1909999999999998},"last":0.38900000000000001}]},{"osd":6,"last update":"Thu Apr 2 23:46:25 2020","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.70999999999999996,"15min":0.60099999999999998},"min":{"1min":0.27800000000000002,"5min":0.25900000000000001,"15min":0.22700000000000001},"max":{"1min":3.2320000000000002,"5min":5.6740000000000004,"15min":5.6740000000000004},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.54300000000000004,"15min":0.53900000000000003},"min":{"1min":0.28699999999999998,"5min":0.25,"15min":0.25},"max":{"1min":2.6760000000000002,"5min":2.6760000000000002,"15min":4.6769999999999996},"last":0.51200000000000001}]},{"osd":7,"last update":"Thu Apr 2 23:46:25 2020","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.73799999999999999,"15min":0.65500000000000003},"min":{"1min":0.34399999999999997,"5min":0.33700000000000002,"15min":0.28299999999999997},"max":{"1min":4.2220000000000004,"5min":5.2190000000000003,"15min":5.2190000000000003},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.59399999999999997,"15min":0.59699999999999998},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.26500000000000001},"max":{"1min":0.754,"5min":4.5330000000000004,"15min":4.8879999999999999},"last":0.625}]}]}]}} 2020-04-02T23:46:51.735 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:46:51.748 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-02T23:46:51.893 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.891+0000 7f2276762700 1 Processor -- start 2020-04-02T23:46:51.894 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.891+0000 7f2276762700 1 -- start start 2020-04-02T23:46:51.896 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.892+0000 7f2276762700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f22700a7a60 0x7f22700a4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:51.897 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.892+0000 7f2276762700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f227012f860 0x7f227012fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:51.897 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.892+0000 7f2276762700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22700a6aa0 con 0x7f22700a14f0 2020-04-02T23:46:51.897 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.892+0000 7f2276762700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22700a5e70 con 0x7f22700a7a60 2020-04-02T23:46:51.897 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.892+0000 7f2276762700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f227009ed60 con 0x7f227012f860 2020-04-02T23:46:51.897 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.892+0000 7f226ffff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f22700a7a60 0x7f22700a4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:51.897 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.892+0000 7f226ffff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f22700a7a60 0x7f22700a4e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:40416/0 (socket says 172.21.15.174:40416) 2020-04-02T23:46:51.897 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.892+0000 7f226ffff700 1 -- 172.21.15.174:0/643600458 learned_addr learned my addr 172.21.15.174:0/643600458 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:46:51.898 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.892+0000 7f2274cff700 1 --2- 172.21.15.174:0/643600458 >> v2:172.21.15.196:3300/0 conn(0x7f227012f860 0x7f227012fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:51.898 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.892+0000 7f226ffff700 1 -- 172.21.15.174:0/643600458 >> v2:172.21.15.196:3300/0 conn(0x7f227012f860 msgr2=0x7f227012fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:46:51.898 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.892+0000 7f226ffff700 1 --2- 172.21.15.174:0/643600458 >> v2:172.21.15.196:3300/0 conn(0x7f227012f860 0x7f227012fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:51.898 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.892+0000 7f226ffff700 1 -- 172.21.15.174:0/643600458 >> v1:172.21.15.196:6789/0 conn(0x7f22700a14f0 legacy=0x7f22700a3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:51.898 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.892+0000 7f226ffff700 1 -- 172.21.15.174:0/643600458 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22700a5430 con 0x7f22700a7a60 2020-04-02T23:46:51.898 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.892+0000 7f226ffff700 1 --2- 172.21.15.174:0/643600458 >> v2:172.21.15.174:3300/0 conn(0x7f22700a7a60 0x7f22700a4e00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2260002f30 tx=0x7f2260007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:51.898 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.892+0000 7f226ffff700 1 --2- 172.21.15.174:0/643600458 >> v2:172.21.15.174:3300/0 conn(0x7f22700a7a60 0x7f22700a4e00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2260002f30 tx=0x7f2260007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:51.899 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.892+0000 7f226ffff700 1 --2- 172.21.15.174:0/643600458 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22700a7a60 0x7f22700a4e00 secure :-1 s=READY pgs=200 cs=0 l=1 rx=0x7f2260002f30 tx=0x7f2260007a40).ready entity=mon.0 client_cookie=a2ba7c62f79151ba server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:51.899 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.893+0000 7f226ffff700 1 --2- 172.21.15.174:0/643600458 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22700a7a60 0x7f22700a4e00 secure :-1 s=THROTTLE_DONE pgs=200 cs=0 l=1 rx=0x7f2260002f30 tx=0x7f2260007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:51.899 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.893+0000 7f226effd700 1 -- 172.21.15.174:0/643600458 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2260011720 con 0x7f22700a7a60 2020-04-02T23:46:51.899 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.893+0000 7f226ffff700 1 --2- 172.21.15.174:0/643600458 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22700a7a60 0x7f22700a4e00 secure :-1 s=THROTTLE_DONE pgs=200 cs=0 l=1 rx=0x7f2260002f30 tx=0x7f2260007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:51.899 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.893+0000 7f226ffff700 1 --2- 172.21.15.174:0/643600458 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22700a7a60 0x7f22700a4e00 secure :-1 s=THROTTLE_DONE pgs=200 cs=0 l=1 rx=0x7f2260002f30 tx=0x7f2260007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:51.899 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.893+0000 7f226effd700 1 -- 172.21.15.174:0/643600458 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2260011880 con 0x7f22700a7a60 2020-04-02T23:46:51.899 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.893+0000 7f226effd700 1 -- 172.21.15.174:0/643600458 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2260011c60 con 0x7f22700a7a60 2020-04-02T23:46:51.900 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.893+0000 7f2276762700 1 -- 172.21.15.174:0/643600458 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22700a7a60 msgr2=0x7f22700a4e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:51.900 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.893+0000 7f2276762700 1 --2- 172.21.15.174:0/643600458 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22700a7a60 0x7f22700a4e00 secure :-1 s=READY pgs=200 cs=0 l=1 rx=0x7f2260002f30 tx=0x7f2260007a40).stop 2020-04-02T23:46:51.900 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.893+0000 7f2276762700 1 -- 172.21.15.174:0/643600458 shutdown_connections 2020-04-02T23:46:51.900 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.893+0000 7f2276762700 1 --2- 172.21.15.174:0/643600458 >> v2:172.21.15.196:3300/0 conn(0x7f227012f860 0x7f227012fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:51.900 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.893+0000 7f2276762700 1 --2- 172.21.15.174:0/643600458 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22700a7a60 0x7f22700a4e00 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:51.900 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.893+0000 7f2276762700 1 -- 172.21.15.174:0/643600458 >> 172.21.15.174:0/643600458 conn(0x7f22700aaf80 msgr2=0x7f22700a6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:46:51.901 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.893+0000 7f2276762700 1 -- 172.21.15.174:0/643600458 shutdown_connections 2020-04-02T23:46:51.901 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.893+0000 7f2276762700 1 -- 172.21.15.174:0/643600458 wait complete. 2020-04-02T23:46:51.901 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.894+0000 7f2276762700 1 Processor -- start 2020-04-02T23:46:51.901 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.894+0000 7f2276762700 1 -- start start 2020-04-02T23:46:51.904 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.895+0000 7f2276762700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f22700a7a60 0x7f227012d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:51.904 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.895+0000 7f2276762700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f227012f860 0x7f227012d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:51.905 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.895+0000 7f2276762700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22700a29b0 con 0x7f22700a14f0 2020-04-02T23:46:51.905 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.895+0000 7f2276762700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22700a2c50 con 0x7f22700a7a60 2020-04-02T23:46:51.905 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.895+0000 7f2276762700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22700a2ef0 con 0x7f227012f860 2020-04-02T23:46:51.905 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.895+0000 7f226ffff700 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f22700a14f0 0x7f22700a32e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.174:51554/0 (socket says 172.21.15.174:51554) 2020-04-02T23:46:51.905 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.895+0000 7f226ffff700 1 -- 172.21.15.174:0/1832848183 learned_addr learned my addr 172.21.15.174:0/1832848183 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:46:51.905 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.895+0000 7f226f7fe700 1 --2- 172.21.15.174:0/1832848183 >> v2:172.21.15.196:3300/0 conn(0x7f22700a7a60 0x7f227012d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:51.906 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.895+0000 7f2274cff700 1 --2- 172.21.15.174:0/1832848183 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f227012f860 0x7f227012d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:51.906 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.895+0000 7f226d7fa700 1 -- 172.21.15.174:0/1832848183 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3596005470 0 0) 0x7f22700a29b0 con 0x7f22700a14f0 2020-04-02T23:46:51.906 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.895+0000 7f226d7fa700 1 -- 172.21.15.174:0/1832848183 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2250002fe0 con 0x7f22700a14f0 2020-04-02T23:46:51.906 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.895+0000 7f226f7fe700 1 -- 172.21.15.174:0/1832848183 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f227012f860 msgr2=0x7f227012d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:51.906 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.895+0000 7f226f7fe700 1 --2- 172.21.15.174:0/1832848183 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f227012f860 0x7f227012d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:51.906 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.895+0000 7f226f7fe700 1 -- 172.21.15.174:0/1832848183 >> v1:172.21.15.196:6789/0 conn(0x7f22700a14f0 legacy=0x7f22700a32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:51.906 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.895+0000 7f226f7fe700 1 -- 172.21.15.174:0/1832848183 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f227012dd00 con 0x7f22700a7a60 2020-04-02T23:46:51.907 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.895+0000 7f2274cff700 1 --2- 172.21.15.174:0/1832848183 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f227012f860 0x7f227012d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:46:51.907 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.895+0000 7f226f7fe700 1 --2- 172.21.15.174:0/1832848183 >> v2:172.21.15.196:3300/0 conn(0x7f22700a7a60 0x7f227012d440 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f22700a6950 tx=0x7f22640108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:51.907 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.896+0000 7f226f7fe700 1 --2- 172.21.15.174:0/1832848183 >> v2:172.21.15.196:3300/0 conn(0x7f22700a7a60 0x7f227012d440 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f22700a6950 tx=0x7f22640108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:51.907 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.896+0000 7f226f7fe700 1 --2- 172.21.15.174:0/1832848183 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f22700a7a60 0x7f227012d440 secure :-1 s=READY pgs=150 cs=0 l=1 rx=0x7f22700a6950 tx=0x7f22640108e0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:51.907 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.896+0000 7f226f7fe700 1 --2- 172.21.15.174:0/1832848183 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f22700a7a60 0x7f227012d440 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7f22700a6950 tx=0x7f22640108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:51.907 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.896+0000 7f226d7fa700 1 -- 172.21.15.174:0/1832848183 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f226400cc00 con 0x7f22700a7a60 2020-04-02T23:46:51.907 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.896+0000 7f226f7fe700 1 --2- 172.21.15.174:0/1832848183 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f22700a7a60 0x7f227012d440 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7f22700a6950 tx=0x7f22640108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:51.907 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.896+0000 7f226f7fe700 1 --2- 172.21.15.174:0/1832848183 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f22700a7a60 0x7f227012d440 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7f22700a6950 tx=0x7f22640108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:51.908 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.896+0000 7f226d7fa700 1 -- 172.21.15.174:0/1832848183 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2264011e90 con 0x7f22700a7a60 2020-04-02T23:46:51.908 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.896+0000 7f226d7fa700 1 -- 172.21.15.174:0/1832848183 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2264010e20 con 0x7f22700a7a60 2020-04-02T23:46:51.908 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.896+0000 7f2276762700 1 -- 172.21.15.174:0/1832848183 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2270066d50 con 0x7f22700a7a60 2020-04-02T23:46:51.908 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.896+0000 7f2276762700 1 -- 172.21.15.174:0/1832848183 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2270135a50 con 0x7f22700a7a60 2020-04-02T23:46:51.908 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.896+0000 7f226f7fe700 1 --2- 172.21.15.174:0/1832848183 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f22700a7a60 0x7f227012d440 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7f22700a6950 tx=0x7f22640108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:51.908 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.897+0000 7f2276762700 1 -- 172.21.15.174:0/1832848183 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2270056c50 con 0x7f22700a7a60 2020-04-02T23:46:51.909 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.897+0000 7f226d7fa700 1 -- 172.21.15.174:0/1832848183 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f22640064e0 con 0x7f22700a7a60 2020-04-02T23:46:51.909 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.897+0000 7f226f7fe700 1 --2- 172.21.15.174:0/1832848183 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f22700a7a60 0x7f227012d440 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7f22700a6950 tx=0x7f22640108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:51.909 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.897+0000 7f226d7fa700 1 --2- 172.21.15.174:0/1832848183 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f225004d8c0 0x7f225004fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:51.909 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.897+0000 7f226d7fa700 1 -- 172.21.15.174:0/1832848183 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f22640608a0 con 0x7f22700a7a60 2020-04-02T23:46:51.909 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.897+0000 7f226ffff700 1 --2- 172.21.15.174:0/1832848183 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f225004d8c0 0x7f225004fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:51.909 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.897+0000 7f226ffff700 1 --2- 172.21.15.174:0/1832848183 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f225004d8c0 0x7f225004fd80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2270066c80 tx=0x7f2260007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:51.909 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.897+0000 7f226ffff700 1 --2- 172.21.15.174:0/1832848183 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f225004d8c0 0x7f225004fd80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2270066c80 tx=0x7f2260007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:51.910 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.897+0000 7f226ffff700 1 --2- 172.21.15.174:0/1832848183 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f225004d8c0 0x7f225004fd80 secure :-1 s=READY pgs=116 cs=0 l=1 rx=0x7f2270066c80 tx=0x7f2260007a40).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:51.910 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.901+0000 7f226f7fe700 1 --2- 172.21.15.174:0/1832848183 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f22700a7a60 0x7f227012d440 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7f22700a6950 tx=0x7f22640108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:51.910 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:51.901+0000 7f226d7fa700 1 -- 172.21.15.174:0/1832848183 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f226403c000 con 0x7f22700a7a60 2020-04-02T23:46:52.040 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:52.038+0000 7f2276762700 1 -- 172.21.15.174:0/1832848183 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f22700a3060 con 0x7f22700a7a60 2020-04-02T23:46:52.041 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:52.040+0000 7f226f7fe700 1 --2- 172.21.15.174:0/1832848183 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f22700a7a60 0x7f227012d440 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7f22700a6950 tx=0x7f22640108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:52.041 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:52.040+0000 7f226d7fa700 1 -- 172.21.15.174:0/1832848183 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16134 (secure 0 0 0) 0x7f226403f620 con 0x7f22700a7a60 2020-04-02T23:46:52.042 INFO:teuthology.orchestra.run.smithi174.stdout: 2020-04-02T23:46:52.042 INFO:teuthology.orchestra.run.smithi174.stdout:{"epoch":23,"fsid":"06504ece-4284-40ba-b298-58864abc4224","created":"2020-04-02T23:21:19.153932+0000","modified":"2020-04-02T23:21:41.535533+0000","last_up_change":"2020-04-02T23:21:29.337390+0000","last_in_change":"2020-04-02T23:21:29.337390+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-02T23:21:22.199702+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-02T23:21:35.314601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-04-02T23:21:38.762876+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-04-02T23:21:39.474986+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c9d748ee-c52f-4f21-b8c9-2a53a937be1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":24590},{"type":"v1","addr":"172.21.15.174:6801","nonce":24590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":24590},{"type":"v1","addr":"172.21.15.174:6803","nonce":24590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":24590},{"type":"v1","addr":"172.21.15.174:6807","nonce":24590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":24590},{"type":"v1","addr":"172.21.15.174:6805","nonce":24590}]},"public_addr":"172.21.15.174:6801/24590","cluster_addr":"172.21.15.174:6803/24590","heartbeat_back_addr":"172.21.15.174:6807/24590","heartbeat_front_addr":"172.21.15.174:6805/24590","state":["exists","up"]},{"osd":1,"uuid":"27c05faf-11f5-4cef-9bde-1a6653a9e533","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":24754},{"type":"v1","addr":"172.21.15.174:6809","nonce":24754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":24754},{"type":"v1","addr":"172.21.15.174:6811","nonce":24754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":24754},{"type":"v1","addr":"172.21.15.174:6815","nonce":24754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":24754},{"type":"v1","addr":"172.21.15.174:6813","nonce":24754}]},"public_addr":"172.21.15.174:6809/24754","cluster_addr":"172.21.15.174:6811/24754","heartbeat_back_addr":"172.21.15.174:6815/24754","heartbeat_front_addr":"172.21.15.174:6813/24754","state":["exists","up"]},{"osd":2,"uuid":"02b1b455-b518-4393-b257-40c3a76af157","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":24781},{"type":"v1","addr":"172.21.15.174:6817","nonce":24781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":24781},{"type":"v1","addr":"172.21.15.174:6819","nonce":24781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":24781},{"type":"v1","addr":"172.21.15.174:6823","nonce":24781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":24781},{"type":"v1","addr":"172.21.15.174:6821","nonce":24781}]},"public_addr":"172.21.15.174:6817/24781","cluster_addr":"172.21.15.174:6819/24781","heartbeat_back_addr":"172.21.15.174:6823/24781","heartbeat_front_addr":"172.21.15.174:6821/24781","state":["exists","up"]},{"osd":3,"uuid":"d7fb3499-9e13-4076-b3cf-28f27eb62967","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":24972},{"type":"v1","addr":"172.21.15.174:6825","nonce":24972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":24972},{"type":"v1","addr":"172.21.15.174:6827","nonce":24972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":24972},{"type":"v1","addr":"172.21.15.174:6831","nonce":24972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":24972},{"type":"v1","addr":"172.21.15.174:6829","nonce":24972}]},"public_addr":"172.21.15.174:6825/24972","cluster_addr":"172.21.15.174:6827/24972","heartbeat_back_addr":"172.21.15.174:6831/24972","heartbeat_front_addr":"172.21.15.174:6829/24972","state":["exists","up"]},{"osd":4,"uuid":"16923c47-2f21-43ea-9647-5ead4b1b2101","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":24034},{"type":"v1","addr":"172.21.15.196:6803","nonce":24034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":24034},{"type":"v1","addr":"172.21.15.196:6805","nonce":24034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":24034},{"type":"v1","addr":"172.21.15.196:6809","nonce":24034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":24034},{"type":"v1","addr":"172.21.15.196:6807","nonce":24034}]},"public_addr":"172.21.15.196:6803/24034","cluster_addr":"172.21.15.196:6805/24034","heartbeat_back_addr":"172.21.15.196:6809/24034","heartbeat_front_addr":"172.21.15.196:6807/24034","state":["exists","up"]},{"osd":5,"uuid":"7cf2859b-2226-4908-8d70-6e699d1acb0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":24190},{"type":"v1","addr":"172.21.15.196:6811","nonce":24190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":24190},{"type":"v1","addr":"172.21.15.196:6813","nonce":24190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":24190},{"type":"v1","addr":"172.21.15.196:6817","nonce":24190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":24190},{"type":"v1","addr":"172.21.15.196:6815","nonce":24190}]},"public_addr":"172.21.15.196:6811/24190","cluster_addr":"172.21.15.196:6813/24190","heartbeat_back_addr":"172.21.15.196:6817/24190","heartbeat_front_addr":"172.21.15.196:6815/24190","state":["exists","up"]},{"osd":6,"uuid":"441081ef-133a-41ec-8041-094e129707e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":24212},{"type":"v1","addr":"172.21.15.196:6819","nonce":24212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":24212},{"type":"v1","addr":"172.21.15.196:6821","nonce":24212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":24212},{"type":"v1","addr":"172.21.15.196:6825","nonce":24212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":24212},{"type":"v1","addr":"172.21.15.196:6823","nonce":24212}]},"public_addr":"172.21.15.196:6819/24212","cluster_addr":"172.21.15.196:6821/24212","heartbeat_back_addr":"172.21.15.196:6825/24212","heartbeat_front_addr":"172.21.15.196:6823/24212","state":["exists","up"]},{"osd":7,"uuid":"17ee8d46-46bf-4ef0-8d02-82cbc4ef5a5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":24408},{"type":"v1","addr":"172.21.15.196:6827","nonce":24408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":24408},{"type":"v1","addr":"172.21.15.196:6829","nonce":24408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":24408},{"type":"v1","addr":"172.21.15.196:6833","nonce":24408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":24408},{"type":"v1","addr":"172.21.15.196:6831","nonce":24408}]},"public_addr":"172.21.15.196:6827/24408","cluster_addr":"172.21.15.196:6829/24408","heartbeat_back_addr":"172.21.15.196:6833/24408","heartbeat_front_addr":"172.21.15.196:6831/24408","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.725574+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.732598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.775890+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.854998+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.545334+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.591623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.627501+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:21:27.614807+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-02T23:46:52.043 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:52.041+0000 7f2276762700 1 -- 172.21.15.174:0/1832848183 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f225004d8c0 msgr2=0x7f225004fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:52.043 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:52.041+0000 7f2276762700 1 --2- 172.21.15.174:0/1832848183 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f225004d8c0 0x7f225004fd80 secure :-1 s=READY pgs=116 cs=0 l=1 rx=0x7f2270066c80 tx=0x7f2260007a40).stop 2020-04-02T23:46:52.044 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:52.041+0000 7f2276762700 1 -- 172.21.15.174:0/1832848183 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f22700a7a60 msgr2=0x7f227012d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:52.044 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:52.041+0000 7f2276762700 1 --2- 172.21.15.174:0/1832848183 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f22700a7a60 0x7f227012d440 secure :-1 s=READY pgs=150 cs=0 l=1 rx=0x7f22700a6950 tx=0x7f22640108e0).stop 2020-04-02T23:46:52.044 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:52.041+0000 7f2276762700 1 -- 172.21.15.174:0/1832848183 shutdown_connections 2020-04-02T23:46:52.044 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:52.041+0000 7f2276762700 1 --2- 172.21.15.174:0/1832848183 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f225004d8c0 0x7f225004fd80 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:52.044 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:52.041+0000 7f2276762700 1 --2- 172.21.15.174:0/1832848183 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f227012f860 0x7f227012d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:52.044 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:52.041+0000 7f2276762700 1 --2- 172.21.15.174:0/1832848183 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f22700a7a60 0x7f227012d440 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:52.044 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:52.041+0000 7f2276762700 1 -- 172.21.15.174:0/1832848183 >> 172.21.15.174:0/1832848183 conn(0x7f22700aaf80 msgr2=0x7f227009d310 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:46:52.045 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:52.041+0000 7f2276762700 1 -- 172.21.15.174:0/1832848183 shutdown_connections 2020-04-02T23:46:52.045 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:52.041+0000 7f2276762700 1 -- 172.21.15.174:0/1832848183 wait complete. 2020-04-02T23:46:53.054 INFO:tasks.ceph:Scrubbing osd.4 2020-04-02T23:46:53.055 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:46:53.071 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.4 config set osd_debug_deep_scrub_sleep 0 2020-04-02T23:46:53.231 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.229+0000 7fb1470a9700 1 Processor -- start 2020-04-02T23:46:53.231 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.229+0000 7fb1470a9700 1 -- start start 2020-04-02T23:46:53.233 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.229+0000 7fb1470a9700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1400a4330 0x7fb1400a22b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:53.234 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.229+0000 7fb1470a9700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1400a3ae0 con 0x7fb1400a7a60 2020-04-02T23:46:53.234 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.229+0000 7fb1470a9700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1400a3d80 con 0x7fb140138bb0 2020-04-02T23:46:53.234 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.229+0000 7fb1470a9700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1400a4020 con 0x7fb1400a4330 2020-04-02T23:46:53.234 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.229+0000 7fb13ffff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1400a4330 0x7fb1400a22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:53.234 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.229+0000 7fb144e45700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fb1400a7a60 0x7fb1401384a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:45468/0 (socket says 172.21.15.174:45468) 2020-04-02T23:46:53.234 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.229+0000 7fb144e45700 1 -- 172.21.15.174:0/646439335 learned_addr learned my addr 172.21.15.174:0/646439335 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:46:53.235 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.230+0000 7fb13ffff700 1 -- 172.21.15.174:0/646439335 >> v1:172.21.15.196:6789/0 conn(0x7fb140138bb0 legacy=0x7fb140134dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:46:53.235 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.230+0000 7fb13ffff700 1 -- 172.21.15.174:0/646439335 >> v1:172.21.15.174:6789/0 conn(0x7fb1400a7a60 legacy=0x7fb1401384a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:53.235 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.230+0000 7fb13ffff700 1 -- 172.21.15.174:0/646439335 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1400a1a60 con 0x7fb1400a4330 2020-04-02T23:46:53.235 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.230+0000 7fb13f7fe700 1 -- 172.21.15.174:0/646439335 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 356895905 0 0) 0x7fb1400a3ae0 con 0x7fb1400a7a60 2020-04-02T23:46:53.235 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.230+0000 7fb13ffff700 1 --2- 172.21.15.174:0/646439335 >> v2:172.21.15.174:3300/0 conn(0x7fb1400a4330 0x7fb1400a22b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb140069f10 tx=0x7fb134007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:53.235 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.230+0000 7fb13ffff700 1 --2- 172.21.15.174:0/646439335 >> v2:172.21.15.174:3300/0 conn(0x7fb1400a4330 0x7fb1400a22b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb140069f10 tx=0x7fb134007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:53.235 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.230+0000 7fb13ffff700 1 --2- 172.21.15.174:0/646439335 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb1400a4330 0x7fb1400a22b0 secure :-1 s=READY pgs=202 cs=0 l=1 rx=0x7fb140069f10 tx=0x7fb134007a40).ready entity=mon.0 client_cookie=7ad0c754d65be3cb server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:53.235 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.230+0000 7fb13ffff700 1 --2- 172.21.15.174:0/646439335 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb1400a4330 0x7fb1400a22b0 secure :-1 s=THROTTLE_DONE pgs=202 cs=0 l=1 rx=0x7fb140069f10 tx=0x7fb134007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:53.236 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.230+0000 7fb13f7fe700 1 -- 172.21.15.174:0/646439335 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb134011430 con 0x7fb1400a4330 2020-04-02T23:46:53.236 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.230+0000 7fb13ffff700 1 --2- 172.21.15.174:0/646439335 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb1400a4330 0x7fb1400a22b0 secure :-1 s=THROTTLE_DONE pgs=202 cs=0 l=1 rx=0x7fb140069f10 tx=0x7fb134007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:53.236 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.230+0000 7fb13f7fe700 1 -- 172.21.15.174:0/646439335 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb134011590 con 0x7fb1400a4330 2020-04-02T23:46:53.236 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.230+0000 7fb13ffff700 1 --2- 172.21.15.174:0/646439335 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb1400a4330 0x7fb1400a22b0 secure :-1 s=THROTTLE_DONE pgs=202 cs=0 l=1 rx=0x7fb140069f10 tx=0x7fb134007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:53.236 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.230+0000 7fb13f7fe700 1 -- 172.21.15.174:0/646439335 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb134011970 con 0x7fb1400a4330 2020-04-02T23:46:53.236 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.230+0000 7fb1470a9700 1 -- 172.21.15.174:0/646439335 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb1400a4330 msgr2=0x7fb1400a22b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:53.236 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.230+0000 7fb1470a9700 1 --2- 172.21.15.174:0/646439335 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb1400a4330 0x7fb1400a22b0 secure :-1 s=READY pgs=202 cs=0 l=1 rx=0x7fb140069f10 tx=0x7fb134007a40).stop 2020-04-02T23:46:53.236 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.231+0000 7fb1470a9700 1 -- 172.21.15.174:0/646439335 shutdown_connections 2020-04-02T23:46:53.237 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.231+0000 7fb1470a9700 1 --2- 172.21.15.174:0/646439335 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb1400a4330 0x7fb1400a22b0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:53.237 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.231+0000 7fb1470a9700 1 -- 172.21.15.174:0/646439335 >> 172.21.15.174:0/646439335 conn(0x7fb1400aaf80 msgr2=0x7fb1400a6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:46:53.237 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.231+0000 7fb1470a9700 1 -- 172.21.15.174:0/646439335 shutdown_connections 2020-04-02T23:46:53.237 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.231+0000 7fb1470a9700 1 -- 172.21.15.174:0/646439335 wait complete. 2020-04-02T23:46:53.237 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.231+0000 7fb1470a9700 1 Processor -- start 2020-04-02T23:46:53.237 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.232+0000 7fb1470a9700 1 -- start start 2020-04-02T23:46:53.241 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.232+0000 7fb1470a9700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1400a7a60 0x7fb140132da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:53.241 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.232+0000 7fb1470a9700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb140135f30 con 0x7fb1400a4330 2020-04-02T23:46:53.241 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.232+0000 7fb1470a9700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb140135bc0 con 0x7fb140138bb0 2020-04-02T23:46:53.241 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.232+0000 7fb1470a9700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb140060890 con 0x7fb1400a7a60 2020-04-02T23:46:53.241 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.232+0000 7fb144e45700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fb1400a4330 0x7fb140130c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:45474/0 (socket says 172.21.15.174:45474) 2020-04-02T23:46:53.242 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.232+0000 7fb144e45700 1 -- 172.21.15.174:0/719057892 learned_addr learned my addr 172.21.15.174:0/719057892 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:46:53.242 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.232+0000 7fb13ffff700 1 --2- 172.21.15.174:0/719057892 >> v2:172.21.15.174:3300/0 conn(0x7fb1400a7a60 0x7fb140132da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:53.242 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.233+0000 7fb13ffff700 1 -- 172.21.15.174:0/719057892 >> v1:172.21.15.196:6789/0 conn(0x7fb140138bb0 legacy=0x7fb14011b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:53.242 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.233+0000 7fb13ffff700 1 -- 172.21.15.174:0/719057892 >> v1:172.21.15.174:6789/0 conn(0x7fb1400a4330 legacy=0x7fb140130c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:53.242 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.233+0000 7fb13dffb700 1 -- 172.21.15.174:0/719057892 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1141265233 0 0) 0x7fb140135f30 con 0x7fb1400a4330 2020-04-02T23:46:53.242 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.233+0000 7fb13ffff700 1 -- 172.21.15.174:0/719057892 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1401332b0 con 0x7fb1400a7a60 2020-04-02T23:46:53.242 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.233+0000 7fb13ffff700 1 --2- 172.21.15.174:0/719057892 >> v2:172.21.15.174:3300/0 conn(0x7fb1400a7a60 0x7fb140132da0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb1401304e0 tx=0x7fb134007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:53.243 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.233+0000 7fb13ffff700 1 --2- 172.21.15.174:0/719057892 >> v2:172.21.15.174:3300/0 conn(0x7fb1400a7a60 0x7fb140132da0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb1401304e0 tx=0x7fb134007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:53.243 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.233+0000 7fb13ffff700 1 --2- 172.21.15.174:0/719057892 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb1400a7a60 0x7fb140132da0 secure :-1 s=READY pgs=204 cs=0 l=1 rx=0x7fb1401304e0 tx=0x7fb134007a40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:53.243 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.233+0000 7fb13ffff700 1 --2- 172.21.15.174:0/719057892 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb1400a7a60 0x7fb140132da0 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7fb1401304e0 tx=0x7fb134007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:53.243 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.233+0000 7fb13dffb700 1 -- 172.21.15.174:0/719057892 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb134011ea0 con 0x7fb1400a7a60 2020-04-02T23:46:53.243 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.233+0000 7fb13ffff700 1 --2- 172.21.15.174:0/719057892 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb1400a7a60 0x7fb140132da0 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7fb1401304e0 tx=0x7fb134007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:53.243 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.233+0000 7fb13ffff700 1 --2- 172.21.15.174:0/719057892 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb1400a7a60 0x7fb140132da0 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7fb1401304e0 tx=0x7fb134007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:53.243 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.233+0000 7fb13dffb700 1 -- 172.21.15.174:0/719057892 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb134007340 con 0x7fb1400a7a60 2020-04-02T23:46:53.244 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.233+0000 7fb1470a9700 1 -- 172.21.15.174:0/719057892 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1401307e0 con 0x7fb1400a7a60 2020-04-02T23:46:53.244 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.233+0000 7fb13dffb700 1 -- 172.21.15.174:0/719057892 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb1340056c0 con 0x7fb1400a7a60 2020-04-02T23:46:53.244 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.233+0000 7fb1470a9700 1 -- 172.21.15.174:0/719057892 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb140131390 con 0x7fb1400a7a60 2020-04-02T23:46:53.244 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.234+0000 7fb13ffff700 1 --2- 172.21.15.174:0/719057892 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb1400a7a60 0x7fb140132da0 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7fb1401304e0 tx=0x7fb134007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:53.244 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.234+0000 7fb1470a9700 1 -- 172.21.15.174:0/719057892 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb140132590 con 0x7fb1400a7a60 2020-04-02T23:46:53.244 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.234+0000 7fb13dffb700 1 -- 172.21.15.174:0/719057892 <== mon.0 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fb1340058f0 con 0x7fb1400a7a60 2020-04-02T23:46:53.244 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.234+0000 7fb13ffff700 1 --2- 172.21.15.174:0/719057892 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb1400a7a60 0x7fb140132da0 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7fb1401304e0 tx=0x7fb134007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:53.245 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.234+0000 7fb13ffff700 1 --2- 172.21.15.174:0/719057892 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb1400a7a60 0x7fb140132da0 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7fb1401304e0 tx=0x7fb134007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:53.246 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.234+0000 7fb13dffb700 1 --2- 172.21.15.174:0/719057892 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fb12004d390 0x7fb12004f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:53.246 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.234+0000 7fb13dffb700 1 -- 172.21.15.174:0/719057892 <== mon.0 v2:172.21.15.174:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb1340617c0 con 0x7fb1400a7a60 2020-04-02T23:46:53.246 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.234+0000 7fb13dffb700 1 --2- 172.21.15.174:0/719057892 >> [v2:172.21.15.196:6802/24034,v1:172.21.15.196:6803/24034] conn(0x7fb120053f70 0x7fb120056390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:53.246 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.234+0000 7fb13dffb700 1 -- 172.21.15.174:0/719057892 --> [v2:172.21.15.196:6802/24034,v1:172.21.15.196:6803/24034] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb120056950 con 0x7fb120053f70 2020-04-02T23:46:53.248 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.234+0000 7fb13dffb700 1 -- 172.21.15.174:0/719057892 <== mon.0 v2:172.21.15.174:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb134062c80 con 0x7fb1400a7a60 2020-04-02T23:46:53.248 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.234+0000 7fb144e45700 1 --2- 172.21.15.174:0/719057892 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fb12004d390 0x7fb12004f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:53.248 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.235+0000 7fb145646700 1 --2- 172.21.15.174:0/719057892 >> [v2:172.21.15.196:6802/24034,v1:172.21.15.196:6803/24034] conn(0x7fb120053f70 0x7fb120056390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:53.248 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.235+0000 7fb144e45700 1 --2- 172.21.15.174:0/719057892 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fb12004d390 0x7fb12004f850 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb130005500 tx=0x7fb130001700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:53.248 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.235+0000 7fb144e45700 1 --2- 172.21.15.174:0/719057892 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fb12004d390 0x7fb12004f850 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb130005500 tx=0x7fb130001700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:53.249 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.235+0000 7fb144e45700 1 --2- 172.21.15.174:0/719057892 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fb12004d390 0x7fb12004f850 secure :-1 s=READY pgs=117 cs=0 l=1 rx=0x7fb130005500 tx=0x7fb130001700).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:53.249 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.235+0000 7fb145646700 1 --2- 172.21.15.174:0/719057892 >> [v2:172.21.15.196:6802/24034,v1:172.21.15.196:6803/24034] conn(0x7fb120053f70 0x7fb120056390 crc :-1 s=READY pgs=10 cs=0 l=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:53.249 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.236+0000 7fb13dffb700 1 -- 172.21.15.174:0/719057892 <== osd.4 v2:172.21.15.196:6802/24034 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21407 (crc 0 0 0) 0x7fb120056950 con 0x7fb120053f70 2020-04-02T23:46:53.252 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.250+0000 7fb1470a9700 1 -- 172.21.15.174:0/719057892 --> [v2:172.21.15.196:6802/24034,v1:172.21.15.196:6803/24034] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb1401309e0 con 0x7fb120053f70 2020-04-02T23:46:53.254 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.251+0000 7fb13dffb700 1 -- 172.21.15.174:0/719057892 <== osd.4 v2:172.21.15.196:6802/24034 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fb1380085c0 con 0x7fb120053f70 2020-04-02T23:46:53.254 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.251+0000 7fb1470a9700 1 -- 172.21.15.174:0/719057892 >> [v2:172.21.15.196:6802/24034,v1:172.21.15.196:6803/24034] conn(0x7fb120053f70 msgr2=0x7fb120056390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:53.254 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.251+0000 7fb1470a9700 1 --2- 172.21.15.174:0/719057892 >> [v2:172.21.15.196:6802/24034,v1:172.21.15.196:6803/24034] conn(0x7fb120053f70 0x7fb120056390 crc :-1 s=READY pgs=10 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:53.254 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.251+0000 7fb1470a9700 1 -- 172.21.15.174:0/719057892 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fb12004d390 msgr2=0x7fb12004f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:53.254 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.251+0000 7fb1470a9700 1 --2- 172.21.15.174:0/719057892 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fb12004d390 0x7fb12004f850 secure :-1 s=READY pgs=117 cs=0 l=1 rx=0x7fb130005500 tx=0x7fb130001700).stop 2020-04-02T23:46:53.254 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.251+0000 7fb1470a9700 1 -- 172.21.15.174:0/719057892 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb1400a7a60 msgr2=0x7fb140132da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:53.255 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.251+0000 7fb1470a9700 1 --2- 172.21.15.174:0/719057892 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb1400a7a60 0x7fb140132da0 secure :-1 s=READY pgs=204 cs=0 l=1 rx=0x7fb1401304e0 tx=0x7fb134007a40).stop 2020-04-02T23:46:53.255 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.251+0000 7fb145646700 1 -- 172.21.15.174:0/719057892 reap_dead start 2020-04-02T23:46:53.255 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.251+0000 7fb1470a9700 1 -- 172.21.15.174:0/719057892 shutdown_connections 2020-04-02T23:46:53.255 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.251+0000 7fb1470a9700 1 --2- 172.21.15.174:0/719057892 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb1400a7a60 0x7fb140132da0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:53.255 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.251+0000 7fb1470a9700 1 -- 172.21.15.174:0/719057892 >> 172.21.15.174:0/719057892 conn(0x7fb1400aaf80 msgr2=0x7fb14009d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:46:53.255 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.251+0000 7fb1470a9700 1 -- 172.21.15.174:0/719057892 shutdown_connections 2020-04-02T23:46:53.255 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.251+0000 7fb1470a9700 1 -- 172.21.15.174:0/719057892 wait complete. 2020-04-02T23:46:53.256 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2020-04-02T23:46:53.256 INFO:teuthology.orchestra.run.smithi174.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-04-02T23:46:53.256 INFO:teuthology.orchestra.run.smithi174.stdout:} 2020-04-02T23:46:53.263 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:46:53.277 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd deep-scrub 4 2020-04-02T23:46:53.422 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.420+0000 7f1f81c2b700 1 Processor -- start 2020-04-02T23:46:53.423 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.420+0000 7f1f81c2b700 1 -- start start 2020-04-02T23:46:53.430 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.421+0000 7f1f81c2b700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f7c0a7a60 0x7f1f7c134c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:53.430 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.421+0000 7f1f81c2b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f7c0a3760 con 0x7f1f7c1350f0 2020-04-02T23:46:53.430 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.421+0000 7f1f81c2b700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f7c135550 con 0x7f1f7c0a42a0 2020-04-02T23:46:53.430 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.421+0000 7f1f81c2b700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f7c1357a0 con 0x7f1f7c0a7a60 2020-04-02T23:46:53.430 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.421+0000 7f1f7affd700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f1f7c1350f0 0x7f1f7c0a3b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:45484/0 (socket says 172.21.15.174:45484) 2020-04-02T23:46:53.431 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.421+0000 7f1f7affd700 1 -- 172.21.15.174:0/375310385 learned_addr learned my addr 172.21.15.174:0/375310385 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:46:53.431 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.421+0000 7f1f7a7fc700 1 -- 172.21.15.174:0/375310385 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 699882138 0 0) 0x7f1f7c0a3760 con 0x7f1f7c1350f0 2020-04-02T23:46:53.431 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.421+0000 7f1f7b7fe700 1 --2- 172.21.15.174:0/375310385 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f7c0a7a60 0x7f1f7c134c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:53.431 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.421+0000 7f1f7a7fc700 1 -- 172.21.15.174:0/375310385 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f68003230 con 0x7f1f7c1350f0 2020-04-02T23:46:53.431 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.422+0000 7f1f7a7fc700 1 -- 172.21.15.174:0/375310385 <== mon.0 v1:172.21.15.174:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3469787356 0 0) 0x7f1f68003230 con 0x7f1f7c1350f0 2020-04-02T23:46:53.431 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.422+0000 7f1f7a7fc700 1 -- 172.21.15.174:0/375310385 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f7c0a7a60 msgr2=0x7f1f7c134c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:46:53.433 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.422+0000 7f1f7a7fc700 1 --2- 172.21.15.174:0/375310385 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f7c0a7a60 0x7f1f7c134c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:53.433 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.422+0000 7f1f7a7fc700 1 -- 172.21.15.174:0/375310385 >> v1:172.21.15.196:6789/0 conn(0x7f1f7c0a42a0 legacy=0x7f1f7c12ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:53.433 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.422+0000 7f1f7a7fc700 1 -- 172.21.15.174:0/375310385 --> v1:172.21.15.174:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f7c135a40 con 0x7f1f7c1350f0 2020-04-02T23:46:53.433 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.422+0000 7f1f7a7fc700 1 -- 172.21.15.174:0/375310385 <== mon.0 v1:172.21.15.174:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2811762909 0 0) 0x7f1f700016d0 con 0x7f1f7c1350f0 2020-04-02T23:46:53.434 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.422+0000 7f1f7a7fc700 1 -- 172.21.15.174:0/375310385 >> v1:172.21.15.174:6789/0 conn(0x7f1f7c1350f0 legacy=0x7f1f7c0a3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:53.434 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.422+0000 7f1f7a7fc700 1 --2- 172.21.15.174:0/375310385 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f7c0a7a60 0x7f1f68003750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:53.434 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.422+0000 7f1f7a7fc700 1 --2- 172.21.15.174:0/375310385 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f68003bb0 0x7f1f68004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:53.434 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.422+0000 7f1f7a7fc700 1 --2- 172.21.15.174:0/375310385 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1f680045e0 0x7f1f68004a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:53.434 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.422+0000 7f1f7a7fc700 1 -- 172.21.15.174:0/375310385 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f7c1357a0 con 0x7f1f68003bb0 2020-04-02T23:46:53.434 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.422+0000 7f1f7a7fc700 1 -- 172.21.15.174:0/375310385 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f68005010 con 0x7f1f680045e0 2020-04-02T23:46:53.434 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.422+0000 7f1f7a7fc700 1 -- 172.21.15.174:0/375310385 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f680051d0 con 0x7f1f7c0a7a60 2020-04-02T23:46:53.435 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.422+0000 7f1f7affd700 1 --2- 172.21.15.174:0/375310385 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f68003bb0 0x7f1f68004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:53.435 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.422+0000 7f1f7b7fe700 1 --2- 172.21.15.174:0/375310385 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f7c0a7a60 0x7f1f68003750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:53.435 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.422+0000 7f1f7bfff700 1 --2- 172.21.15.174:0/375310385 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1f680045e0 0x7f1f68004a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:53.435 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.422+0000 7f1f7affd700 1 -- 172.21.15.174:0/375310385 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f7c0a7a60 msgr2=0x7f1f68003750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:46:53.435 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.422+0000 7f1f7affd700 1 --2- 172.21.15.174:0/375310385 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f7c0a7a60 0x7f1f68003750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:53.435 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.422+0000 7f1f7affd700 1 -- 172.21.15.174:0/375310385 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1f680045e0 msgr2=0x7f1f68004a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:46:53.435 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.422+0000 7f1f7affd700 1 --2- 172.21.15.174:0/375310385 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1f680045e0 0x7f1f68004a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:53.435 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.422+0000 7f1f7affd700 1 -- 172.21.15.174:0/375310385 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f68003230 con 0x7f1f68003bb0 2020-04-02T23:46:53.436 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.422+0000 7f1f7bfff700 1 --2- 172.21.15.174:0/375310385 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1f680045e0 0x7f1f68004a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-02T23:46:53.436 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.422+0000 7f1f7affd700 1 --2- 172.21.15.174:0/375310385 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f68003bb0 0x7f1f68004010 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1f700013e0 tx=0x7f1f7c0a7e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:53.436 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.422+0000 7f1f7affd700 1 --2- 172.21.15.174:0/375310385 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f68003bb0 0x7f1f68004010 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1f700013e0 tx=0x7f1f7c0a7e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:53.436 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.422+0000 7f1f7affd700 1 --2- 172.21.15.174:0/375310385 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f68003bb0 0x7f1f68004010 secure :-1 s=READY pgs=206 cs=0 l=1 rx=0x7f1f700013e0 tx=0x7f1f7c0a7e40).ready entity=mon.0 client_cookie=814d682ffcb54cf server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:53.436 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.422+0000 7f1f7affd700 1 --2- 172.21.15.174:0/375310385 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f68003bb0 0x7f1f68004010 secure :-1 s=THROTTLE_DONE pgs=206 cs=0 l=1 rx=0x7f1f700013e0 tx=0x7f1f7c0a7e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:53.436 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.422+0000 7f1f7affd700 1 --2- 172.21.15.174:0/375310385 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f68003bb0 0x7f1f68004010 secure :-1 s=THROTTLE_DONE pgs=206 cs=0 l=1 rx=0x7f1f700013e0 tx=0x7f1f7c0a7e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:53.436 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.422+0000 7f1f7a7fc700 1 -- 172.21.15.174:0/375310385 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f7000e160 con 0x7f1f68003bb0 2020-04-02T23:46:53.437 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.422+0000 7f1f7affd700 1 --2- 172.21.15.174:0/375310385 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f68003bb0 0x7f1f68004010 secure :-1 s=THROTTLE_DONE pgs=206 cs=0 l=1 rx=0x7f1f700013e0 tx=0x7f1f7c0a7e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:53.437 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.422+0000 7f1f7a7fc700 1 -- 172.21.15.174:0/375310385 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f7000e2c0 con 0x7f1f68003bb0 2020-04-02T23:46:53.437 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.422+0000 7f1f7a7fc700 1 -- 172.21.15.174:0/375310385 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f7000e6a0 con 0x7f1f68003bb0 2020-04-02T23:46:53.437 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.422+0000 7f1f81c2b700 1 -- 172.21.15.174:0/375310385 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f68003bb0 msgr2=0x7f1f68004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:53.437 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.422+0000 7f1f81c2b700 1 --2- 172.21.15.174:0/375310385 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f68003bb0 0x7f1f68004010 secure :-1 s=READY pgs=206 cs=0 l=1 rx=0x7f1f700013e0 tx=0x7f1f7c0a7e40).stop 2020-04-02T23:46:53.437 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.422+0000 7f1f7bfff700 1 -- 172.21.15.174:0/375310385 reap_dead start 2020-04-02T23:46:53.437 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.423+0000 7f1f81c2b700 1 -- 172.21.15.174:0/375310385 shutdown_connections 2020-04-02T23:46:53.438 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.423+0000 7f1f81c2b700 1 -- 172.21.15.174:0/375310385 >> 172.21.15.174:0/375310385 conn(0x7f1f7c0aaf80 msgr2=0x7f1f7c0a6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:46:53.438 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.423+0000 7f1f81c2b700 1 -- 172.21.15.174:0/375310385 shutdown_connections 2020-04-02T23:46:53.438 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.423+0000 7f1f81c2b700 1 -- 172.21.15.174:0/375310385 wait complete. 2020-04-02T23:46:53.438 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.424+0000 7f1f81c2b700 1 Processor -- start 2020-04-02T23:46:53.438 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.424+0000 7f1f81c2b700 1 -- start start 2020-04-02T23:46:53.438 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.425+0000 7f1f81c2b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1f7c1345e0 0x7f1f7c130e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:53.438 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.425+0000 7f1f81c2b700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f7c147aa0 0x7f1f7c0a0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:53.439 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.425+0000 7f1f81c2b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f7c09e1d0 con 0x7f1f7c09e4d0 2020-04-02T23:46:53.439 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.425+0000 7f1f81c2b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f7c09fd40 con 0x7f1f7c1345e0 2020-04-02T23:46:53.439 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.425+0000 7f1f81c2b700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f7c09e950 con 0x7f1f7c147aa0 2020-04-02T23:46:53.439 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.425+0000 7f1f7b7fe700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1f7c1345e0 0x7f1f7c130e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:53.439 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.425+0000 7f1f7b7fe700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1f7c1345e0 0x7f1f7c130e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:40458/0 (socket says 172.21.15.174:40458) 2020-04-02T23:46:53.439 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.425+0000 7f1f7affd700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f1f7c09e4d0 0x7f1f7c147390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:45498/0 (socket says 172.21.15.174:45498) 2020-04-02T23:46:53.439 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.425+0000 7f1f7b7fe700 1 -- 172.21.15.174:0/2563327759 learned_addr learned my addr 172.21.15.174:0/2563327759 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:46:53.440 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.425+0000 7f1f7b7fe700 1 -- 172.21.15.174:0/2563327759 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f7c147aa0 msgr2=0x7f1f7c0a0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:53.440 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.425+0000 7f1f7bfff700 1 --2- 172.21.15.174:0/2563327759 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f7c147aa0 0x7f1f7c0a0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:53.440 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.425+0000 7f1f7b7fe700 1 --2- 172.21.15.174:0/2563327759 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f7c147aa0 0x7f1f7c0a0130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:53.440 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.425+0000 7f1f78ff9700 1 -- 172.21.15.174:0/2563327759 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 347456884 0 0) 0x7f1f7c09e1d0 con 0x7f1f7c09e4d0 2020-04-02T23:46:53.440 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.425+0000 7f1f7b7fe700 1 -- 172.21.15.174:0/2563327759 >> v1:172.21.15.174:6789/0 conn(0x7f1f7c09e4d0 legacy=0x7f1f7c147390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:53.440 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.425+0000 7f1f7b7fe700 1 -- 172.21.15.174:0/2563327759 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f7c0a0590 con 0x7f1f7c1345e0 2020-04-02T23:46:53.440 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.425+0000 7f1f7b7fe700 1 --2- 172.21.15.174:0/2563327759 >> v2:172.21.15.174:3300/0 conn(0x7f1f7c1345e0 0x7f1f7c130e00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1f7c09ea90 tx=0x7f1f6c0111e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:53.441 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.425+0000 7f1f7b7fe700 1 --2- 172.21.15.174:0/2563327759 >> v2:172.21.15.174:3300/0 conn(0x7f1f7c1345e0 0x7f1f7c130e00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1f7c09ea90 tx=0x7f1f6c0111e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:53.441 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.425+0000 7f1f7b7fe700 1 --2- 172.21.15.174:0/2563327759 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f7c1345e0 0x7f1f7c130e00 secure :-1 s=READY pgs=208 cs=0 l=1 rx=0x7f1f7c09ea90 tx=0x7f1f6c0111e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:53.441 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.425+0000 7f1f7b7fe700 1 --2- 172.21.15.174:0/2563327759 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f7c1345e0 0x7f1f7c130e00 secure :-1 s=THROTTLE_DONE pgs=208 cs=0 l=1 rx=0x7f1f7c09ea90 tx=0x7f1f6c0111e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:53.441 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.425+0000 7f1f7b7fe700 1 --2- 172.21.15.174:0/2563327759 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f7c1345e0 0x7f1f7c130e00 secure :-1 s=THROTTLE_DONE pgs=208 cs=0 l=1 rx=0x7f1f7c09ea90 tx=0x7f1f6c0111e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:53.441 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.425+0000 7f1f78ff9700 1 -- 172.21.15.174:0/2563327759 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f6c005e30 con 0x7f1f7c1345e0 2020-04-02T23:46:53.441 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.425+0000 7f1f7b7fe700 1 --2- 172.21.15.174:0/2563327759 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f7c1345e0 0x7f1f7c130e00 secure :-1 s=THROTTLE_DONE pgs=208 cs=0 l=1 rx=0x7f1f7c09ea90 tx=0x7f1f6c0111e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:53.441 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.425+0000 7f1f78ff9700 1 -- 172.21.15.174:0/2563327759 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f6c00cb40 con 0x7f1f7c1345e0 2020-04-02T23:46:53.442 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.425+0000 7f1f81c2b700 1 -- 172.21.15.174:0/2563327759 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f7c0a0a40 con 0x7f1f7c1345e0 2020-04-02T23:46:53.442 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.425+0000 7f1f78ff9700 1 -- 172.21.15.174:0/2563327759 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f6c012740 con 0x7f1f7c1345e0 2020-04-02T23:46:53.442 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.425+0000 7f1f81c2b700 1 -- 172.21.15.174:0/2563327759 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f7c0a0780 con 0x7f1f7c1345e0 2020-04-02T23:46:53.442 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.426+0000 7f1f7b7fe700 1 --2- 172.21.15.174:0/2563327759 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f7c1345e0 0x7f1f7c130e00 secure :-1 s=THROTTLE_DONE pgs=208 cs=0 l=1 rx=0x7f1f7c09ea90 tx=0x7f1f6c0111e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:53.442 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.426+0000 7f1f81c2b700 1 -- 172.21.15.174:0/2563327759 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f7c0a0ea0 con 0x7f1f7c1345e0 2020-04-02T23:46:53.442 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.426+0000 7f1f78ff9700 1 -- 172.21.15.174:0/2563327759 <== mon.0 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f1f6c00e180 con 0x7f1f7c1345e0 2020-04-02T23:46:53.442 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.426+0000 7f1f7b7fe700 1 --2- 172.21.15.174:0/2563327759 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f7c1345e0 0x7f1f7c130e00 secure :-1 s=THROTTLE_DONE pgs=208 cs=0 l=1 rx=0x7f1f7c09ea90 tx=0x7f1f6c0111e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:53.443 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.427+0000 7f1f78ff9700 1 --2- 172.21.15.174:0/2563327759 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f1f5c04d470 0x7f1f5c04f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:53.443 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.427+0000 7f1f78ff9700 1 -- 172.21.15.174:0/2563327759 <== mon.0 v2:172.21.15.174:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1f6c061030 con 0x7f1f7c1345e0 2020-04-02T23:46:53.443 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.427+0000 7f1f7affd700 1 --2- 172.21.15.174:0/2563327759 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f1f5c04d470 0x7f1f5c04f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:53.443 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.427+0000 7f1f7affd700 1 --2- 172.21.15.174:0/2563327759 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f1f5c04d470 0x7f1f5c04f930 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1f70004520 tx=0x7f1f7c0a7e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:53.443 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.427+0000 7f1f7affd700 1 --2- 172.21.15.174:0/2563327759 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f1f5c04d470 0x7f1f5c04f930 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1f70004520 tx=0x7f1f7c0a7e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:53.443 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.427+0000 7f1f7affd700 1 --2- 172.21.15.174:0/2563327759 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f1f5c04d470 0x7f1f5c04f930 secure :-1 s=READY pgs=118 cs=0 l=1 rx=0x7f1f70004520 tx=0x7f1f7c0a7e40).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:53.444 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.430+0000 7f1f7b7fe700 1 --2- 172.21.15.174:0/2563327759 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f7c1345e0 0x7f1f7c130e00 secure :-1 s=THROTTLE_DONE pgs=208 cs=0 l=1 rx=0x7f1f7c09ea90 tx=0x7f1f6c0111e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:53.444 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.430+0000 7f1f78ff9700 1 -- 172.21.15.174:0/2563327759 <== mon.0 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f1f6c03c7f0 con 0x7f1f7c1345e0 2020-04-02T23:46:53.571 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.569+0000 7f1f81c2b700 1 -- 172.21.15.174:0/2563327759 --> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f1f7c056c50 con 0x7f1f5c04d470 2020-04-02T23:46:53.571 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.569+0000 7f1f7affd700 1 --2- 172.21.15.174:0/2563327759 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f1f5c04d470 0x7f1f5c04f930 secure :-1 s=THROTTLE_DONE pgs=118 cs=0 l=1 rx=0x7f1f70004520 tx=0x7f1f7c0a7e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:53.572 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.569+0000 7f1f78ff9700 1 -- 172.21.15.174:0/2563327759 <== mgr.4102 v2:172.21.15.196:6800/23210 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1f7c056c50 con 0x7f1f5c04d470 2020-04-02T23:46:53.573 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.571+0000 7f1f81c2b700 1 -- 172.21.15.174:0/2563327759 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f1f5c04d470 msgr2=0x7f1f5c04f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:53.573 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.571+0000 7f1f81c2b700 1 --2- 172.21.15.174:0/2563327759 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f1f5c04d470 0x7f1f5c04f930 secure :-1 s=READY pgs=118 cs=0 l=1 rx=0x7f1f70004520 tx=0x7f1f7c0a7e40).stop 2020-04-02T23:46:53.574 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.571+0000 7f1f81c2b700 1 -- 172.21.15.174:0/2563327759 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f7c1345e0 msgr2=0x7f1f7c130e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:53.574 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.571+0000 7f1f81c2b700 1 --2- 172.21.15.174:0/2563327759 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f7c1345e0 0x7f1f7c130e00 secure :-1 s=READY pgs=208 cs=0 l=1 rx=0x7f1f7c09ea90 tx=0x7f1f6c0111e0).stop 2020-04-02T23:46:53.574 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.571+0000 7f1f81c2b700 1 -- 172.21.15.174:0/2563327759 shutdown_connections 2020-04-02T23:46:53.574 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.571+0000 7f1f81c2b700 1 --2- 172.21.15.174:0/2563327759 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f1f5c04d470 0x7f1f5c04f930 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:53.574 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.571+0000 7f1f81c2b700 1 --2- 172.21.15.174:0/2563327759 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f7c147aa0 0x7f1f7c0a0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:53.574 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.571+0000 7f1f81c2b700 1 --2- 172.21.15.174:0/2563327759 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f7c1345e0 0x7f1f7c130e00 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:53.575 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.571+0000 7f1f81c2b700 1 -- 172.21.15.174:0/2563327759 >> 172.21.15.174:0/2563327759 conn(0x7f1f7c0aaf80 msgr2=0x7f1f7c0695c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:46:53.575 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.571+0000 7f1f81c2b700 1 -- 172.21.15.174:0/2563327759 shutdown_connections 2020-04-02T23:46:53.575 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.571+0000 7f1f81c2b700 1 -- 172.21.15.174:0/2563327759 wait complete. 2020-04-02T23:46:53.575 INFO:teuthology.orchestra.run.smithi174.stderr:instructed osd(s) 4 to deep-scrub 2020-04-02T23:46:53.583 INFO:tasks.ceph:Scrubbing osd.5 2020-04-02T23:46:53.583 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:46:53.596 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.5 config set osd_debug_deep_scrub_sleep 0 2020-04-02T23:46:53.746 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.744+0000 7f7f918c8700 1 Processor -- start 2020-04-02T23:46:53.747 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.744+0000 7f7f918c8700 1 -- start start 2020-04-02T23:46:53.754 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.745+0000 7f7f918c8700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7f8c05bf90 0x7f7f8c09e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:53.754 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.745+0000 7f7f918c8700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7f8c09ec70 0x7f7f8c138aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:53.755 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.745+0000 7f7f918c8700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f8c0a2a70 con 0x7f7f8c138f00 2020-04-02T23:46:53.755 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.745+0000 7f7f918c8700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f8c09e140 con 0x7f7f8c05bf90 2020-04-02T23:46:53.755 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.745+0000 7f7f918c8700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8c09e3e0 con 0x7f7f8c09ec70 2020-04-02T23:46:53.755 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.745+0000 7f7f908c6700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7f8c05bf90 0x7f7f8c09e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:53.755 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.745+0000 7f7f910c7700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f7f8c138f00 0x7f7f8c139390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:45506/0 (socket says 172.21.15.174:45506) 2020-04-02T23:46:53.755 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.745+0000 7f7f910c7700 1 -- 172.21.15.174:0/950816390 learned_addr learned my addr 172.21.15.174:0/950816390 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:46:53.756 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.745+0000 7f7f908c6700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7f8c05bf90 0x7f7f8c09e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:40466/0 (socket says 172.21.15.174:40466) 2020-04-02T23:46:53.756 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.745+0000 7f7f8bfff700 1 --2- 172.21.15.174:0/950816390 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7f8c09ec70 0x7f7f8c138aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:53.756 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.745+0000 7f7f908c6700 1 -- 172.21.15.174:0/950816390 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7f8c09ec70 msgr2=0x7f7f8c138aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:46:53.756 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.745+0000 7f7f908c6700 1 --2- 172.21.15.174:0/950816390 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7f8c09ec70 0x7f7f8c138aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:53.756 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.745+0000 7f7f908c6700 1 -- 172.21.15.174:0/950816390 >> v1:172.21.15.174:6789/0 conn(0x7f7f8c138f00 legacy=0x7f7f8c139390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:53.756 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.745+0000 7f7f8b7fe700 1 -- 172.21.15.174:0/950816390 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4216601500 0 0) 0x7f7f8c0a2a70 con 0x7f7f8c138f00 2020-04-02T23:46:53.756 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.745+0000 7f7f908c6700 1 -- 172.21.15.174:0/950816390 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f8c0a65b0 con 0x7f7f8c05bf90 2020-04-02T23:46:53.757 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.745+0000 7f7f908c6700 1 --2- 172.21.15.174:0/950816390 >> v2:172.21.15.174:3300/0 conn(0x7f7f8c05bf90 0x7f7f8c09e810 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7f7c002f30 tx=0x7f7f7c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:53.757 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.745+0000 7f7f908c6700 1 --2- 172.21.15.174:0/950816390 >> v2:172.21.15.174:3300/0 conn(0x7f7f8c05bf90 0x7f7f8c09e810 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7f7c002f30 tx=0x7f7f7c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:53.757 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.745+0000 7f7f908c6700 1 --2- 172.21.15.174:0/950816390 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f8c05bf90 0x7f7f8c09e810 secure :-1 s=READY pgs=210 cs=0 l=1 rx=0x7f7f7c002f30 tx=0x7f7f7c007a40).ready entity=mon.0 client_cookie=758df3499e8abdd server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:53.757 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.745+0000 7f7f908c6700 1 --2- 172.21.15.174:0/950816390 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f8c05bf90 0x7f7f8c09e810 secure :-1 s=THROTTLE_DONE pgs=210 cs=0 l=1 rx=0x7f7f7c002f30 tx=0x7f7f7c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:53.757 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.745+0000 7f7f8b7fe700 1 -- 172.21.15.174:0/950816390 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f7c00ae80 con 0x7f7f8c05bf90 2020-04-02T23:46:53.757 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.745+0000 7f7f908c6700 1 --2- 172.21.15.174:0/950816390 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f8c05bf90 0x7f7f8c09e810 secure :-1 s=THROTTLE_DONE pgs=210 cs=0 l=1 rx=0x7f7f7c002f30 tx=0x7f7f7c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:53.757 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.745+0000 7f7f908c6700 1 --2- 172.21.15.174:0/950816390 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f8c05bf90 0x7f7f8c09e810 secure :-1 s=THROTTLE_DONE pgs=210 cs=0 l=1 rx=0x7f7f7c002f30 tx=0x7f7f7c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:53.758 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.745+0000 7f7f8b7fe700 1 -- 172.21.15.174:0/950816390 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f7c013a60 con 0x7f7f8c05bf90 2020-04-02T23:46:53.758 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.745+0000 7f7f8b7fe700 1 -- 172.21.15.174:0/950816390 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f7c013e40 con 0x7f7f8c05bf90 2020-04-02T23:46:53.758 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.745+0000 7f7f918c8700 1 -- 172.21.15.174:0/950816390 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f8c05bf90 msgr2=0x7f7f8c09e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:53.758 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.745+0000 7f7f918c8700 1 --2- 172.21.15.174:0/950816390 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f8c05bf90 0x7f7f8c09e810 secure :-1 s=READY pgs=210 cs=0 l=1 rx=0x7f7f7c002f30 tx=0x7f7f7c007a40).stop 2020-04-02T23:46:53.758 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.746+0000 7f7f918c8700 1 -- 172.21.15.174:0/950816390 shutdown_connections 2020-04-02T23:46:53.758 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.746+0000 7f7f918c8700 1 --2- 172.21.15.174:0/950816390 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f8c05bf90 0x7f7f8c09e810 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:53.759 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.746+0000 7f7f918c8700 1 --2- 172.21.15.174:0/950816390 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7f8c09ec70 0x7f7f8c138aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:53.759 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.746+0000 7f7f918c8700 1 -- 172.21.15.174:0/950816390 >> 172.21.15.174:0/950816390 conn(0x7f7f8c0a6d00 msgr2=0x7f7f8c0a7110 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:46:53.759 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.746+0000 7f7f918c8700 1 -- 172.21.15.174:0/950816390 shutdown_connections 2020-04-02T23:46:53.759 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.746+0000 7f7f918c8700 1 -- 172.21.15.174:0/950816390 wait complete. 2020-04-02T23:46:53.759 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.747+0000 7f7f918c8700 1 Processor -- start 2020-04-02T23:46:53.759 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.747+0000 7f7f918c8700 1 -- start start 2020-04-02T23:46:53.759 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.748+0000 7f7f918c8700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f7f8c09ec70 0x7f7f8c131b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:53.760 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.748+0000 7f7f918c8700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7f8c138f00 0x7f7f8c09cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:53.760 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.748+0000 7f7f918c8700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f8c132080 con 0x7f7f8c05bf90 2020-04-02T23:46:53.760 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.748+0000 7f7f918c8700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f8c133390 con 0x7f7f8c09ec70 2020-04-02T23:46:53.760 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.748+0000 7f7f918c8700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8c137ee0 con 0x7f7f8c138f00 2020-04-02T23:46:53.760 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.748+0000 7f7f910c7700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7f8c138f00 0x7f7f8c09cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:53.760 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.748+0000 7f7f8bfff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f7f8c09ec70 0x7f7f8c131b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:53.760 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.748+0000 7f7f910c7700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7f8c138f00 0x7f7f8c09cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.174:35062/0 (socket says 172.21.15.174:35062) 2020-04-02T23:46:53.761 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.748+0000 7f7f910c7700 1 -- 172.21.15.174:0/4109898168 learned_addr learned my addr 172.21.15.174:0/4109898168 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:46:53.761 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.748+0000 7f7f910c7700 1 -- 172.21.15.174:0/4109898168 >> v2:172.21.15.196:3300/0 conn(0x7f7f8c09ec70 msgr2=0x7f7f8c131b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:53.761 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.748+0000 7f7f910c7700 1 --2- 172.21.15.174:0/4109898168 >> v2:172.21.15.196:3300/0 conn(0x7f7f8c09ec70 0x7f7f8c131b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:53.761 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.748+0000 7f7f910c7700 1 -- 172.21.15.174:0/4109898168 >> v1:172.21.15.196:6789/0 conn(0x7f7f8c05bf90 legacy=0x7f7f8c136430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:53.761 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.748+0000 7f7f910c7700 1 -- 172.21.15.174:0/4109898168 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f8c134710 con 0x7f7f8c138f00 2020-04-02T23:46:53.761 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.748+0000 7f7f8bfff700 1 --2- 172.21.15.174:0/4109898168 >> v2:172.21.15.196:3300/0 conn(0x7f7f8c09ec70 0x7f7f8c131b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:46:53.761 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.748+0000 7f7f910c7700 1 --2- 172.21.15.174:0/4109898168 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7f8c138f00 0x7f7f8c09cb80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7f84001210 tx=0x7f7f84010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:53.762 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.748+0000 7f7f910c7700 1 --2- 172.21.15.174:0/4109898168 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7f8c138f00 0x7f7f8c09cb80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7f84001210 tx=0x7f7f84010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:53.762 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.748+0000 7f7f910c7700 1 --2- 172.21.15.174:0/4109898168 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7f8c138f00 0x7f7f8c09cb80 secure :-1 s=READY pgs=41 cs=0 l=1 rx=0x7f7f84001210 tx=0x7f7f84010ca0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:53.762 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.749+0000 7f7f910c7700 1 --2- 172.21.15.174:0/4109898168 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7f8c138f00 0x7f7f8c09cb80 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7f7f84001210 tx=0x7f7f84010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:53.762 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.749+0000 7f7f89ffb700 1 -- 172.21.15.174:0/4109898168 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f84005e30 con 0x7f7f8c138f00 2020-04-02T23:46:53.762 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.749+0000 7f7f910c7700 1 --2- 172.21.15.174:0/4109898168 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7f8c138f00 0x7f7f8c09cb80 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7f7f84001210 tx=0x7f7f84010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:53.762 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.749+0000 7f7f918c8700 1 -- 172.21.15.174:0/4109898168 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f8c133580 con 0x7f7f8c138f00 2020-04-02T23:46:53.762 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.749+0000 7f7f89ffb700 1 -- 172.21.15.174:0/4109898168 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f84012530 con 0x7f7f8c138f00 2020-04-02T23:46:53.763 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.749+0000 7f7f910c7700 1 --2- 172.21.15.174:0/4109898168 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7f8c138f00 0x7f7f8c09cb80 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7f7f84001210 tx=0x7f7f84010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:53.763 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.749+0000 7f7f89ffb700 1 -- 172.21.15.174:0/4109898168 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f84012910 con 0x7f7f8c138f00 2020-04-02T23:46:53.763 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.749+0000 7f7f918c8700 1 -- 172.21.15.174:0/4109898168 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f8c136b40 con 0x7f7f8c138f00 2020-04-02T23:46:53.763 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.749+0000 7f7f918c8700 1 -- 172.21.15.174:0/4109898168 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7f8c133a20 con 0x7f7f8c138f00 2020-04-02T23:46:53.763 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.749+0000 7f7f910c7700 1 --2- 172.21.15.174:0/4109898168 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7f8c138f00 0x7f7f8c09cb80 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7f7f84001210 tx=0x7f7f84010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:53.763 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.750+0000 7f7f89ffb700 1 -- 172.21.15.174:0/4109898168 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f7f84012b90 con 0x7f7f8c138f00 2020-04-02T23:46:53.763 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.750+0000 7f7f910c7700 1 --2- 172.21.15.174:0/4109898168 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7f8c138f00 0x7f7f8c09cb80 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7f7f84001210 tx=0x7f7f84010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:53.763 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.750+0000 7f7f910c7700 1 --2- 172.21.15.174:0/4109898168 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7f8c138f00 0x7f7f8c09cb80 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7f7f84001210 tx=0x7f7f84010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:53.764 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.750+0000 7f7f89ffb700 1 --2- 172.21.15.174:0/4109898168 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f7f6c04d470 0x7f7f6c04f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:53.764 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.750+0000 7f7f89ffb700 1 -- 172.21.15.174:0/4109898168 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7f84061660 con 0x7f7f8c138f00 2020-04-02T23:46:53.764 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.750+0000 7f7f89ffb700 1 --2- 172.21.15.174:0/4109898168 >> [v2:172.21.15.196:6810/24190,v1:172.21.15.196:6811/24190] conn(0x7f7f6c054050 0x7f7f6c056470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:53.764 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.750+0000 7f7f89ffb700 1 -- 172.21.15.174:0/4109898168 --> [v2:172.21.15.196:6810/24190,v1:172.21.15.196:6811/24190] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7f6c056a30 con 0x7f7f6c054050 2020-04-02T23:46:53.764 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.750+0000 7f7f89ffb700 1 -- 172.21.15.174:0/4109898168 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7f84062b80 con 0x7f7f8c138f00 2020-04-02T23:46:53.764 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.750+0000 7f7f908c6700 1 --2- 172.21.15.174:0/4109898168 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f7f6c04d470 0x7f7f6c04f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:53.764 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.750+0000 7f7f8bfff700 1 --2- 172.21.15.174:0/4109898168 >> [v2:172.21.15.196:6810/24190,v1:172.21.15.196:6811/24190] conn(0x7f7f6c054050 0x7f7f6c056470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:53.765 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.750+0000 7f7f908c6700 1 --2- 172.21.15.174:0/4109898168 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f7f6c04d470 0x7f7f6c04f930 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7f8c09e990 tx=0x7f7f7c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:53.765 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.751+0000 7f7f908c6700 1 --2- 172.21.15.174:0/4109898168 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f7f6c04d470 0x7f7f6c04f930 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7f8c09e990 tx=0x7f7f7c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:53.765 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.751+0000 7f7f908c6700 1 --2- 172.21.15.174:0/4109898168 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f7f6c04d470 0x7f7f6c04f930 secure :-1 s=READY pgs=119 cs=0 l=1 rx=0x7f7f8c09e990 tx=0x7f7f7c007a40).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:53.765 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.751+0000 7f7f8bfff700 1 --2- 172.21.15.174:0/4109898168 >> [v2:172.21.15.196:6810/24190,v1:172.21.15.196:6811/24190] conn(0x7f7f6c054050 0x7f7f6c056470 crc :-1 s=READY pgs=10 cs=0 l=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:53.765 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.751+0000 7f7f89ffb700 1 -- 172.21.15.174:0/4109898168 <== osd.5 v2:172.21.15.196:6810/24190 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21407 (crc 0 0 0) 0x7f7f6c056a30 con 0x7f7f6c054050 2020-04-02T23:46:53.767 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.765+0000 7f7f918c8700 1 -- 172.21.15.174:0/4109898168 --> [v2:172.21.15.196:6810/24190,v1:172.21.15.196:6811/24190] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f7f8c133780 con 0x7f7f6c054050 2020-04-02T23:46:53.768 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.766+0000 7f7f89ffb700 1 -- 172.21.15.174:0/4109898168 <== osd.5 v2:172.21.15.196:6810/24190 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f7f8c133780 con 0x7f7f6c054050 2020-04-02T23:46:53.768 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2020-04-02T23:46:53.768 INFO:teuthology.orchestra.run.smithi174.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-04-02T23:46:53.769 INFO:teuthology.orchestra.run.smithi174.stdout:} 2020-04-02T23:46:53.770 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.766+0000 7f7f918c8700 1 -- 172.21.15.174:0/4109898168 >> [v2:172.21.15.196:6810/24190,v1:172.21.15.196:6811/24190] conn(0x7f7f6c054050 msgr2=0x7f7f6c056470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:53.770 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.767+0000 7f7f918c8700 1 --2- 172.21.15.174:0/4109898168 >> [v2:172.21.15.196:6810/24190,v1:172.21.15.196:6811/24190] conn(0x7f7f6c054050 0x7f7f6c056470 crc :-1 s=READY pgs=10 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:53.770 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.767+0000 7f7f918c8700 1 -- 172.21.15.174:0/4109898168 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f7f6c04d470 msgr2=0x7f7f6c04f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:53.770 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.767+0000 7f7f918c8700 1 --2- 172.21.15.174:0/4109898168 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f7f6c04d470 0x7f7f6c04f930 secure :-1 s=READY pgs=119 cs=0 l=1 rx=0x7f7f8c09e990 tx=0x7f7f7c007a40).stop 2020-04-02T23:46:53.770 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.767+0000 7f7f918c8700 1 -- 172.21.15.174:0/4109898168 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7f8c138f00 msgr2=0x7f7f8c09cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:53.770 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.767+0000 7f7f918c8700 1 --2- 172.21.15.174:0/4109898168 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7f8c138f00 0x7f7f8c09cb80 secure :-1 s=READY pgs=41 cs=0 l=1 rx=0x7f7f84001210 tx=0x7f7f84010ca0).stop 2020-04-02T23:46:53.771 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.767+0000 7f7f910c7700 1 -- 172.21.15.174:0/4109898168 reap_dead start 2020-04-02T23:46:53.771 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.767+0000 7f7f918c8700 1 -- 172.21.15.174:0/4109898168 shutdown_connections 2020-04-02T23:46:53.771 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.767+0000 7f7f918c8700 1 -- 172.21.15.174:0/4109898168 >> 172.21.15.174:0/4109898168 conn(0x7f7f8c0a6d00 msgr2=0x7f7f8c0695c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:46:53.771 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.767+0000 7f7f918c8700 1 -- 172.21.15.174:0/4109898168 shutdown_connections 2020-04-02T23:46:53.771 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.767+0000 7f7f918c8700 1 -- 172.21.15.174:0/4109898168 wait complete. 2020-04-02T23:46:53.779 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:46:53.792 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd deep-scrub 5 2020-04-02T23:46:53.938 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.935+0000 7fb0012f2700 1 Processor -- start 2020-04-02T23:46:53.938 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.935+0000 7fb0012f2700 1 -- start start 2020-04-02T23:46:53.944 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.936+0000 7fb0012f2700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7faffc0a1100 0x7faffc09f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:53.944 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.936+0000 7fb0012f2700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faffc13e510 0x7faffc140900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:53.944 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.936+0000 7fb0012f2700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faffc05ca20 con 0x7faffc0a4670 2020-04-02T23:46:53.945 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.936+0000 7fb0012f2700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faffc09eb80 con 0x7faffc0a1100 2020-04-02T23:46:53.945 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.936+0000 7fb0012f2700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faffc09ee20 con 0x7faffc13e510 2020-04-02T23:46:53.945 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.936+0000 7faffa7fc700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7faffc0a1100 0x7faffc09f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:53.945 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.936+0000 7faffaffd700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7faffc0a4670 0x7faffc066600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:45518/0 (socket says 172.21.15.174:45518) 2020-04-02T23:46:53.945 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.936+0000 7faffaffd700 1 -- 172.21.15.174:0/1328958780 learned_addr learned my addr 172.21.15.174:0/1328958780 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:46:53.945 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.937+0000 7faffb7fe700 1 --2- 172.21.15.174:0/1328958780 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faffc13e510 0x7faffc140900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:53.946 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.937+0000 7faffa7fc700 1 -- 172.21.15.174:0/1328958780 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faffc13e510 msgr2=0x7faffc140900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:46:53.946 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.937+0000 7faffa7fc700 1 --2- 172.21.15.174:0/1328958780 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faffc13e510 0x7faffc140900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:53.946 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.937+0000 7faffa7fc700 1 -- 172.21.15.174:0/1328958780 >> v1:172.21.15.174:6789/0 conn(0x7faffc0a4670 legacy=0x7faffc066600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:53.946 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.937+0000 7faffa7fc700 1 -- 172.21.15.174:0/1328958780 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faffc05ac00 con 0x7faffc0a1100 2020-04-02T23:46:53.946 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.937+0000 7faffb7fe700 1 --2- 172.21.15.174:0/1328958780 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faffc13e510 0x7faffc140900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-02T23:46:53.946 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.937+0000 7faffa7fc700 1 --2- 172.21.15.174:0/1328958780 >> v2:172.21.15.174:3300/0 conn(0x7faffc0a1100 0x7faffc09f590 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7faff00010d0 tx=0x7fafec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:53.946 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.937+0000 7faffa7fc700 1 --2- 172.21.15.174:0/1328958780 >> v2:172.21.15.174:3300/0 conn(0x7faffc0a1100 0x7faffc09f590 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7faff00010d0 tx=0x7fafec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:53.947 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.937+0000 7faffa7fc700 1 --2- 172.21.15.174:0/1328958780 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faffc0a1100 0x7faffc09f590 secure :-1 s=READY pgs=212 cs=0 l=1 rx=0x7faff00010d0 tx=0x7fafec007a40).ready entity=mon.0 client_cookie=d1d5768e6362986b server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:53.948 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.937+0000 7faffa7fc700 1 --2- 172.21.15.174:0/1328958780 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faffc0a1100 0x7faffc09f590 secure :-1 s=THROTTLE_DONE pgs=212 cs=0 l=1 rx=0x7faff00010d0 tx=0x7fafec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:53.948 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.937+0000 7faff9ffb700 1 -- 172.21.15.174:0/1328958780 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fafec008d30 con 0x7faffc0a1100 2020-04-02T23:46:53.949 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.937+0000 7faffa7fc700 1 --2- 172.21.15.174:0/1328958780 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faffc0a1100 0x7faffc09f590 secure :-1 s=THROTTLE_DONE pgs=212 cs=0 l=1 rx=0x7faff00010d0 tx=0x7fafec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:53.949 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.937+0000 7faffa7fc700 1 --2- 172.21.15.174:0/1328958780 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faffc0a1100 0x7faffc09f590 secure :-1 s=THROTTLE_DONE pgs=212 cs=0 l=1 rx=0x7faff00010d0 tx=0x7fafec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:53.949 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.937+0000 7faff9ffb700 1 -- 172.21.15.174:0/1328958780 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafec008e90 con 0x7faffc0a1100 2020-04-02T23:46:53.949 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.937+0000 7faff9ffb700 1 -- 172.21.15.174:0/1328958780 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fafec0118e0 con 0x7faffc0a1100 2020-04-02T23:46:53.949 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.937+0000 7fb0012f2700 1 -- 172.21.15.174:0/1328958780 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faffc0a1100 msgr2=0x7faffc09f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:53.949 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.937+0000 7fb0012f2700 1 --2- 172.21.15.174:0/1328958780 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faffc0a1100 0x7faffc09f590 secure :-1 s=READY pgs=212 cs=0 l=1 rx=0x7faff00010d0 tx=0x7fafec007a40).stop 2020-04-02T23:46:53.949 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.937+0000 7fb0012f2700 1 -- 172.21.15.174:0/1328958780 shutdown_connections 2020-04-02T23:46:53.950 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.937+0000 7fb0012f2700 1 --2- 172.21.15.174:0/1328958780 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faffc13e510 0x7faffc140900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:53.950 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.937+0000 7fb0012f2700 1 --2- 172.21.15.174:0/1328958780 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faffc0a1100 0x7faffc09f590 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:53.950 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.938+0000 7fb0012f2700 1 -- 172.21.15.174:0/1328958780 >> 172.21.15.174:0/1328958780 conn(0x7faffc0aaca0 msgr2=0x7faffc0ab0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:46:53.950 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.938+0000 7fb0012f2700 1 -- 172.21.15.174:0/1328958780 shutdown_connections 2020-04-02T23:46:53.950 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.938+0000 7fb0012f2700 1 -- 172.21.15.174:0/1328958780 wait complete. 2020-04-02T23:46:53.950 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.938+0000 7fb0012f2700 1 Processor -- start 2020-04-02T23:46:53.950 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.938+0000 7fb0012f2700 1 -- start start 2020-04-02T23:46:53.951 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.939+0000 7fb0012f2700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7faffc0a1100 0x7faffc061890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:53.951 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.939+0000 7fb0012f2700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7faffc0a4670 0x7faffc09b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:53.951 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.939+0000 7fb0012f2700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faffc09d240 con 0x7faffc13e510 2020-04-02T23:46:53.951 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.939+0000 7fb0012f2700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faffc09b240 con 0x7faffc0a1100 2020-04-02T23:46:53.951 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.939+0000 7fb0012f2700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faffc09cb00 con 0x7faffc0a4670 2020-04-02T23:46:53.952 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.939+0000 7faffaffd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7faffc0a1100 0x7faffc061890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:53.952 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.939+0000 7faffaffd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7faffc0a1100 0x7faffc061890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:40484/0 (socket says 172.21.15.174:40484) 2020-04-02T23:46:53.952 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.939+0000 7faffaffd700 1 -- 172.21.15.174:0/3510293181 learned_addr learned my addr 172.21.15.174:0/3510293181 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:46:53.952 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.939+0000 7faffa7fc700 1 --2- 172.21.15.174:0/3510293181 >> v2:172.21.15.196:3300/0 conn(0x7faffc0a4670 0x7faffc09b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:53.952 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.939+0000 7faffaffd700 1 -- 172.21.15.174:0/3510293181 >> v2:172.21.15.196:3300/0 conn(0x7faffc0a4670 msgr2=0x7faffc09b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:53.952 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.939+0000 7faffaffd700 1 --2- 172.21.15.174:0/3510293181 >> v2:172.21.15.196:3300/0 conn(0x7faffc0a4670 0x7faffc09b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:53.953 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.939+0000 7faffaffd700 1 -- 172.21.15.174:0/3510293181 >> v1:172.21.15.174:6789/0 conn(0x7faffc13e510 legacy=0x7faffc1370b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:53.953 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.939+0000 7fafebfff700 1 -- 172.21.15.174:0/3510293181 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1377916523 0 0) 0x7faffc09d240 con 0x7faffc13e510 2020-04-02T23:46:53.953 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.939+0000 7faffaffd700 1 -- 172.21.15.174:0/3510293181 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faffc09cda0 con 0x7faffc0a1100 2020-04-02T23:46:53.953 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.939+0000 7faffaffd700 1 --2- 172.21.15.174:0/3510293181 >> v2:172.21.15.174:3300/0 conn(0x7faffc0a1100 0x7faffc061890 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7faff0001190 tx=0x7faff000c5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:53.953 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.939+0000 7faffaffd700 1 --2- 172.21.15.174:0/3510293181 >> v2:172.21.15.174:3300/0 conn(0x7faffc0a1100 0x7faffc061890 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7faff0001190 tx=0x7faff000c5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:53.953 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.939+0000 7faffaffd700 1 --2- 172.21.15.174:0/3510293181 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faffc0a1100 0x7faffc061890 secure :-1 s=READY pgs=214 cs=0 l=1 rx=0x7faff0001190 tx=0x7faff000c5f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:53.953 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.940+0000 7faffaffd700 1 --2- 172.21.15.174:0/3510293181 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faffc0a1100 0x7faffc061890 secure :-1 s=THROTTLE_DONE pgs=214 cs=0 l=1 rx=0x7faff0001190 tx=0x7faff000c5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:53.953 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.940+0000 7fafebfff700 1 -- 172.21.15.174:0/3510293181 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faff000c950 con 0x7faffc0a1100 2020-04-02T23:46:53.954 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.940+0000 7faffaffd700 1 --2- 172.21.15.174:0/3510293181 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faffc0a1100 0x7faffc061890 secure :-1 s=THROTTLE_DONE pgs=214 cs=0 l=1 rx=0x7faff0001190 tx=0x7faff000c5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:53.954 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.940+0000 7faffaffd700 1 --2- 172.21.15.174:0/3510293181 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faffc0a1100 0x7faffc061890 secure :-1 s=THROTTLE_DONE pgs=214 cs=0 l=1 rx=0x7faff0001190 tx=0x7faff000c5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:53.954 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.940+0000 7fafebfff700 1 -- 172.21.15.174:0/3510293181 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faff000cab0 con 0x7faffc0a1100 2020-04-02T23:46:53.954 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.940+0000 7fb0012f2700 1 -- 172.21.15.174:0/3510293181 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faffc061cf0 con 0x7faffc0a1100 2020-04-02T23:46:53.954 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.940+0000 7fafebfff700 1 -- 172.21.15.174:0/3510293181 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faff000ce90 con 0x7faffc0a1100 2020-04-02T23:46:53.954 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.940+0000 7fb0012f2700 1 -- 172.21.15.174:0/3510293181 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faffc13e200 con 0x7faffc0a1100 2020-04-02T23:46:53.954 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.940+0000 7faffaffd700 1 --2- 172.21.15.174:0/3510293181 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faffc0a1100 0x7faffc061890 secure :-1 s=THROTTLE_DONE pgs=214 cs=0 l=1 rx=0x7faff0001190 tx=0x7faff000c5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:53.955 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.941+0000 7fb0012f2700 1 -- 172.21.15.174:0/3510293181 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faffc056c50 con 0x7faffc0a1100 2020-04-02T23:46:53.955 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.941+0000 7fafebfff700 1 -- 172.21.15.174:0/3510293181 <== mon.0 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7faff00055a0 con 0x7faffc0a1100 2020-04-02T23:46:53.955 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.941+0000 7faffaffd700 1 --2- 172.21.15.174:0/3510293181 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faffc0a1100 0x7faffc061890 secure :-1 s=THROTTLE_DONE pgs=214 cs=0 l=1 rx=0x7faff0001190 tx=0x7faff000c5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:53.955 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.941+0000 7fafebfff700 1 --2- 172.21.15.174:0/3510293181 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fafd804d420 0x7fafd804f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:53.955 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.941+0000 7fafebfff700 1 -- 172.21.15.174:0/3510293181 <== mon.0 v2:172.21.15.174:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7faff0060e60 con 0x7faffc0a1100 2020-04-02T23:46:53.955 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.941+0000 7faffa7fc700 1 --2- 172.21.15.174:0/3510293181 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fafd804d420 0x7fafd804f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:53.955 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.941+0000 7faffa7fc700 1 --2- 172.21.15.174:0/3510293181 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fafd804d420 0x7fafd804f8e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7faff00010d0 tx=0x7fafec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:53.956 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.941+0000 7faffa7fc700 1 --2- 172.21.15.174:0/3510293181 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fafd804d420 0x7fafd804f8e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7faff00010d0 tx=0x7fafec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:53.956 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.941+0000 7faffa7fc700 1 --2- 172.21.15.174:0/3510293181 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fafd804d420 0x7fafd804f8e0 secure :-1 s=READY pgs=120 cs=0 l=1 rx=0x7faff00010d0 tx=0x7fafec007a40).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:53.956 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.944+0000 7faffaffd700 1 --2- 172.21.15.174:0/3510293181 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faffc0a1100 0x7faffc061890 secure :-1 s=THROTTLE_DONE pgs=214 cs=0 l=1 rx=0x7faff0001190 tx=0x7faff000c5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:53.956 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:53.944+0000 7fafebfff700 1 -- 172.21.15.174:0/3510293181 <== mon.0 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7faff003c5c0 con 0x7faffc0a1100 2020-04-02T23:46:54.082 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.080+0000 7fb0012f2700 1 -- 172.21.15.174:0/3510293181 --> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7faffc05a690 con 0x7fafd804d420 2020-04-02T23:46:54.083 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.080+0000 7faffa7fc700 1 --2- 172.21.15.174:0/3510293181 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fafd804d420 0x7fafd804f8e0 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7faff00010d0 tx=0x7fafec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:54.083 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.081+0000 7fafebfff700 1 -- 172.21.15.174:0/3510293181 <== mgr.4102 v2:172.21.15.196:6800/23210 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7faffc05a690 con 0x7fafd804d420 2020-04-02T23:46:54.084 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.082+0000 7fb0012f2700 1 -- 172.21.15.174:0/3510293181 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fafd804d420 msgr2=0x7fafd804f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:54.084 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.082+0000 7fb0012f2700 1 --2- 172.21.15.174:0/3510293181 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fafd804d420 0x7fafd804f8e0 secure :-1 s=READY pgs=120 cs=0 l=1 rx=0x7faff00010d0 tx=0x7fafec007a40).stop 2020-04-02T23:46:54.085 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.082+0000 7fb0012f2700 1 -- 172.21.15.174:0/3510293181 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faffc0a1100 msgr2=0x7faffc061890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:54.085 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.082+0000 7fb0012f2700 1 --2- 172.21.15.174:0/3510293181 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faffc0a1100 0x7faffc061890 secure :-1 s=READY pgs=214 cs=0 l=1 rx=0x7faff0001190 tx=0x7faff000c5f0).stop 2020-04-02T23:46:54.085 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.082+0000 7fb0012f2700 1 -- 172.21.15.174:0/3510293181 shutdown_connections 2020-04-02T23:46:54.085 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.082+0000 7fb0012f2700 1 --2- 172.21.15.174:0/3510293181 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fafd804d420 0x7fafd804f8e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:54.085 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.082+0000 7fb0012f2700 1 --2- 172.21.15.174:0/3510293181 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faffc0a1100 0x7faffc061890 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:54.085 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.082+0000 7fb0012f2700 1 --2- 172.21.15.174:0/3510293181 >> v2:172.21.15.196:3300/0 conn(0x7faffc0a4670 0x7faffc09b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:54.085 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.082+0000 7fb0012f2700 1 -- 172.21.15.174:0/3510293181 >> 172.21.15.174:0/3510293181 conn(0x7faffc0aaca0 msgr2=0x7faffc0695c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:46:54.086 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.082+0000 7fb0012f2700 1 -- 172.21.15.174:0/3510293181 shutdown_connections 2020-04-02T23:46:54.086 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.082+0000 7fb0012f2700 1 -- 172.21.15.174:0/3510293181 wait complete. 2020-04-02T23:46:54.086 INFO:teuthology.orchestra.run.smithi174.stderr:instructed osd(s) 5 to deep-scrub 2020-04-02T23:46:54.094 INFO:tasks.ceph:Scrubbing osd.6 2020-04-02T23:46:54.095 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:46:54.108 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.6 config set osd_debug_deep_scrub_sleep 0 2020-04-02T23:46:54.257 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.254+0000 7f6aa4223700 1 Processor -- start 2020-04-02T23:46:54.257 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.255+0000 7f6aa4223700 1 -- start start 2020-04-02T23:46:54.263 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.255+0000 7f6aa4223700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6a9c066e50 0x7f6a9c0a62b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:54.264 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.255+0000 7f6aa4223700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f6a9c09d350 0x7f6a9c05f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:54.264 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.255+0000 7f6aa4223700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6a9c05fd50 0x7f6a9c13bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:54.264 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.255+0000 7f6aa4223700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a9c0a6d40 con 0x7f6a9c066e50 2020-04-02T23:46:54.264 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.255+0000 7f6aa4223700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a9c09dbe0 con 0x7f6a9c09d350 2020-04-02T23:46:54.264 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.255+0000 7f6aa4223700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9c09d940 con 0x7f6a9c05fd50 2020-04-02T23:46:54.264 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.255+0000 7f6aa1fbf700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6a9c066e50 0x7f6a9c0a62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:54.264 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.255+0000 7f6aa1fbf700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6a9c066e50 0x7f6a9c0a62b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:40492/0 (socket says 172.21.15.174:40492) 2020-04-02T23:46:54.265 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.255+0000 7f6aa1fbf700 1 -- 172.21.15.174:0/256855988 learned_addr learned my addr 172.21.15.174:0/256855988 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:46:54.265 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.256+0000 7f6aa27c0700 1 --2- 172.21.15.174:0/256855988 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6a9c05fd50 0x7f6a9c13bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:54.265 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.256+0000 7f6aa17be700 1 --2- 172.21.15.174:0/256855988 >> v2:172.21.15.196:3300/0 conn(0x7f6a9c09d350 0x7f6a9c05f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:54.265 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.256+0000 7f6aa1fbf700 1 -- 172.21.15.174:0/256855988 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6a9c05fd50 msgr2=0x7f6a9c13bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:46:54.265 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.256+0000 7f6aa1fbf700 1 --2- 172.21.15.174:0/256855988 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6a9c05fd50 0x7f6a9c13bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:54.265 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.256+0000 7f6aa1fbf700 1 -- 172.21.15.174:0/256855988 >> v2:172.21.15.196:3300/0 conn(0x7f6a9c09d350 msgr2=0x7f6a9c05f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:46:54.265 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.256+0000 7f6aa1fbf700 1 --2- 172.21.15.174:0/256855988 >> v2:172.21.15.196:3300/0 conn(0x7f6a9c09d350 0x7f6a9c05f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:54.266 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.256+0000 7f6aa1fbf700 1 -- 172.21.15.174:0/256855988 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a9c05f450 con 0x7f6a9c066e50 2020-04-02T23:46:54.266 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.256+0000 7f6aa1fbf700 1 --2- 172.21.15.174:0/256855988 >> v2:172.21.15.174:3300/0 conn(0x7f6a9c066e50 0x7f6a9c0a62b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6a8c002f30 tx=0x7f6a8c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:54.266 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.256+0000 7f6aa1fbf700 1 --2- 172.21.15.174:0/256855988 >> v2:172.21.15.174:3300/0 conn(0x7f6a9c066e50 0x7f6a9c0a62b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6a8c002f30 tx=0x7f6a8c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:54.266 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.256+0000 7f6aa1fbf700 1 --2- 172.21.15.174:0/256855988 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6a9c066e50 0x7f6a9c0a62b0 secure :-1 s=READY pgs=215 cs=0 l=1 rx=0x7f6a8c002f30 tx=0x7f6a8c007a40).ready entity=mon.0 client_cookie=dcbc758bbea41161 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:54.266 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.256+0000 7f6aa1fbf700 1 --2- 172.21.15.174:0/256855988 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6a9c066e50 0x7f6a9c0a62b0 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7f6a8c002f30 tx=0x7f6a8c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:54.266 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.256+0000 7f6aa0fbd700 1 -- 172.21.15.174:0/256855988 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a8c0115c0 con 0x7f6a9c066e50 2020-04-02T23:46:54.266 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.256+0000 7f6aa1fbf700 1 --2- 172.21.15.174:0/256855988 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6a9c066e50 0x7f6a9c0a62b0 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7f6a8c002f30 tx=0x7f6a8c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:54.267 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.256+0000 7f6aa1fbf700 1 --2- 172.21.15.174:0/256855988 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6a9c066e50 0x7f6a9c0a62b0 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7f6a8c002f30 tx=0x7f6a8c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:54.267 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.256+0000 7f6aa0fbd700 1 -- 172.21.15.174:0/256855988 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a8c011720 con 0x7f6a9c066e50 2020-04-02T23:46:54.267 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.256+0000 7f6aa0fbd700 1 -- 172.21.15.174:0/256855988 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a8c011b00 con 0x7f6a9c066e50 2020-04-02T23:46:54.267 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.256+0000 7f6aa4223700 1 -- 172.21.15.174:0/256855988 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6a9c066e50 msgr2=0x7f6a9c0a62b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:54.267 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.256+0000 7f6aa4223700 1 --2- 172.21.15.174:0/256855988 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6a9c066e50 0x7f6a9c0a62b0 secure :-1 s=READY pgs=215 cs=0 l=1 rx=0x7f6a8c002f30 tx=0x7f6a8c007a40).stop 2020-04-02T23:46:54.267 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.257+0000 7f6aa4223700 1 -- 172.21.15.174:0/256855988 shutdown_connections 2020-04-02T23:46:54.267 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.257+0000 7f6aa4223700 1 --2- 172.21.15.174:0/256855988 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6a9c05fd50 0x7f6a9c13bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:54.267 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.257+0000 7f6aa4223700 1 --2- 172.21.15.174:0/256855988 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6a9c066e50 0x7f6a9c0a62b0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:54.268 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.257+0000 7f6aa4223700 1 --2- 172.21.15.174:0/256855988 >> v2:172.21.15.196:3300/0 conn(0x7f6a9c09d350 0x7f6a9c05f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:54.268 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.257+0000 7f6aa4223700 1 -- 172.21.15.174:0/256855988 >> 172.21.15.174:0/256855988 conn(0x7f6a9c0a8050 msgr2=0x7f6a9c0a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:46:54.268 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.257+0000 7f6aa4223700 1 -- 172.21.15.174:0/256855988 shutdown_connections 2020-04-02T23:46:54.268 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.257+0000 7f6aa4223700 1 -- 172.21.15.174:0/256855988 wait complete. 2020-04-02T23:46:54.268 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.257+0000 7f6aa4223700 1 Processor -- start 2020-04-02T23:46:54.268 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.258+0000 7f6aa4223700 1 -- start start 2020-04-02T23:46:54.269 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.258+0000 7f6aa4223700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6a9c135240 0x7f6a9c0a40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:54.269 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.258+0000 7f6aa4223700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a9c0a3990 con 0x7f6a9c066e50 2020-04-02T23:46:54.269 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.258+0000 7f6aa4223700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a9c0a3c30 con 0x7f6a9c09d350 2020-04-02T23:46:54.269 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.258+0000 7f6aa4223700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9c0aa9a0 con 0x7f6a9c135240 2020-04-02T23:46:54.269 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.258+0000 7f6aa1fbf700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f6a9c066e50 0x7f6a9c134b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:45536/0 (socket says 172.21.15.174:45536) 2020-04-02T23:46:54.269 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.258+0000 7f6aa1fbf700 1 -- 172.21.15.174:0/4197151808 learned_addr learned my addr 172.21.15.174:0/4197151808 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:46:54.270 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.258+0000 7f6aa27c0700 1 --2- 172.21.15.174:0/4197151808 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6a9c135240 0x7f6a9c0a40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:54.270 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.258+0000 7f6a8affd700 1 -- 172.21.15.174:0/4197151808 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4091276225 0 0) 0x7f6a9c0a3990 con 0x7f6a9c066e50 2020-04-02T23:46:54.270 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.258+0000 7f6a8affd700 1 -- 172.21.15.174:0/4197151808 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a7c002fe0 con 0x7f6a9c066e50 2020-04-02T23:46:54.270 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.258+0000 7f6a8affd700 1 -- 172.21.15.174:0/4197151808 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3823671694 0 0) 0x7f6a9c0a3c30 con 0x7f6a9c09d350 2020-04-02T23:46:54.270 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.258+0000 7f6a8affd700 1 -- 172.21.15.174:0/4197151808 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a9c0a3990 con 0x7f6a9c09d350 2020-04-02T23:46:54.270 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.259+0000 7f6aa27c0700 1 -- 172.21.15.174:0/4197151808 >> v1:172.21.15.196:6789/0 conn(0x7f6a9c09d350 legacy=0x7f6a9c14dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:54.270 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.259+0000 7f6aa27c0700 1 -- 172.21.15.174:0/4197151808 >> v1:172.21.15.174:6789/0 conn(0x7f6a9c066e50 legacy=0x7f6a9c134b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:54.271 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.259+0000 7f6aa27c0700 1 -- 172.21.15.174:0/4197151808 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a9c0a57b0 con 0x7f6a9c135240 2020-04-02T23:46:54.271 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.259+0000 7f6aa27c0700 1 --2- 172.21.15.174:0/4197151808 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6a9c135240 0x7f6a9c0a40d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6a940032b0 tx=0x7f6a94010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:54.271 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.259+0000 7f6aa27c0700 1 --2- 172.21.15.174:0/4197151808 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6a9c135240 0x7f6a9c0a40d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6a940032b0 tx=0x7f6a94010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:54.271 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.259+0000 7f6aa27c0700 1 --2- 172.21.15.174:0/4197151808 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6a9c135240 0x7f6a9c0a40d0 secure :-1 s=READY pgs=42 cs=0 l=1 rx=0x7f6a940032b0 tx=0x7f6a94010ec0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:54.271 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.259+0000 7f6aa27c0700 1 --2- 172.21.15.174:0/4197151808 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6a9c135240 0x7f6a9c0a40d0 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7f6a940032b0 tx=0x7f6a94010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:54.271 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.259+0000 7f6a8affd700 1 -- 172.21.15.174:0/4197151808 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a9400e350 con 0x7f6a9c135240 2020-04-02T23:46:54.271 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.259+0000 7f6aa27c0700 1 --2- 172.21.15.174:0/4197151808 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6a9c135240 0x7f6a9c0a40d0 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7f6a940032b0 tx=0x7f6a94010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:54.272 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.259+0000 7f6aa4223700 1 -- 172.21.15.174:0/4197151808 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a9c0a2d20 con 0x7f6a9c135240 2020-04-02T23:46:54.272 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.259+0000 7f6a8affd700 1 -- 172.21.15.174:0/4197151808 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a94005c30 con 0x7f6a9c135240 2020-04-02T23:46:54.272 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.259+0000 7f6aa27c0700 1 --2- 172.21.15.174:0/4197151808 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6a9c135240 0x7f6a9c0a40d0 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7f6a940032b0 tx=0x7f6a94010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:54.272 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.259+0000 7f6a8affd700 1 -- 172.21.15.174:0/4197151808 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a94005da0 con 0x7f6a9c135240 2020-04-02T23:46:54.272 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.259+0000 7f6aa4223700 1 -- 172.21.15.174:0/4197151808 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a9c0a2fd0 con 0x7f6a9c135240 2020-04-02T23:46:54.272 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.260+0000 7f6aa27c0700 1 --2- 172.21.15.174:0/4197151808 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6a9c135240 0x7f6a9c0a40d0 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7f6a940032b0 tx=0x7f6a94010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:54.272 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.260+0000 7f6aa4223700 1 -- 172.21.15.174:0/4197151808 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6a9c0aaae0 con 0x7f6a9c135240 2020-04-02T23:46:54.273 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.260+0000 7f6a8affd700 1 -- 172.21.15.174:0/4197151808 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f6a9400caf0 con 0x7f6a9c135240 2020-04-02T23:46:54.273 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.260+0000 7f6aa27c0700 1 --2- 172.21.15.174:0/4197151808 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6a9c135240 0x7f6a9c0a40d0 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7f6a940032b0 tx=0x7f6a94010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:54.273 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.260+0000 7f6aa27c0700 1 --2- 172.21.15.174:0/4197151808 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6a9c135240 0x7f6a9c0a40d0 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7f6a940032b0 tx=0x7f6a94010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:54.273 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.260+0000 7f6a8affd700 1 --2- 172.21.15.174:0/4197151808 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f6a7c04d9d0 0x7f6a7c04fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:54.273 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.260+0000 7f6a8affd700 1 -- 172.21.15.174:0/4197151808 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f6a94060d20 con 0x7f6a9c135240 2020-04-02T23:46:54.273 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.260+0000 7f6a8affd700 1 --2- 172.21.15.174:0/4197151808 >> [v2:172.21.15.196:6818/24212,v1:172.21.15.196:6819/24212] conn(0x7f6a7c0544b0 0x7f6a7c0568d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:54.273 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.260+0000 7f6a8affd700 1 -- 172.21.15.174:0/4197151808 --> [v2:172.21.15.196:6818/24212,v1:172.21.15.196:6819/24212] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6a7c056e90 con 0x7f6a7c0544b0 2020-04-02T23:46:54.274 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.260+0000 7f6a8affd700 1 -- 172.21.15.174:0/4197151808 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6a940621c0 con 0x7f6a9c135240 2020-04-02T23:46:54.274 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.260+0000 7f6aa1fbf700 1 --2- 172.21.15.174:0/4197151808 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f6a7c04d9d0 0x7f6a7c04fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:54.274 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.261+0000 7f6aa17be700 1 --2- 172.21.15.174:0/4197151808 >> [v2:172.21.15.196:6818/24212,v1:172.21.15.196:6819/24212] conn(0x7f6a7c0544b0 0x7f6a7c0568d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:54.274 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.261+0000 7f6aa1fbf700 1 --2- 172.21.15.174:0/4197151808 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f6a7c04d9d0 0x7f6a7c04fe90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6a8c0084c0 tx=0x7f6a8c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:54.274 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.261+0000 7f6aa1fbf700 1 --2- 172.21.15.174:0/4197151808 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f6a7c04d9d0 0x7f6a7c04fe90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6a8c0084c0 tx=0x7f6a8c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:54.274 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.261+0000 7f6aa1fbf700 1 --2- 172.21.15.174:0/4197151808 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f6a7c04d9d0 0x7f6a7c04fe90 secure :-1 s=READY pgs=121 cs=0 l=1 rx=0x7f6a8c0084c0 tx=0x7f6a8c007a40).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:54.274 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.261+0000 7f6aa17be700 1 --2- 172.21.15.174:0/4197151808 >> [v2:172.21.15.196:6818/24212,v1:172.21.15.196:6819/24212] conn(0x7f6a7c0544b0 0x7f6a7c0568d0 crc :-1 s=READY pgs=11 cs=0 l=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:54.274 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.261+0000 7f6a8affd700 1 -- 172.21.15.174:0/4197151808 <== osd.6 v2:172.21.15.196:6818/24212 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21407 (crc 0 0 0) 0x7f6a7c056e90 con 0x7f6a7c0544b0 2020-04-02T23:46:54.277 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.276+0000 7f6aa4223700 1 -- 172.21.15.174:0/4197151808 --> [v2:172.21.15.196:6818/24212,v1:172.21.15.196:6819/24212] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6a9c056c50 con 0x7f6a7c0544b0 2020-04-02T23:46:54.278 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.276+0000 7f6a8affd700 1 -- 172.21.15.174:0/4197151808 <== osd.6 v2:172.21.15.196:6818/24212 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f6a9c056c50 con 0x7f6a7c0544b0 2020-04-02T23:46:54.278 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2020-04-02T23:46:54.279 INFO:teuthology.orchestra.run.smithi174.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-04-02T23:46:54.279 INFO:teuthology.orchestra.run.smithi174.stdout:} 2020-04-02T23:46:54.280 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.277+0000 7f6aa4223700 1 -- 172.21.15.174:0/4197151808 >> [v2:172.21.15.196:6818/24212,v1:172.21.15.196:6819/24212] conn(0x7f6a7c0544b0 msgr2=0x7f6a7c0568d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:54.280 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.277+0000 7f6aa4223700 1 --2- 172.21.15.174:0/4197151808 >> [v2:172.21.15.196:6818/24212,v1:172.21.15.196:6819/24212] conn(0x7f6a7c0544b0 0x7f6a7c0568d0 crc :-1 s=READY pgs=11 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:54.280 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.277+0000 7f6aa4223700 1 -- 172.21.15.174:0/4197151808 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f6a7c04d9d0 msgr2=0x7f6a7c04fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:54.280 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.277+0000 7f6aa4223700 1 --2- 172.21.15.174:0/4197151808 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f6a7c04d9d0 0x7f6a7c04fe90 secure :-1 s=READY pgs=121 cs=0 l=1 rx=0x7f6a8c0084c0 tx=0x7f6a8c007a40).stop 2020-04-02T23:46:54.281 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.277+0000 7f6aa4223700 1 -- 172.21.15.174:0/4197151808 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6a9c135240 msgr2=0x7f6a9c0a40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:54.281 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.277+0000 7f6aa4223700 1 --2- 172.21.15.174:0/4197151808 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6a9c135240 0x7f6a9c0a40d0 secure :-1 s=READY pgs=42 cs=0 l=1 rx=0x7f6a940032b0 tx=0x7f6a94010ec0).stop 2020-04-02T23:46:54.281 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.277+0000 7f6aa27c0700 1 -- 172.21.15.174:0/4197151808 reap_dead start 2020-04-02T23:46:54.281 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.277+0000 7f6aa4223700 1 -- 172.21.15.174:0/4197151808 shutdown_connections 2020-04-02T23:46:54.281 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.277+0000 7f6aa4223700 1 -- 172.21.15.174:0/4197151808 >> 172.21.15.174:0/4197151808 conn(0x7f6a9c0a8050 msgr2=0x7f6a9c0695c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:46:54.281 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.277+0000 7f6aa4223700 1 -- 172.21.15.174:0/4197151808 shutdown_connections 2020-04-02T23:46:54.281 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.277+0000 7f6aa4223700 1 -- 172.21.15.174:0/4197151808 wait complete. 2020-04-02T23:46:54.289 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:46:54.302 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd deep-scrub 6 2020-04-02T23:46:54.448 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.446+0000 7fddd985a700 1 Processor -- start 2020-04-02T23:46:54.448 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.446+0000 7fddd985a700 1 -- start start 2020-04-02T23:46:54.454 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.446+0000 7fddd985a700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fddd405f600 0x7fddd40601a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:54.455 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.446+0000 7fddd985a700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fddd4060600 0x7fddd405b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:54.455 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.446+0000 7fddd985a700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddd4132880 con 0x7fddd405b4f0 2020-04-02T23:46:54.455 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.446+0000 7fddd985a700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddd40a9460 con 0x7fddd4060600 2020-04-02T23:46:54.455 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.446+0000 7fddd985a700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddd40a9700 con 0x7fddd405f600 2020-04-02T23:46:54.455 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.446+0000 7fddd9059700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fddd405b4f0 0x7fddd409d1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:45548/0 (socket says 172.21.15.174:45548) 2020-04-02T23:46:54.455 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.446+0000 7fddd9059700 1 -- 172.21.15.174:0/2998199387 learned_addr learned my addr 172.21.15.174:0/2998199387 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:46:54.455 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.447+0000 7fddd8858700 1 --2- 172.21.15.174:0/2998199387 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fddd405f600 0x7fddd40601a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:54.456 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.447+0000 7fddd3fff700 1 --2- 172.21.15.174:0/2998199387 >> v2:172.21.15.196:3300/0 conn(0x7fddd4060600 0x7fddd405b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:54.456 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.447+0000 7fddd37fe700 1 -- 172.21.15.174:0/2998199387 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3577645465 0 0) 0x7fddd4132880 con 0x7fddd405b4f0 2020-04-02T23:46:54.456 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.447+0000 7fddd37fe700 1 -- 172.21.15.174:0/2998199387 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddb4003230 con 0x7fddd405b4f0 2020-04-02T23:46:54.456 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.447+0000 7fddd8858700 1 -- 172.21.15.174:0/2998199387 >> v2:172.21.15.196:3300/0 conn(0x7fddd4060600 msgr2=0x7fddd405b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:46:54.456 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.447+0000 7fddd37fe700 1 -- 172.21.15.174:0/2998199387 <== mon.0 v1:172.21.15.174:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4252343179 0 0) 0x7fddb4003230 con 0x7fddd405b4f0 2020-04-02T23:46:54.456 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.447+0000 7fddd8858700 1 --2- 172.21.15.174:0/2998199387 >> v2:172.21.15.196:3300/0 conn(0x7fddd4060600 0x7fddd405b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:54.456 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.447+0000 7fddd8858700 1 -- 172.21.15.174:0/2998199387 >> v1:172.21.15.174:6789/0 conn(0x7fddd405b4f0 legacy=0x7fddd409d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:54.457 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.447+0000 7fddd8858700 1 -- 172.21.15.174:0/2998199387 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd40a9230 con 0x7fddd405f600 2020-04-02T23:46:54.457 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.447+0000 7fddd8858700 1 --2- 172.21.15.174:0/2998199387 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fddd405f600 0x7fddd40601a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fddcc001870 tx=0x7fddd406a960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:54.457 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.447+0000 7fddd8858700 1 --2- 172.21.15.174:0/2998199387 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fddd405f600 0x7fddd40601a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fddcc001870 tx=0x7fddd406a960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:54.457 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.447+0000 7fddd8858700 1 --2- 172.21.15.174:0/2998199387 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fddd405f600 0x7fddd40601a0 secure :-1 s=READY pgs=43 cs=0 l=1 rx=0x7fddcc001870 tx=0x7fddd406a960).ready entity=mon.2 client_cookie=450a92525def8f1e server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:54.457 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.447+0000 7fddd8858700 1 --2- 172.21.15.174:0/2998199387 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fddd405f600 0x7fddd40601a0 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7fddcc001870 tx=0x7fddd406a960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:54.457 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.447+0000 7fddd37fe700 1 -- 172.21.15.174:0/2998199387 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fddcc0016d0 con 0x7fddd405f600 2020-04-02T23:46:54.457 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.447+0000 7fddd8858700 1 --2- 172.21.15.174:0/2998199387 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fddd405f600 0x7fddd40601a0 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7fddcc001870 tx=0x7fddd406a960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:54.458 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.447+0000 7fddd8858700 1 --2- 172.21.15.174:0/2998199387 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fddd405f600 0x7fddd40601a0 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7fddcc001870 tx=0x7fddd406a960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:54.458 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.447+0000 7fddd37fe700 1 -- 172.21.15.174:0/2998199387 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddbc008b40 con 0x7fddd405f600 2020-04-02T23:46:54.458 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.447+0000 7fddd37fe700 1 -- 172.21.15.174:0/2998199387 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fddbc008ea0 con 0x7fddd405f600 2020-04-02T23:46:54.458 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.447+0000 7fddd985a700 1 -- 172.21.15.174:0/2998199387 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fddd405f600 msgr2=0x7fddd40601a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:54.458 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.447+0000 7fddd985a700 1 --2- 172.21.15.174:0/2998199387 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fddd405f600 0x7fddd40601a0 secure :-1 s=READY pgs=43 cs=0 l=1 rx=0x7fddcc001870 tx=0x7fddd406a960).stop 2020-04-02T23:46:54.458 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.448+0000 7fddd985a700 1 -- 172.21.15.174:0/2998199387 shutdown_connections 2020-04-02T23:46:54.458 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.448+0000 7fddd985a700 1 --2- 172.21.15.174:0/2998199387 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fddd405f600 0x7fddd40601a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:54.459 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.448+0000 7fddd985a700 1 --2- 172.21.15.174:0/2998199387 >> v2:172.21.15.196:3300/0 conn(0x7fddd4060600 0x7fddd405b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:54.459 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.448+0000 7fddd985a700 1 -- 172.21.15.174:0/2998199387 >> 172.21.15.174:0/2998199387 conn(0x7fddd40ae840 msgr2=0x7fddd40aec20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:46:54.459 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.448+0000 7fddd985a700 1 -- 172.21.15.174:0/2998199387 shutdown_connections 2020-04-02T23:46:54.459 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.448+0000 7fddd985a700 1 -- 172.21.15.174:0/2998199387 wait complete. 2020-04-02T23:46:54.459 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.449+0000 7fddd985a700 1 Processor -- start 2020-04-02T23:46:54.459 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.449+0000 7fddd985a700 1 -- start start 2020-04-02T23:46:54.459 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.449+0000 7fddd985a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fddd405f600 0x7fddd4132860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:54.459 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.449+0000 7fddd985a700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fddd40ad810 0x7fddd41332a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:54.460 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.449+0000 7fddd985a700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddd4134c40 con 0x7fddd405b4f0 2020-04-02T23:46:54.460 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.449+0000 7fddd985a700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddd4144ff0 con 0x7fddd405f600 2020-04-02T23:46:54.460 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.449+0000 7fddd985a700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddd4134ee0 con 0x7fddd40ad810 2020-04-02T23:46:54.460 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.449+0000 7fddd3fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fddd405f600 0x7fddd4132860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:54.460 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.449+0000 7fddd3fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fddd405f600 0x7fddd4132860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:40516/0 (socket says 172.21.15.174:40516) 2020-04-02T23:46:54.460 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.449+0000 7fddd3fff700 1 -- 172.21.15.174:0/1662675344 learned_addr learned my addr 172.21.15.174:0/1662675344 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:46:54.460 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.450+0000 7fddd9059700 1 --2- 172.21.15.174:0/1662675344 >> v2:172.21.15.196:3300/0 conn(0x7fddd40ad810 0x7fddd41332a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:54.461 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.450+0000 7fddd3fff700 1 -- 172.21.15.174:0/1662675344 >> v2:172.21.15.196:3300/0 conn(0x7fddd40ad810 msgr2=0x7fddd41332a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:54.461 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.450+0000 7fddd3fff700 1 --2- 172.21.15.174:0/1662675344 >> v2:172.21.15.196:3300/0 conn(0x7fddd40ad810 0x7fddd41332a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:54.461 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.450+0000 7fddd3fff700 1 -- 172.21.15.174:0/1662675344 >> v1:172.21.15.196:6789/0 conn(0x7fddd405b4f0 legacy=0x7fddd41385d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:54.461 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.450+0000 7fddd3fff700 1 -- 172.21.15.174:0/1662675344 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd4135180 con 0x7fddd405f600 2020-04-02T23:46:54.461 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.450+0000 7fddd3fff700 1 --2- 172.21.15.174:0/1662675344 >> v2:172.21.15.174:3300/0 conn(0x7fddd405f600 0x7fddd4132860 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fddc40033f0 tx=0x7fddc4011050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:54.461 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.450+0000 7fddd3fff700 1 --2- 172.21.15.174:0/1662675344 >> v2:172.21.15.174:3300/0 conn(0x7fddd405f600 0x7fddd4132860 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fddc40033f0 tx=0x7fddc4011050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:54.461 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.450+0000 7fddd3fff700 1 --2- 172.21.15.174:0/1662675344 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fddd405f600 0x7fddd4132860 secure :-1 s=READY pgs=218 cs=0 l=1 rx=0x7fddc40033f0 tx=0x7fddc4011050).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:54.462 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.450+0000 7fddd3fff700 1 --2- 172.21.15.174:0/1662675344 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fddd405f600 0x7fddd4132860 secure :-1 s=THROTTLE_DONE pgs=218 cs=0 l=1 rx=0x7fddc40033f0 tx=0x7fddc4011050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:54.462 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.450+0000 7fddd1ffb700 1 -- 172.21.15.174:0/1662675344 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fddc4005e30 con 0x7fddd405f600 2020-04-02T23:46:54.462 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.450+0000 7fddd3fff700 1 --2- 172.21.15.174:0/1662675344 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fddd405f600 0x7fddd4132860 secure :-1 s=THROTTLE_DONE pgs=218 cs=0 l=1 rx=0x7fddc40033f0 tx=0x7fddc4011050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:54.462 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.450+0000 7fddd3fff700 1 --2- 172.21.15.174:0/1662675344 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fddd405f600 0x7fddd4132860 secure :-1 s=THROTTLE_DONE pgs=218 cs=0 l=1 rx=0x7fddc40033f0 tx=0x7fddc4011050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:54.462 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.450+0000 7fddd1ffb700 1 -- 172.21.15.174:0/1662675344 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddc4007540 con 0x7fddd405f600 2020-04-02T23:46:54.462 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.450+0000 7fddd985a700 1 -- 172.21.15.174:0/1662675344 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddd4133700 con 0x7fddd405f600 2020-04-02T23:46:54.462 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.450+0000 7fddd1ffb700 1 -- 172.21.15.174:0/1662675344 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fddc4012670 con 0x7fddd405f600 2020-04-02T23:46:54.463 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.450+0000 7fddd985a700 1 -- 172.21.15.174:0/1662675344 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddd4145670 con 0x7fddd405f600 2020-04-02T23:46:54.463 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.451+0000 7fddd3fff700 1 --2- 172.21.15.174:0/1662675344 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fddd405f600 0x7fddd4132860 secure :-1 s=THROTTLE_DONE pgs=218 cs=0 l=1 rx=0x7fddc40033f0 tx=0x7fddc4011050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:54.463 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.451+0000 7fddd985a700 1 -- 172.21.15.174:0/1662675344 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddd4135310 con 0x7fddd405f600 2020-04-02T23:46:54.463 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.451+0000 7fddd1ffb700 1 -- 172.21.15.174:0/1662675344 <== mon.0 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fddc400e180 con 0x7fddd405f600 2020-04-02T23:46:54.463 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.451+0000 7fddd3fff700 1 --2- 172.21.15.174:0/1662675344 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fddd405f600 0x7fddd4132860 secure :-1 s=THROTTLE_DONE pgs=218 cs=0 l=1 rx=0x7fddc40033f0 tx=0x7fddc4011050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:54.463 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.451+0000 7fddd1ffb700 1 --2- 172.21.15.174:0/1662675344 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fddb804d610 0x7fddb804fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:54.463 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.451+0000 7fddd1ffb700 1 -- 172.21.15.174:0/1662675344 <== mon.0 v2:172.21.15.174:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fddc4061000 con 0x7fddd405f600 2020-04-02T23:46:54.463 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.451+0000 7fddd8858700 1 --2- 172.21.15.174:0/1662675344 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fddb804d610 0x7fddb804fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:54.464 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.452+0000 7fddd8858700 1 --2- 172.21.15.174:0/1662675344 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fddb804d610 0x7fddb804fad0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fddd40add30 tx=0x7fddd406a960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:54.464 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.452+0000 7fddd8858700 1 --2- 172.21.15.174:0/1662675344 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fddb804d610 0x7fddb804fad0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fddd40add30 tx=0x7fddd406a960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:54.464 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.452+0000 7fddd8858700 1 --2- 172.21.15.174:0/1662675344 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fddb804d610 0x7fddb804fad0 secure :-1 s=READY pgs=122 cs=0 l=1 rx=0x7fddd40add30 tx=0x7fddd406a960).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:54.464 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.455+0000 7fddd3fff700 1 --2- 172.21.15.174:0/1662675344 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fddd405f600 0x7fddd4132860 secure :-1 s=THROTTLE_DONE pgs=218 cs=0 l=1 rx=0x7fddc40033f0 tx=0x7fddc4011050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:54.464 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.455+0000 7fddd1ffb700 1 -- 172.21.15.174:0/1662675344 <== mon.0 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fddc403c760 con 0x7fddd405f600 2020-04-02T23:46:54.594 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.592+0000 7fddd985a700 1 -- 172.21.15.174:0/1662675344 --> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fddd4056c50 con 0x7fddb804d610 2020-04-02T23:46:54.595 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.593+0000 7fddd8858700 1 --2- 172.21.15.174:0/1662675344 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fddb804d610 0x7fddb804fad0 secure :-1 s=THROTTLE_DONE pgs=122 cs=0 l=1 rx=0x7fddd40add30 tx=0x7fddd406a960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:54.595 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.593+0000 7fddd1ffb700 1 -- 172.21.15.174:0/1662675344 <== mgr.4102 v2:172.21.15.196:6800/23210 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fddd4056c50 con 0x7fddb804d610 2020-04-02T23:46:54.596 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.594+0000 7fddd985a700 1 -- 172.21.15.174:0/1662675344 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fddb804d610 msgr2=0x7fddb804fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:54.596 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.594+0000 7fddd985a700 1 --2- 172.21.15.174:0/1662675344 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fddb804d610 0x7fddb804fad0 secure :-1 s=READY pgs=122 cs=0 l=1 rx=0x7fddd40add30 tx=0x7fddd406a960).stop 2020-04-02T23:46:54.597 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.594+0000 7fddd985a700 1 -- 172.21.15.174:0/1662675344 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fddd405f600 msgr2=0x7fddd4132860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:54.597 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.594+0000 7fddd985a700 1 --2- 172.21.15.174:0/1662675344 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fddd405f600 0x7fddd4132860 secure :-1 s=READY pgs=218 cs=0 l=1 rx=0x7fddc40033f0 tx=0x7fddc4011050).stop 2020-04-02T23:46:54.597 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.594+0000 7fddd985a700 1 -- 172.21.15.174:0/1662675344 shutdown_connections 2020-04-02T23:46:54.597 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.594+0000 7fddd985a700 1 --2- 172.21.15.174:0/1662675344 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fddb804d610 0x7fddb804fad0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:54.597 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.594+0000 7fddd985a700 1 --2- 172.21.15.174:0/1662675344 >> v2:172.21.15.196:3300/0 conn(0x7fddd40ad810 0x7fddd41332a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:54.597 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.594+0000 7fddd985a700 1 --2- 172.21.15.174:0/1662675344 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fddd405f600 0x7fddd4132860 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:54.598 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.594+0000 7fddd985a700 1 -- 172.21.15.174:0/1662675344 >> 172.21.15.174:0/1662675344 conn(0x7fddd40ae840 msgr2=0x7fddd412ebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:46:54.598 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.594+0000 7fddd985a700 1 -- 172.21.15.174:0/1662675344 shutdown_connections 2020-04-02T23:46:54.598 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.594+0000 7fddd985a700 1 -- 172.21.15.174:0/1662675344 wait complete. 2020-04-02T23:46:54.598 INFO:teuthology.orchestra.run.smithi174.stderr:instructed osd(s) 6 to deep-scrub 2020-04-02T23:46:54.606 INFO:tasks.ceph:Scrubbing osd.7 2020-04-02T23:46:54.607 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:46:54.620 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.7 config set osd_debug_deep_scrub_sleep 0 2020-04-02T23:46:54.769 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.767+0000 7f41dead5700 1 Processor -- start 2020-04-02T23:46:54.769 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.767+0000 7f41dead5700 1 -- start start 2020-04-02T23:46:54.776 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.768+0000 7f41dead5700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f41d80a4330 0x7f41d80a22b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:54.776 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.768+0000 7f41dead5700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f41d8138bb0 0x7f41d8134dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:54.776 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.768+0000 7f41dead5700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41d80a3ae0 con 0x7f41d80a7a60 2020-04-02T23:46:54.776 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.768+0000 7f41dead5700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41d80a3d80 con 0x7f41d80a4330 2020-04-02T23:46:54.776 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.768+0000 7f41dead5700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41d80a4020 con 0x7f41d8138bb0 2020-04-02T23:46:54.777 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.768+0000 7f41d7fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f41d80a4330 0x7f41d80a22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:54.777 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.768+0000 7f41d7fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f41d80a4330 0x7f41d80a22b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:40524/0 (socket says 172.21.15.174:40524) 2020-04-02T23:46:54.777 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.768+0000 7f41d7fff700 1 -- 172.21.15.174:0/3132430154 learned_addr learned my addr 172.21.15.174:0/3132430154 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:46:54.777 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.768+0000 7f41dc871700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f41d80a7a60 0x7f41d81384a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:45560/0 (socket says 172.21.15.174:45560) 2020-04-02T23:46:54.777 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.768+0000 7f41dd072700 1 --2- 172.21.15.174:0/3132430154 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f41d8138bb0 0x7f41d8134dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:54.777 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.768+0000 7f41d7fff700 1 -- 172.21.15.174:0/3132430154 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f41d8138bb0 msgr2=0x7f41d8134dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:46:54.777 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.768+0000 7f41d7fff700 1 --2- 172.21.15.174:0/3132430154 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f41d8138bb0 0x7f41d8134dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:54.777 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.768+0000 7f41d7fff700 1 -- 172.21.15.174:0/3132430154 >> v1:172.21.15.174:6789/0 conn(0x7f41d80a7a60 legacy=0x7f41d81384a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:54.778 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.768+0000 7f41d7fff700 1 -- 172.21.15.174:0/3132430154 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d80a1a60 con 0x7f41d80a4330 2020-04-02T23:46:54.778 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.768+0000 7f41d77fe700 1 -- 172.21.15.174:0/3132430154 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2368849259 0 0) 0x7f41d80a3ae0 con 0x7f41d80a7a60 2020-04-02T23:46:54.778 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.768+0000 7f41dd072700 1 --2- 172.21.15.174:0/3132430154 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f41d8138bb0 0x7f41d8134dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-02T23:46:54.778 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.768+0000 7f41d7fff700 1 --2- 172.21.15.174:0/3132430154 >> v2:172.21.15.174:3300/0 conn(0x7f41d80a4330 0x7f41d80a22b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f41cc002f30 tx=0x7f41cc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:54.778 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.768+0000 7f41d7fff700 1 --2- 172.21.15.174:0/3132430154 >> v2:172.21.15.174:3300/0 conn(0x7f41d80a4330 0x7f41d80a22b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f41cc002f30 tx=0x7f41cc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:54.778 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.768+0000 7f41d7fff700 1 --2- 172.21.15.174:0/3132430154 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41d80a4330 0x7f41d80a22b0 secure :-1 s=READY pgs=220 cs=0 l=1 rx=0x7f41cc002f30 tx=0x7f41cc007a40).ready entity=mon.0 client_cookie=fac5874911574977 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:54.778 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.768+0000 7f41d7fff700 1 --2- 172.21.15.174:0/3132430154 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41d80a4330 0x7f41d80a22b0 secure :-1 s=THROTTLE_DONE pgs=220 cs=0 l=1 rx=0x7f41cc002f30 tx=0x7f41cc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:54.779 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.768+0000 7f41d77fe700 1 -- 172.21.15.174:0/3132430154 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41cc011720 con 0x7f41d80a4330 2020-04-02T23:46:54.779 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.768+0000 7f41d7fff700 1 --2- 172.21.15.174:0/3132430154 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41d80a4330 0x7f41d80a22b0 secure :-1 s=THROTTLE_DONE pgs=220 cs=0 l=1 rx=0x7f41cc002f30 tx=0x7f41cc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:54.779 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.768+0000 7f41d7fff700 1 --2- 172.21.15.174:0/3132430154 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41d80a4330 0x7f41d80a22b0 secure :-1 s=THROTTLE_DONE pgs=220 cs=0 l=1 rx=0x7f41cc002f30 tx=0x7f41cc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:54.779 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.768+0000 7f41d77fe700 1 -- 172.21.15.174:0/3132430154 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41cc011880 con 0x7f41d80a4330 2020-04-02T23:46:54.779 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.768+0000 7f41d77fe700 1 -- 172.21.15.174:0/3132430154 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41cc011c60 con 0x7f41d80a4330 2020-04-02T23:46:54.779 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.768+0000 7f41dead5700 1 -- 172.21.15.174:0/3132430154 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41d80a4330 msgr2=0x7f41d80a22b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:54.779 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.768+0000 7f41dead5700 1 --2- 172.21.15.174:0/3132430154 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41d80a4330 0x7f41d80a22b0 secure :-1 s=READY pgs=220 cs=0 l=1 rx=0x7f41cc002f30 tx=0x7f41cc007a40).stop 2020-04-02T23:46:54.779 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.769+0000 7f41dead5700 1 -- 172.21.15.174:0/3132430154 shutdown_connections 2020-04-02T23:46:54.780 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.769+0000 7f41dead5700 1 --2- 172.21.15.174:0/3132430154 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f41d8138bb0 0x7f41d8134dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:54.780 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.769+0000 7f41dead5700 1 --2- 172.21.15.174:0/3132430154 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41d80a4330 0x7f41d80a22b0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:54.780 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.769+0000 7f41dead5700 1 -- 172.21.15.174:0/3132430154 >> 172.21.15.174:0/3132430154 conn(0x7f41d80aaf80 msgr2=0x7f41d80a6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:46:54.780 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.769+0000 7f41dead5700 1 -- 172.21.15.174:0/3132430154 shutdown_connections 2020-04-02T23:46:54.780 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.769+0000 7f41dead5700 1 -- 172.21.15.174:0/3132430154 wait complete. 2020-04-02T23:46:54.780 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.770+0000 7f41dead5700 1 Processor -- start 2020-04-02T23:46:54.780 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.770+0000 7f41dead5700 1 -- start start 2020-04-02T23:46:54.781 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.770+0000 7f41dead5700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f41d80a4330 0x7f41d8134070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:54.781 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.770+0000 7f41dead5700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41d8135f30 con 0x7f41d8138bb0 2020-04-02T23:46:54.781 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.770+0000 7f41dead5700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41d8120fa0 con 0x7f41d80a7a60 2020-04-02T23:46:54.781 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.770+0000 7f41dead5700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41d8135820 con 0x7f41d80a4330 2020-04-02T23:46:54.781 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.771+0000 7f41dc871700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f41d80a4330 0x7f41d8134070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:54.781 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.771+0000 7f41dd072700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f41d8138bb0 0x7f41d8120890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:45570/0 (socket says 172.21.15.174:45570) 2020-04-02T23:46:54.781 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.771+0000 7f41dc871700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f41d80a4330 0x7f41d8134070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:40528/0 (socket says 172.21.15.174:40528) 2020-04-02T23:46:54.782 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.771+0000 7f41dd072700 1 -- 172.21.15.174:0/3220777910 learned_addr learned my addr 172.21.15.174:0/3220777910 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:46:54.782 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.771+0000 7f41dc871700 1 -- 172.21.15.174:0/3220777910 >> v1:172.21.15.196:6789/0 conn(0x7f41d80a7a60 legacy=0x7f41d8120180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:54.782 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.771+0000 7f41dc871700 1 -- 172.21.15.174:0/3220777910 >> v1:172.21.15.174:6789/0 conn(0x7f41d8138bb0 legacy=0x7f41d8120890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:54.782 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.771+0000 7f41d5ffb700 1 -- 172.21.15.174:0/3220777910 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4241600755 0 0) 0x7f41d8135f30 con 0x7f41d8138bb0 2020-04-02T23:46:54.782 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.771+0000 7f41dc871700 1 -- 172.21.15.174:0/3220777910 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d81319b0 con 0x7f41d80a4330 2020-04-02T23:46:54.782 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.771+0000 7f41dc871700 1 --2- 172.21.15.174:0/3220777910 >> v2:172.21.15.174:3300/0 conn(0x7f41d80a4330 0x7f41d8134070 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f41d8138ad0 tx=0x7f41d0010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:54.782 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.771+0000 7f41dc871700 1 --2- 172.21.15.174:0/3220777910 >> v2:172.21.15.174:3300/0 conn(0x7f41d80a4330 0x7f41d8134070 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f41d8138ad0 tx=0x7f41d0010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:54.782 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.771+0000 7f41dc871700 1 --2- 172.21.15.174:0/3220777910 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41d80a4330 0x7f41d8134070 secure :-1 s=READY pgs=222 cs=0 l=1 rx=0x7f41d8138ad0 tx=0x7f41d0010cd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:54.783 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.771+0000 7f41dc871700 1 --2- 172.21.15.174:0/3220777910 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41d80a4330 0x7f41d8134070 secure :-1 s=THROTTLE_DONE pgs=222 cs=0 l=1 rx=0x7f41d8138ad0 tx=0x7f41d0010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:54.783 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.771+0000 7f41d5ffb700 1 -- 172.21.15.174:0/3220777910 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41d0004c50 con 0x7f41d80a4330 2020-04-02T23:46:54.783 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.771+0000 7f41dc871700 1 --2- 172.21.15.174:0/3220777910 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41d80a4330 0x7f41d8134070 secure :-1 s=THROTTLE_DONE pgs=222 cs=0 l=1 rx=0x7f41d8138ad0 tx=0x7f41d0010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:54.783 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.771+0000 7f41dc871700 1 --2- 172.21.15.174:0/3220777910 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41d80a4330 0x7f41d8134070 secure :-1 s=THROTTLE_DONE pgs=222 cs=0 l=1 rx=0x7f41d8138ad0 tx=0x7f41d0010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:54.783 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.771+0000 7f41d5ffb700 1 -- 172.21.15.174:0/3220777910 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41d0004db0 con 0x7f41d80a4330 2020-04-02T23:46:54.783 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.771+0000 7f41dead5700 1 -- 172.21.15.174:0/3220777910 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41d8131cb0 con 0x7f41d80a4330 2020-04-02T23:46:54.783 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.771+0000 7f41d5ffb700 1 -- 172.21.15.174:0/3220777910 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41d0012820 con 0x7f41d80a4330 2020-04-02T23:46:54.784 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.771+0000 7f41dead5700 1 -- 172.21.15.174:0/3220777910 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41d8126970 con 0x7f41d80a4330 2020-04-02T23:46:54.784 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.772+0000 7f41dc871700 1 --2- 172.21.15.174:0/3220777910 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41d80a4330 0x7f41d8134070 secure :-1 s=THROTTLE_DONE pgs=222 cs=0 l=1 rx=0x7f41d8138ad0 tx=0x7f41d0010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:54.784 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.772+0000 7f41dead5700 1 -- 172.21.15.174:0/3220777910 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f41d8126b70 con 0x7f41d80a4330 2020-04-02T23:46:54.784 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.772+0000 7f41d5ffb700 1 -- 172.21.15.174:0/3220777910 <== mon.0 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f41d0012a20 con 0x7f41d80a4330 2020-04-02T23:46:54.784 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.772+0000 7f41dc871700 1 --2- 172.21.15.174:0/3220777910 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41d80a4330 0x7f41d8134070 secure :-1 s=THROTTLE_DONE pgs=222 cs=0 l=1 rx=0x7f41d8138ad0 tx=0x7f41d0010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:54.784 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.772+0000 7f41dc871700 1 --2- 172.21.15.174:0/3220777910 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41d80a4330 0x7f41d8134070 secure :-1 s=THROTTLE_DONE pgs=222 cs=0 l=1 rx=0x7f41d8138ad0 tx=0x7f41d0010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:54.784 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.772+0000 7f41d5ffb700 1 --2- 172.21.15.174:0/3220777910 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f41b804d420 0x7f41b804f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:54.785 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.772+0000 7f41d5ffb700 1 -- 172.21.15.174:0/3220777910 <== mon.0 v2:172.21.15.174:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f41d00614f0 con 0x7f41d80a4330 2020-04-02T23:46:54.785 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.772+0000 7f41d5ffb700 1 --2- 172.21.15.174:0/3220777910 >> [v2:172.21.15.196:6826/24408,v1:172.21.15.196:6827/24408] conn(0x7f41b8054000 0x7f41b8056420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:54.785 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.772+0000 7f41d5ffb700 1 -- 172.21.15.174:0/3220777910 --> [v2:172.21.15.196:6826/24408,v1:172.21.15.196:6827/24408] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f41b80569e0 con 0x7f41b8054000 2020-04-02T23:46:54.785 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.772+0000 7f41d5ffb700 1 -- 172.21.15.174:0/3220777910 <== mon.0 v2:172.21.15.174:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f41d0062a10 con 0x7f41d80a4330 2020-04-02T23:46:54.785 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.773+0000 7f41d7fff700 1 --2- 172.21.15.174:0/3220777910 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f41b804d420 0x7f41b804f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:54.785 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.773+0000 7f41dd072700 1 --2- 172.21.15.174:0/3220777910 >> [v2:172.21.15.196:6826/24408,v1:172.21.15.196:6827/24408] conn(0x7f41b8054000 0x7f41b8056420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:54.785 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.773+0000 7f41d7fff700 1 --2- 172.21.15.174:0/3220777910 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f41b804d420 0x7f41b804f8e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f41cc002f30 tx=0x7f41cc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:54.785 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.773+0000 7f41d7fff700 1 --2- 172.21.15.174:0/3220777910 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f41b804d420 0x7f41b804f8e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f41cc002f30 tx=0x7f41cc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:54.786 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.773+0000 7f41d7fff700 1 --2- 172.21.15.174:0/3220777910 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f41b804d420 0x7f41b804f8e0 secure :-1 s=READY pgs=123 cs=0 l=1 rx=0x7f41cc002f30 tx=0x7f41cc007a40).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:54.786 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.773+0000 7f41dd072700 1 --2- 172.21.15.174:0/3220777910 >> [v2:172.21.15.196:6826/24408,v1:172.21.15.196:6827/24408] conn(0x7f41b8054000 0x7f41b8056420 crc :-1 s=READY pgs=9 cs=0 l=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:54.786 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.774+0000 7f41d5ffb700 1 -- 172.21.15.174:0/3220777910 <== osd.7 v2:172.21.15.196:6826/24408 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21407 (crc 0 0 0) 0x7f41b80569e0 con 0x7f41b8054000 2020-04-02T23:46:54.790 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.788+0000 7f41dead5700 1 -- 172.21.15.174:0/3220777910 --> [v2:172.21.15.196:6826/24408,v1:172.21.15.196:6827/24408] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f41d8126fd0 con 0x7f41b8054000 2020-04-02T23:46:54.790 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.788+0000 7f41d5ffb700 1 -- 172.21.15.174:0/3220777910 <== osd.7 v2:172.21.15.196:6826/24408 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f41d8126fd0 con 0x7f41b8054000 2020-04-02T23:46:54.791 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2020-04-02T23:46:54.791 INFO:teuthology.orchestra.run.smithi174.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-04-02T23:46:54.791 INFO:teuthology.orchestra.run.smithi174.stdout:} 2020-04-02T23:46:54.792 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.789+0000 7f41dead5700 1 -- 172.21.15.174:0/3220777910 >> [v2:172.21.15.196:6826/24408,v1:172.21.15.196:6827/24408] conn(0x7f41b8054000 msgr2=0x7f41b8056420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:54.792 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.789+0000 7f41dead5700 1 --2- 172.21.15.174:0/3220777910 >> [v2:172.21.15.196:6826/24408,v1:172.21.15.196:6827/24408] conn(0x7f41b8054000 0x7f41b8056420 crc :-1 s=READY pgs=9 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:54.792 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.789+0000 7f41dead5700 1 -- 172.21.15.174:0/3220777910 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f41b804d420 msgr2=0x7f41b804f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:54.793 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.789+0000 7f41dead5700 1 --2- 172.21.15.174:0/3220777910 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f41b804d420 0x7f41b804f8e0 secure :-1 s=READY pgs=123 cs=0 l=1 rx=0x7f41cc002f30 tx=0x7f41cc007a40).stop 2020-04-02T23:46:54.793 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.789+0000 7f41dead5700 1 -- 172.21.15.174:0/3220777910 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41d80a4330 msgr2=0x7f41d8134070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:54.793 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.789+0000 7f41dead5700 1 --2- 172.21.15.174:0/3220777910 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41d80a4330 0x7f41d8134070 secure :-1 s=READY pgs=222 cs=0 l=1 rx=0x7f41d8138ad0 tx=0x7f41d0010cd0).stop 2020-04-02T23:46:54.793 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.789+0000 7f41dd072700 1 -- 172.21.15.174:0/3220777910 reap_dead start 2020-04-02T23:46:54.793 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.789+0000 7f41dead5700 1 -- 172.21.15.174:0/3220777910 shutdown_connections 2020-04-02T23:46:54.793 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.789+0000 7f41dead5700 1 --2- 172.21.15.174:0/3220777910 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41d80a4330 0x7f41d8134070 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:54.793 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.789+0000 7f41dead5700 1 -- 172.21.15.174:0/3220777910 >> 172.21.15.174:0/3220777910 conn(0x7f41d80aaf80 msgr2=0x7f41d81272d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:46:54.793 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.789+0000 7f41dead5700 1 -- 172.21.15.174:0/3220777910 shutdown_connections 2020-04-02T23:46:54.794 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.789+0000 7f41dead5700 1 -- 172.21.15.174:0/3220777910 wait complete. 2020-04-02T23:46:54.801 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:46:54.814 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd deep-scrub 7 2020-04-02T23:46:54.959 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.957+0000 7fac94c3f700 1 Processor -- start 2020-04-02T23:46:54.959 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.957+0000 7fac94c3f700 1 -- start start 2020-04-02T23:46:54.962 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.958+0000 7fac94c3f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fac90138b90 0x7fac9013f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:54.962 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.958+0000 7fac94c3f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac900a3e30 con 0x7fac900a38f0 2020-04-02T23:46:54.962 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.958+0000 7fac94c3f700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac900a40d0 con 0x7fac900a7a60 2020-04-02T23:46:54.962 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.958+0000 7fac94c3f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac900a4370 con 0x7fac90138b90 2020-04-02T23:46:54.962 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.958+0000 7fac8ed9d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fac90138b90 0x7fac9013f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:54.962 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.958+0000 7fac8ed9d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fac90138b90 0x7fac9013f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:40538/0 (socket says 172.21.15.174:40538) 2020-04-02T23:46:54.963 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.958+0000 7fac8dd9b700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fac900a38f0 0x7fac90138480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:45576/0 (socket says 172.21.15.174:45576) 2020-04-02T23:46:54.963 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.958+0000 7fac8ed9d700 1 -- 172.21.15.174:0/1711958564 learned_addr learned my addr 172.21.15.174:0/1711958564 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:46:54.963 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.958+0000 7fac8ed9d700 1 -- 172.21.15.174:0/1711958564 >> v1:172.21.15.196:6789/0 conn(0x7fac900a7a60 legacy=0x7fac900a1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:54.963 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.958+0000 7fac8ed9d700 1 -- 172.21.15.174:0/1711958564 >> v1:172.21.15.174:6789/0 conn(0x7fac900a38f0 legacy=0x7fac90138480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:54.963 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.958+0000 7fac8d59a700 1 -- 172.21.15.174:0/1711958564 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 560653902 0 0) 0x7fac900a3e30 con 0x7fac900a38f0 2020-04-02T23:46:54.963 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.958+0000 7fac8ed9d700 1 -- 172.21.15.174:0/1711958564 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac9005ac00 con 0x7fac90138b90 2020-04-02T23:46:54.963 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.958+0000 7fac8ed9d700 1 --2- 172.21.15.174:0/1711958564 >> v2:172.21.15.174:3300/0 conn(0x7fac90138b90 0x7fac9013f8a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fac880032b0 tx=0x7fac88007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:54.963 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.958+0000 7fac8ed9d700 1 --2- 172.21.15.174:0/1711958564 >> v2:172.21.15.174:3300/0 conn(0x7fac90138b90 0x7fac9013f8a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fac880032b0 tx=0x7fac88007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:54.964 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.958+0000 7fac8ed9d700 1 --2- 172.21.15.174:0/1711958564 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fac90138b90 0x7fac9013f8a0 secure :-1 s=READY pgs=224 cs=0 l=1 rx=0x7fac880032b0 tx=0x7fac88007dc0).ready entity=mon.0 client_cookie=ca95ee6448577532 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:54.964 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.959+0000 7fac8ed9d700 1 --2- 172.21.15.174:0/1711958564 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fac90138b90 0x7fac9013f8a0 secure :-1 s=THROTTLE_DONE pgs=224 cs=0 l=1 rx=0x7fac880032b0 tx=0x7fac88007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:54.964 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.959+0000 7fac8d59a700 1 -- 172.21.15.174:0/1711958564 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac8800a160 con 0x7fac90138b90 2020-04-02T23:46:54.964 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.959+0000 7fac8ed9d700 1 --2- 172.21.15.174:0/1711958564 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fac90138b90 0x7fac9013f8a0 secure :-1 s=THROTTLE_DONE pgs=224 cs=0 l=1 rx=0x7fac880032b0 tx=0x7fac88007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:54.964 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.959+0000 7fac8ed9d700 1 --2- 172.21.15.174:0/1711958564 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fac90138b90 0x7fac9013f8a0 secure :-1 s=THROTTLE_DONE pgs=224 cs=0 l=1 rx=0x7fac880032b0 tx=0x7fac88007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:54.964 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.959+0000 7fac8d59a700 1 -- 172.21.15.174:0/1711958564 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac8800a2c0 con 0x7fac90138b90 2020-04-02T23:46:54.964 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.959+0000 7fac8d59a700 1 -- 172.21.15.174:0/1711958564 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac8800a6e0 con 0x7fac90138b90 2020-04-02T23:46:54.965 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.959+0000 7fac94c3f700 1 -- 172.21.15.174:0/1711958564 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fac90138b90 msgr2=0x7fac9013f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:54.965 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.959+0000 7fac94c3f700 1 --2- 172.21.15.174:0/1711958564 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fac90138b90 0x7fac9013f8a0 secure :-1 s=READY pgs=224 cs=0 l=1 rx=0x7fac880032b0 tx=0x7fac88007dc0).stop 2020-04-02T23:46:54.965 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.959+0000 7fac94c3f700 1 -- 172.21.15.174:0/1711958564 shutdown_connections 2020-04-02T23:46:54.965 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.959+0000 7fac94c3f700 1 --2- 172.21.15.174:0/1711958564 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fac90138b90 0x7fac9013f8a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:54.965 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.959+0000 7fac94c3f700 1 -- 172.21.15.174:0/1711958564 >> 172.21.15.174:0/1711958564 conn(0x7fac900aaf80 msgr2=0x7fac900a6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:46:54.965 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.959+0000 7fac94c3f700 1 -- 172.21.15.174:0/1711958564 shutdown_connections 2020-04-02T23:46:54.965 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.959+0000 7fac94c3f700 1 -- 172.21.15.174:0/1711958564 wait complete. 2020-04-02T23:46:54.970 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.960+0000 7fac94c3f700 1 Processor -- start 2020-04-02T23:46:54.970 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.960+0000 7fac94c3f700 1 -- start start 2020-04-02T23:46:54.971 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.961+0000 7fac94c3f700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fac90138b90 0x7fac900a1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:54.971 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.961+0000 7fac94c3f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac9009e860 con 0x7fac900a38f0 2020-04-02T23:46:54.971 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.961+0000 7fac94c3f700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac90131f90 con 0x7fac900a7a60 2020-04-02T23:46:54.971 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.961+0000 7fac94c3f700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac9012d980 con 0x7fac90138b90 2020-04-02T23:46:54.971 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.961+0000 7fac8e59c700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fac900a38f0 0x7fac90130e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:45580/0 (socket says 172.21.15.174:45580) 2020-04-02T23:46:54.971 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.961+0000 7fac8e59c700 1 -- 172.21.15.174:0/2247404263 learned_addr learned my addr 172.21.15.174:0/2247404263 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:46:54.972 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.961+0000 7fac8ed9d700 1 --2- 172.21.15.174:0/2247404263 >> v2:172.21.15.196:3300/0 conn(0x7fac90138b90 0x7fac900a1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:54.972 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.961+0000 7fac7f7fe700 1 -- 172.21.15.174:0/2247404263 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2769389078 0 0) 0x7fac9009e860 con 0x7fac900a38f0 2020-04-02T23:46:54.972 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.961+0000 7fac7f7fe700 1 -- 172.21.15.174:0/2247404263 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac6c002fe0 con 0x7fac900a38f0 2020-04-02T23:46:54.972 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.961+0000 7fac7f7fe700 1 -- 172.21.15.174:0/2247404263 <== mon.0 v1:172.21.15.174:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2035817562 0 0) 0x7fac6c002fe0 con 0x7fac900a38f0 2020-04-02T23:46:54.972 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.961+0000 7fac7f7fe700 1 -- 172.21.15.174:0/2247404263 --> v1:172.21.15.174:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fac9009e860 con 0x7fac900a38f0 2020-04-02T23:46:54.972 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.961+0000 7fac7f7fe700 1 -- 172.21.15.174:0/2247404263 <== mon.0 v1:172.21.15.174:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2811762909 0 0) 0x7fac840018d0 con 0x7fac900a38f0 2020-04-02T23:46:54.972 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.961+0000 7fac7f7fe700 1 -- 172.21.15.174:0/2247404263 >> v2:172.21.15.196:3300/0 conn(0x7fac90138b90 msgr2=0x7fac900a1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:54.973 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.961+0000 7fac7f7fe700 1 --2- 172.21.15.174:0/2247404263 >> v2:172.21.15.196:3300/0 conn(0x7fac90138b90 0x7fac900a1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:54.973 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.961+0000 7fac7f7fe700 1 -- 172.21.15.174:0/2247404263 >> v1:172.21.15.196:6789/0 conn(0x7fac900a7a60 legacy=0x7fac900a0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:54.973 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.961+0000 7fac7f7fe700 1 -- 172.21.15.174:0/2247404263 >> v1:172.21.15.174:6789/0 conn(0x7fac900a38f0 legacy=0x7fac90130e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:54.973 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.961+0000 7fac7f7fe700 1 --2- 172.21.15.174:0/2247404263 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fac6c0049b0 0x7fac6c004dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:54.973 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.961+0000 7fac7f7fe700 1 --2- 172.21.15.174:0/2247404263 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fac6c003920 0x7fac6c003d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:54.973 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.961+0000 7fac7f7fe700 1 --2- 172.21.15.174:0/2247404263 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fac6c0041e0 0x7fac6c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:54.974 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.961+0000 7fac7f7fe700 1 -- 172.21.15.174:0/2247404263 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac9012d980 con 0x7fac6c0041e0 2020-04-02T23:46:54.974 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.961+0000 7fac7f7fe700 1 -- 172.21.15.174:0/2247404263 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac6c0053e0 con 0x7fac6c0049b0 2020-04-02T23:46:54.974 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.961+0000 7fac7f7fe700 1 -- 172.21.15.174:0/2247404263 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac6c00bbb0 con 0x7fac6c003920 2020-04-02T23:46:54.974 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.961+0000 7fac8ed9d700 1 --2- 172.21.15.174:0/2247404263 >> v2:172.21.15.196:3300/0 conn(0x7fac90138b90 0x7fac900a1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:46:54.974 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.961+0000 7fac8e59c700 1 --2- 172.21.15.174:0/2247404263 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fac6c0049b0 0x7fac6c004dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:54.974 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.961+0000 7fac8ed9d700 1 --2- 172.21.15.174:0/2247404263 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fac6c0041e0 0x7fac6c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:54.975 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.961+0000 7fac8dd9b700 1 --2- 172.21.15.174:0/2247404263 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fac6c003920 0x7fac6c003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:54.975 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.962+0000 7fac8ed9d700 1 -- 172.21.15.174:0/2247404263 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fac6c003920 msgr2=0x7fac6c003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:54.975 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.962+0000 7fac8ed9d700 1 --2- 172.21.15.174:0/2247404263 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fac6c003920 0x7fac6c003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:54.975 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.962+0000 7fac8ed9d700 1 -- 172.21.15.174:0/2247404263 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fac6c0049b0 msgr2=0x7fac6c004dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:54.975 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.962+0000 7fac8ed9d700 1 --2- 172.21.15.174:0/2247404263 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fac6c0049b0 0x7fac6c004dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:54.975 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.962+0000 7fac8ed9d700 1 -- 172.21.15.174:0/2247404263 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac901309d0 con 0x7fac6c0041e0 2020-04-02T23:46:54.975 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.962+0000 7fac94c3f700 1 -- 172.21.15.174:0/2247404263 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac90130730 con 0x7fac6c0041e0 2020-04-02T23:46:54.975 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.962+0000 7fac8ed9d700 1 --2- 172.21.15.174:0/2247404263 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fac6c0041e0 0x7fac6c00b750 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fac880032b0 tx=0x7fac88007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:54.976 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.962+0000 7fac94c3f700 1 -- 172.21.15.174:0/2247404263 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac90131cb0 con 0x7fac6c0041e0 2020-04-02T23:46:54.976 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.962+0000 7fac8ed9d700 1 -- 172.21.15.174:0/2247404263 reap_dead start 2020-04-02T23:46:54.976 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.962+0000 7fac8ed9d700 1 --2- 172.21.15.174:0/2247404263 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fac6c0041e0 0x7fac6c00b750 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fac880032b0 tx=0x7fac88007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:54.976 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.962+0000 7fac8ed9d700 1 --2- 172.21.15.174:0/2247404263 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fac6c0041e0 0x7fac6c00b750 secure :-1 s=READY pgs=226 cs=0 l=1 rx=0x7fac880032b0 tx=0x7fac88007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:54.976 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.962+0000 7fac8ed9d700 1 --2- 172.21.15.174:0/2247404263 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fac6c0041e0 0x7fac6c00b750 secure :-1 s=THROTTLE_DONE pgs=226 cs=0 l=1 rx=0x7fac880032b0 tx=0x7fac88007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:54.976 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.962+0000 7fac7f7fe700 1 -- 172.21.15.174:0/2247404263 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac8800aaf0 con 0x7fac6c0041e0 2020-04-02T23:46:54.976 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.962+0000 7fac8ed9d700 1 --2- 172.21.15.174:0/2247404263 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fac6c0041e0 0x7fac6c00b750 secure :-1 s=THROTTLE_DONE pgs=226 cs=0 l=1 rx=0x7fac880032b0 tx=0x7fac88007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:54.976 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.962+0000 7fac8ed9d700 1 --2- 172.21.15.174:0/2247404263 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fac6c0041e0 0x7fac6c00b750 secure :-1 s=THROTTLE_DONE pgs=226 cs=0 l=1 rx=0x7fac880032b0 tx=0x7fac88007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:54.977 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.962+0000 7fac7f7fe700 1 -- 172.21.15.174:0/2247404263 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac88005a40 con 0x7fac6c0041e0 2020-04-02T23:46:54.977 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.962+0000 7fac7f7fe700 1 -- 172.21.15.174:0/2247404263 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac8800ac50 con 0x7fac6c0041e0 2020-04-02T23:46:54.977 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.963+0000 7fac8ed9d700 1 --2- 172.21.15.174:0/2247404263 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fac6c0041e0 0x7fac6c00b750 secure :-1 s=THROTTLE_DONE pgs=226 cs=0 l=1 rx=0x7fac880032b0 tx=0x7fac88007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:54.977 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.963+0000 7fac94c3f700 1 -- 172.21.15.174:0/2247404263 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac90056c50 con 0x7fac6c0041e0 2020-04-02T23:46:54.977 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.963+0000 7fac7f7fe700 1 -- 172.21.15.174:0/2247404263 <== mon.0 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fac8800f750 con 0x7fac6c0041e0 2020-04-02T23:46:54.977 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.963+0000 7fac8ed9d700 1 --2- 172.21.15.174:0/2247404263 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fac6c0041e0 0x7fac6c00b750 secure :-1 s=THROTTLE_DONE pgs=226 cs=0 l=1 rx=0x7fac880032b0 tx=0x7fac88007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:54.977 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.963+0000 7fac7f7fe700 1 --2- 172.21.15.174:0/2247404263 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fac6c0513e0 0x7fac6c0538a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:54.978 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.963+0000 7fac7f7fe700 1 -- 172.21.15.174:0/2247404263 <== mon.0 v2:172.21.15.174:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fac88061940 con 0x7fac6c0041e0 2020-04-02T23:46:54.978 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.963+0000 7fac8e59c700 1 --2- 172.21.15.174:0/2247404263 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fac6c0513e0 0x7fac6c0538a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:54.978 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.964+0000 7fac8e59c700 1 --2- 172.21.15.174:0/2247404263 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fac6c0513e0 0x7fac6c0538a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fac840015e0 tx=0x7fac84008a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:54.978 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.964+0000 7fac8e59c700 1 --2- 172.21.15.174:0/2247404263 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fac6c0513e0 0x7fac6c0538a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fac840015e0 tx=0x7fac84008a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:54.978 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.964+0000 7fac8e59c700 1 --2- 172.21.15.174:0/2247404263 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fac6c0513e0 0x7fac6c0538a0 secure :-1 s=READY pgs=124 cs=0 l=1 rx=0x7fac840015e0 tx=0x7fac84008a60).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:54.978 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.966+0000 7fac8ed9d700 1 --2- 172.21.15.174:0/2247404263 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fac6c0041e0 0x7fac6c00b750 secure :-1 s=THROTTLE_DONE pgs=226 cs=0 l=1 rx=0x7fac880032b0 tx=0x7fac88007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:54.978 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:54.966+0000 7fac7f7fe700 1 -- 172.21.15.174:0/2247404263 <== mon.0 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fac8803d160 con 0x7fac6c0041e0 2020-04-02T23:46:55.106 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.104+0000 7fac94c3f700 1 -- 172.21.15.174:0/2247404263 --> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fac9005a690 con 0x7fac6c0513e0 2020-04-02T23:46:55.106 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.104+0000 7fac8e59c700 1 --2- 172.21.15.174:0/2247404263 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fac6c0513e0 0x7fac6c0538a0 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7fac840015e0 tx=0x7fac84008a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.106 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.104+0000 7fac7f7fe700 1 -- 172.21.15.174:0/2247404263 <== mgr.4102 v2:172.21.15.196:6800/23210 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fac9005a690 con 0x7fac6c0513e0 2020-04-02T23:46:55.108 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.106+0000 7fac94c3f700 1 -- 172.21.15.174:0/2247404263 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fac6c0513e0 msgr2=0x7fac6c0538a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:55.108 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.106+0000 7fac94c3f700 1 --2- 172.21.15.174:0/2247404263 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fac6c0513e0 0x7fac6c0538a0 secure :-1 s=READY pgs=124 cs=0 l=1 rx=0x7fac840015e0 tx=0x7fac84008a60).stop 2020-04-02T23:46:55.108 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.106+0000 7fac94c3f700 1 -- 172.21.15.174:0/2247404263 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fac6c0041e0 msgr2=0x7fac6c00b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:55.109 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.106+0000 7fac94c3f700 1 --2- 172.21.15.174:0/2247404263 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fac6c0041e0 0x7fac6c00b750 secure :-1 s=READY pgs=226 cs=0 l=1 rx=0x7fac880032b0 tx=0x7fac88007dc0).stop 2020-04-02T23:46:55.109 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.106+0000 7fac94c3f700 1 -- 172.21.15.174:0/2247404263 shutdown_connections 2020-04-02T23:46:55.109 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.106+0000 7fac94c3f700 1 --2- 172.21.15.174:0/2247404263 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fac6c0513e0 0x7fac6c0538a0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:55.109 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.106+0000 7fac94c3f700 1 --2- 172.21.15.174:0/2247404263 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fac6c0041e0 0x7fac6c00b750 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:55.109 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.106+0000 7fac94c3f700 1 -- 172.21.15.174:0/2247404263 >> 172.21.15.174:0/2247404263 conn(0x7fac900aaf80 msgr2=0x7fac900695c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:46:55.109 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.106+0000 7fac94c3f700 1 -- 172.21.15.174:0/2247404263 shutdown_connections 2020-04-02T23:46:55.109 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.106+0000 7fac94c3f700 1 -- 172.21.15.174:0/2247404263 wait complete. 2020-04-02T23:46:55.110 INFO:teuthology.orchestra.run.smithi174.stderr:instructed osd(s) 7 to deep-scrub 2020-04-02T23:46:55.118 INFO:tasks.ceph:Scrubbing osd.0 2020-04-02T23:46:55.119 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:46:55.132 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.0 config set osd_debug_deep_scrub_sleep 0 2020-04-02T23:46:55.281 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.279+0000 7fceaeed6700 1 Processor -- start 2020-04-02T23:46:55.281 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.279+0000 7fceaeed6700 1 -- start start 2020-04-02T23:46:55.287 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.279+0000 7fceaeed6700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fcea80a38f0 0x7fcea8138480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:55.287 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.279+0000 7fceaeed6700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcea81388e0 0x7fcea8134d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:55.287 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.279+0000 7fceaeed6700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcea80a3e30 con 0x7fcea80a7a60 2020-04-02T23:46:55.287 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.279+0000 7fceaeed6700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcea80a40d0 con 0x7fcea80a38f0 2020-04-02T23:46:55.287 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.279+0000 7fceaeed6700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcea80a4370 con 0x7fcea81388e0 2020-04-02T23:46:55.288 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.279+0000 7fcea7fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fcea80a38f0 0x7fcea8138480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:55.288 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.279+0000 7fceacc72700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fcea80a7a60 0x7fcea80a1fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:45594/0 (socket says 172.21.15.174:45594) 2020-04-02T23:46:55.288 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.279+0000 7fceacc72700 1 -- 172.21.15.174:0/309034485 learned_addr learned my addr 172.21.15.174:0/309034485 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:46:55.288 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.280+0000 7fcead473700 1 --2- 172.21.15.174:0/309034485 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcea81388e0 0x7fcea8134d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:55.288 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.280+0000 7fcea7fff700 1 -- 172.21.15.174:0/309034485 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcea81388e0 msgr2=0x7fcea8134d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:46:55.288 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.280+0000 7fcea7fff700 1 --2- 172.21.15.174:0/309034485 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcea81388e0 0x7fcea8134d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:55.288 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.280+0000 7fcea7fff700 1 -- 172.21.15.174:0/309034485 >> v1:172.21.15.174:6789/0 conn(0x7fcea80a7a60 legacy=0x7fcea80a1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:55.289 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.280+0000 7fcea7fff700 1 -- 172.21.15.174:0/309034485 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcea8138d20 con 0x7fcea80a38f0 2020-04-02T23:46:55.289 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.280+0000 7fcea77fe700 1 -- 172.21.15.174:0/309034485 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3282397492 0 0) 0x7fcea80a3e30 con 0x7fcea80a7a60 2020-04-02T23:46:55.289 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.280+0000 7fcead473700 1 --2- 172.21.15.174:0/309034485 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcea81388e0 0x7fcea8134d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-02T23:46:55.289 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.280+0000 7fcea7fff700 1 --2- 172.21.15.174:0/309034485 >> v2:172.21.15.174:3300/0 conn(0x7fcea80a38f0 0x7fcea8138480 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fce9c002f30 tx=0x7fce9c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.289 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.280+0000 7fcea7fff700 1 --2- 172.21.15.174:0/309034485 >> v2:172.21.15.174:3300/0 conn(0x7fcea80a38f0 0x7fcea8138480 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fce9c002f30 tx=0x7fce9c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.289 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.280+0000 7fcea7fff700 1 --2- 172.21.15.174:0/309034485 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcea80a38f0 0x7fcea8138480 secure :-1 s=READY pgs=228 cs=0 l=1 rx=0x7fce9c002f30 tx=0x7fce9c007a40).ready entity=mon.0 client_cookie=1d0013516be8a975 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:55.289 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.280+0000 7fcea7fff700 1 --2- 172.21.15.174:0/309034485 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcea80a38f0 0x7fcea8138480 secure :-1 s=THROTTLE_DONE pgs=228 cs=0 l=1 rx=0x7fce9c002f30 tx=0x7fce9c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.290 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.280+0000 7fcea77fe700 1 -- 172.21.15.174:0/309034485 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce9c011470 con 0x7fcea80a38f0 2020-04-02T23:46:55.290 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.280+0000 7fcea7fff700 1 --2- 172.21.15.174:0/309034485 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcea80a38f0 0x7fcea8138480 secure :-1 s=THROTTLE_DONE pgs=228 cs=0 l=1 rx=0x7fce9c002f30 tx=0x7fce9c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.290 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.280+0000 7fcea7fff700 1 --2- 172.21.15.174:0/309034485 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcea80a38f0 0x7fcea8138480 secure :-1 s=THROTTLE_DONE pgs=228 cs=0 l=1 rx=0x7fce9c002f30 tx=0x7fce9c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.290 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.280+0000 7fcea77fe700 1 -- 172.21.15.174:0/309034485 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce9c0115d0 con 0x7fcea80a38f0 2020-04-02T23:46:55.290 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.280+0000 7fcea77fe700 1 -- 172.21.15.174:0/309034485 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce9c0119b0 con 0x7fcea80a38f0 2020-04-02T23:46:55.290 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.280+0000 7fceaeed6700 1 -- 172.21.15.174:0/309034485 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcea80a38f0 msgr2=0x7fcea8138480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:55.290 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.280+0000 7fceaeed6700 1 --2- 172.21.15.174:0/309034485 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcea80a38f0 0x7fcea8138480 secure :-1 s=READY pgs=228 cs=0 l=1 rx=0x7fce9c002f30 tx=0x7fce9c007a40).stop 2020-04-02T23:46:55.291 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.280+0000 7fceaeed6700 1 -- 172.21.15.174:0/309034485 shutdown_connections 2020-04-02T23:46:55.291 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.280+0000 7fceaeed6700 1 --2- 172.21.15.174:0/309034485 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcea81388e0 0x7fcea8134d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:55.291 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.280+0000 7fceaeed6700 1 --2- 172.21.15.174:0/309034485 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcea80a38f0 0x7fcea8138480 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:55.291 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.280+0000 7fceaeed6700 1 -- 172.21.15.174:0/309034485 >> 172.21.15.174:0/309034485 conn(0x7fcea80aaf80 msgr2=0x7fcea80a6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:46:55.291 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.281+0000 7fceaeed6700 1 -- 172.21.15.174:0/309034485 shutdown_connections 2020-04-02T23:46:55.291 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.281+0000 7fceaeed6700 1 -- 172.21.15.174:0/309034485 wait complete. 2020-04-02T23:46:55.292 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.281+0000 7fceaeed6700 1 Processor -- start 2020-04-02T23:46:55.292 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.281+0000 7fceaeed6700 1 -- start start 2020-04-02T23:46:55.292 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.282+0000 7fceaeed6700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fcea80a38f0 0x7fcea8133c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:55.292 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.282+0000 7fceaeed6700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcea809ef60 con 0x7fcea80a7a60 2020-04-02T23:46:55.292 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.282+0000 7fceaeed6700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcea809f200 con 0x7fcea81388e0 2020-04-02T23:46:55.292 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.282+0000 7fceaeed6700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcea8135a70 con 0x7fcea80a38f0 2020-04-02T23:46:55.292 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.282+0000 7fceacc72700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fcea80a38f0 0x7fcea8133c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:55.293 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.282+0000 7fceacc72700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fcea80a38f0 0x7fcea8133c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:40562/0 (socket says 172.21.15.174:40562) 2020-04-02T23:46:55.293 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.282+0000 7fceacc72700 1 -- 172.21.15.174:0/62978512 learned_addr learned my addr 172.21.15.174:0/62978512 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:46:55.293 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.282+0000 7fceacc72700 1 -- 172.21.15.174:0/62978512 >> v1:172.21.15.196:6789/0 conn(0x7fcea81388e0 legacy=0x7fcea812b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:55.293 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.282+0000 7fceacc72700 1 -- 172.21.15.174:0/62978512 >> v1:172.21.15.174:6789/0 conn(0x7fcea80a7a60 legacy=0x7fcea8134910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:55.293 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.282+0000 7fcea5ffb700 1 -- 172.21.15.174:0/62978512 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 246604311 0 0) 0x7fcea809ef60 con 0x7fcea80a7a60 2020-04-02T23:46:55.293 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.282+0000 7fceacc72700 1 -- 172.21.15.174:0/62978512 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcea8135bb0 con 0x7fcea80a38f0 2020-04-02T23:46:55.293 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.283+0000 7fceacc72700 1 --2- 172.21.15.174:0/62978512 >> v2:172.21.15.174:3300/0 conn(0x7fcea80a38f0 0x7fcea8133c60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcea8131bf0 tx=0x7fce98010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.294 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.283+0000 7fceacc72700 1 --2- 172.21.15.174:0/62978512 >> v2:172.21.15.174:3300/0 conn(0x7fcea80a38f0 0x7fcea8133c60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcea8131bf0 tx=0x7fce98010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.294 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.283+0000 7fceacc72700 1 --2- 172.21.15.174:0/62978512 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcea80a38f0 0x7fcea8133c60 secure :-1 s=READY pgs=230 cs=0 l=1 rx=0x7fcea8131bf0 tx=0x7fce98010a10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:55.294 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.283+0000 7fceacc72700 1 --2- 172.21.15.174:0/62978512 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcea80a38f0 0x7fcea8133c60 secure :-1 s=THROTTLE_DONE pgs=230 cs=0 l=1 rx=0x7fcea8131bf0 tx=0x7fce98010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.294 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.283+0000 7fcea5ffb700 1 -- 172.21.15.174:0/62978512 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce98005ca0 con 0x7fcea80a38f0 2020-04-02T23:46:55.294 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.283+0000 7fceacc72700 1 --2- 172.21.15.174:0/62978512 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcea80a38f0 0x7fcea8133c60 secure :-1 s=THROTTLE_DONE pgs=230 cs=0 l=1 rx=0x7fcea8131bf0 tx=0x7fce98010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.294 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.283+0000 7fcea5ffb700 1 -- 172.21.15.174:0/62978512 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce98005e00 con 0x7fcea80a38f0 2020-04-02T23:46:55.294 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.283+0000 7fceacc72700 1 --2- 172.21.15.174:0/62978512 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcea80a38f0 0x7fcea8133c60 secure :-1 s=THROTTLE_DONE pgs=230 cs=0 l=1 rx=0x7fcea8131bf0 tx=0x7fce98010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.294 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.283+0000 7fceaeed6700 1 -- 172.21.15.174:0/62978512 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcea8136e50 con 0x7fcea80a38f0 2020-04-02T23:46:55.295 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.283+0000 7fcea5ffb700 1 -- 172.21.15.174:0/62978512 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce980062b0 con 0x7fcea80a38f0 2020-04-02T23:46:55.295 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.283+0000 7fceaeed6700 1 -- 172.21.15.174:0/62978512 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcea81351e0 con 0x7fcea80a38f0 2020-04-02T23:46:55.295 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.283+0000 7fceacc72700 1 --2- 172.21.15.174:0/62978512 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcea80a38f0 0x7fcea8133c60 secure :-1 s=THROTTLE_DONE pgs=230 cs=0 l=1 rx=0x7fcea8131bf0 tx=0x7fce98010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.295 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.284+0000 7fceaeed6700 1 -- 172.21.15.174:0/62978512 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcea809f6a0 con 0x7fcea80a38f0 2020-04-02T23:46:55.295 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.284+0000 7fcea5ffb700 1 -- 172.21.15.174:0/62978512 <== mon.0 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fce980064f0 con 0x7fcea80a38f0 2020-04-02T23:46:55.295 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.284+0000 7fceacc72700 1 --2- 172.21.15.174:0/62978512 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcea80a38f0 0x7fcea8133c60 secure :-1 s=THROTTLE_DONE pgs=230 cs=0 l=1 rx=0x7fcea8131bf0 tx=0x7fce98010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.295 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.284+0000 7fceacc72700 1 --2- 172.21.15.174:0/62978512 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcea80a38f0 0x7fcea8133c60 secure :-1 s=THROTTLE_DONE pgs=230 cs=0 l=1 rx=0x7fcea8131bf0 tx=0x7fce98010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.296 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.284+0000 7fcea5ffb700 1 --2- 172.21.15.174:0/62978512 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fce8804d420 0x7fce8804f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:55.296 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.284+0000 7fcea5ffb700 1 -- 172.21.15.174:0/62978512 <== mon.0 v2:172.21.15.174:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fce980610a0 con 0x7fcea80a38f0 2020-04-02T23:46:55.296 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.284+0000 7fcea5ffb700 1 --2- 172.21.15.174:0/62978512 >> [v2:172.21.15.174:6800/24590,v1:172.21.15.174:6801/24590] conn(0x7fce88054000 0x7fce88056420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:55.296 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.284+0000 7fcea5ffb700 1 -- 172.21.15.174:0/62978512 --> [v2:172.21.15.174:6800/24590,v1:172.21.15.174:6801/24590] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fce880569e0 con 0x7fce88054000 2020-04-02T23:46:55.296 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.284+0000 7fcea5ffb700 1 -- 172.21.15.174:0/62978512 <== mon.0 v2:172.21.15.174:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fce980625c0 con 0x7fcea80a38f0 2020-04-02T23:46:55.296 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.284+0000 7fcea7fff700 1 --2- 172.21.15.174:0/62978512 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fce8804d420 0x7fce8804f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:55.296 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.284+0000 7fcead473700 1 --2- 172.21.15.174:0/62978512 >> [v2:172.21.15.174:6800/24590,v1:172.21.15.174:6801/24590] conn(0x7fce88054000 0x7fce88056420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:55.297 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.284+0000 7fcea7fff700 1 --2- 172.21.15.174:0/62978512 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fce8804d420 0x7fce8804f8e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fce9c0088e0 tx=0x7fce9c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.297 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.285+0000 7fcea7fff700 1 --2- 172.21.15.174:0/62978512 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fce8804d420 0x7fce8804f8e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fce9c0088e0 tx=0x7fce9c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.297 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.285+0000 7fcea7fff700 1 --2- 172.21.15.174:0/62978512 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fce8804d420 0x7fce8804f8e0 secure :-1 s=READY pgs=125 cs=0 l=1 rx=0x7fce9c0088e0 tx=0x7fce9c007a40).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:55.297 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.285+0000 7fcead473700 1 --2- 172.21.15.174:0/62978512 >> [v2:172.21.15.174:6800/24590,v1:172.21.15.174:6801/24590] conn(0x7fce88054000 0x7fce88056420 crc :-1 s=READY pgs=10 cs=0 l=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:55.297 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.285+0000 7fcea5ffb700 1 -- 172.21.15.174:0/62978512 <== osd.0 v2:172.21.15.174:6800/24590 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21407 (crc 0 0 0) 0x7fce880569e0 con 0x7fce88054000 2020-04-02T23:46:55.303 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.299+0000 7fceaeed6700 1 -- 172.21.15.174:0/62978512 --> [v2:172.21.15.174:6800/24590,v1:172.21.15.174:6801/24590] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fcea8056c50 con 0x7fce88054000 2020-04-02T23:46:55.303 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.300+0000 7fcea5ffb700 1 -- 172.21.15.174:0/62978512 <== osd.0 v2:172.21.15.174:6800/24590 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fcea8056c50 con 0x7fce88054000 2020-04-02T23:46:55.303 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.300+0000 7fceaeed6700 1 -- 172.21.15.174:0/62978512 >> [v2:172.21.15.174:6800/24590,v1:172.21.15.174:6801/24590] conn(0x7fce88054000 msgr2=0x7fce88056420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:55.303 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.300+0000 7fceaeed6700 1 --2- 172.21.15.174:0/62978512 >> [v2:172.21.15.174:6800/24590,v1:172.21.15.174:6801/24590] conn(0x7fce88054000 0x7fce88056420 crc :-1 s=READY pgs=10 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:55.303 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.300+0000 7fceaeed6700 1 -- 172.21.15.174:0/62978512 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fce8804d420 msgr2=0x7fce8804f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:55.303 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.300+0000 7fceaeed6700 1 --2- 172.21.15.174:0/62978512 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fce8804d420 0x7fce8804f8e0 secure :-1 s=READY pgs=125 cs=0 l=1 rx=0x7fce9c0088e0 tx=0x7fce9c007a40).stop 2020-04-02T23:46:55.303 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.300+0000 7fceaeed6700 1 -- 172.21.15.174:0/62978512 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcea80a38f0 msgr2=0x7fcea8133c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:55.304 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.300+0000 7fceaeed6700 1 --2- 172.21.15.174:0/62978512 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcea80a38f0 0x7fcea8133c60 secure :-1 s=READY pgs=230 cs=0 l=1 rx=0x7fcea8131bf0 tx=0x7fce98010a10).stop 2020-04-02T23:46:55.304 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.300+0000 7fcead473700 1 -- 172.21.15.174:0/62978512 reap_dead start 2020-04-02T23:46:55.304 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.300+0000 7fceaeed6700 1 -- 172.21.15.174:0/62978512 shutdown_connections 2020-04-02T23:46:55.304 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.300+0000 7fceaeed6700 1 --2- 172.21.15.174:0/62978512 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcea80a38f0 0x7fcea8133c60 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:55.304 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.300+0000 7fceaeed6700 1 -- 172.21.15.174:0/62978512 >> 172.21.15.174:0/62978512 conn(0x7fcea80aaf80 msgr2=0x7fcea81381a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:46:55.304 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.300+0000 7fceaeed6700 1 -- 172.21.15.174:0/62978512 shutdown_connections 2020-04-02T23:46:55.304 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.300+0000 7fceaeed6700 1 -- 172.21.15.174:0/62978512 wait complete. 2020-04-02T23:46:55.305 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2020-04-02T23:46:55.305 INFO:teuthology.orchestra.run.smithi174.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-04-02T23:46:55.305 INFO:teuthology.orchestra.run.smithi174.stdout:} 2020-04-02T23:46:55.312 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:46:55.325 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd deep-scrub 0 2020-04-02T23:46:55.473 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.470+0000 7f010d10d700 1 Processor -- start 2020-04-02T23:46:55.473 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.470+0000 7f010d10d700 1 -- start start 2020-04-02T23:46:55.475 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.471+0000 7f010d10d700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f010805bf90 0x7f010809e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:55.475 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.471+0000 7f010d10d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f01081391b0 0x7f01081395d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:55.476 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.471+0000 7f010d10d700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01080a2a70 con 0x7f010809ec70 2020-04-02T23:46:55.476 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.471+0000 7f010d10d700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f010809e140 con 0x7f01081391b0 2020-04-02T23:46:55.476 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.471+0000 7f010d10d700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f010809e3e0 con 0x7f010805bf90 2020-04-02T23:46:55.476 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.471+0000 7f010c90c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f01081391b0 0x7f01081395d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:55.476 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.471+0000 7f010c90c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f01081391b0 0x7f01081395d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:40574/0 (socket says 172.21.15.174:40574) 2020-04-02T23:46:55.476 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.471+0000 7f010c90c700 1 -- 172.21.15.174:0/3918160898 learned_addr learned my addr 172.21.15.174:0/3918160898 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:46:55.477 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.471+0000 7f0107fff700 1 --2- 172.21.15.174:0/3918160898 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f010805bf90 0x7f010809e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:55.477 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.472+0000 7f010c90c700 1 -- 172.21.15.174:0/3918160898 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f010805bf90 msgr2=0x7f010809e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:46:55.477 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.472+0000 7f010c90c700 1 --2- 172.21.15.174:0/3918160898 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f010805bf90 0x7f010809e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:55.477 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.472+0000 7f010c90c700 1 -- 172.21.15.174:0/3918160898 >> v1:172.21.15.196:6789/0 conn(0x7f010809ec70 legacy=0x7f0108138aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:55.477 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.472+0000 7f010c90c700 1 -- 172.21.15.174:0/3918160898 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01080a65b0 con 0x7f01081391b0 2020-04-02T23:46:55.477 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.472+0000 7f010c90c700 1 --2- 172.21.15.174:0/3918160898 >> v2:172.21.15.174:3300/0 conn(0x7f01081391b0 0x7f01081395d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f01000032b0 tx=0x7f0100007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.478 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.472+0000 7f010c90c700 1 --2- 172.21.15.174:0/3918160898 >> v2:172.21.15.174:3300/0 conn(0x7f01081391b0 0x7f01081395d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f01000032b0 tx=0x7f0100007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.478 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.472+0000 7f010c90c700 1 --2- 172.21.15.174:0/3918160898 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f01081391b0 0x7f01081395d0 secure :-1 s=READY pgs=231 cs=0 l=1 rx=0x7f01000032b0 tx=0x7f0100007dc0).ready entity=mon.0 client_cookie=1b2190cb04cc1929 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:55.478 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.472+0000 7f010c90c700 1 --2- 172.21.15.174:0/3918160898 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f01081391b0 0x7f01081395d0 secure :-1 s=THROTTLE_DONE pgs=231 cs=0 l=1 rx=0x7f01000032b0 tx=0x7f0100007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.478 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.472+0000 7f0106ffd700 1 -- 172.21.15.174:0/3918160898 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f010000a160 con 0x7f01081391b0 2020-04-02T23:46:55.478 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.472+0000 7f010c90c700 1 --2- 172.21.15.174:0/3918160898 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f01081391b0 0x7f01081395d0 secure :-1 s=THROTTLE_DONE pgs=231 cs=0 l=1 rx=0x7f01000032b0 tx=0x7f0100007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.478 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.472+0000 7f0106ffd700 1 -- 172.21.15.174:0/3918160898 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f010000a2c0 con 0x7f01081391b0 2020-04-02T23:46:55.478 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.472+0000 7f010c90c700 1 --2- 172.21.15.174:0/3918160898 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f01081391b0 0x7f01081395d0 secure :-1 s=THROTTLE_DONE pgs=231 cs=0 l=1 rx=0x7f01000032b0 tx=0x7f0100007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.478 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.472+0000 7f0106ffd700 1 -- 172.21.15.174:0/3918160898 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f010000a6e0 con 0x7f01081391b0 2020-04-02T23:46:55.479 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.472+0000 7f010d10d700 1 -- 172.21.15.174:0/3918160898 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f01081391b0 msgr2=0x7f01081395d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:55.479 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.472+0000 7f010d10d700 1 --2- 172.21.15.174:0/3918160898 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f01081391b0 0x7f01081395d0 secure :-1 s=READY pgs=231 cs=0 l=1 rx=0x7f01000032b0 tx=0x7f0100007dc0).stop 2020-04-02T23:46:55.479 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.472+0000 7f010d10d700 1 -- 172.21.15.174:0/3918160898 shutdown_connections 2020-04-02T23:46:55.479 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.472+0000 7f010d10d700 1 --2- 172.21.15.174:0/3918160898 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f01081391b0 0x7f01081395d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:55.479 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.472+0000 7f010d10d700 1 --2- 172.21.15.174:0/3918160898 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f010805bf90 0x7f010809e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:55.479 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.472+0000 7f010d10d700 1 -- 172.21.15.174:0/3918160898 >> 172.21.15.174:0/3918160898 conn(0x7f01080a6d00 msgr2=0x7f01080a7110 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:46:55.479 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.472+0000 7f010d10d700 1 -- 172.21.15.174:0/3918160898 shutdown_connections 2020-04-02T23:46:55.480 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.472+0000 7f010d10d700 1 -- 172.21.15.174:0/3918160898 wait complete. 2020-04-02T23:46:55.480 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.473+0000 7f010d10d700 1 Processor -- start 2020-04-02T23:46:55.480 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.473+0000 7f010d10d700 1 -- start start 2020-04-02T23:46:55.483 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.474+0000 7f010d10d700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f010809ec70 0x7f010809bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:55.483 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.474+0000 7f010d10d700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f01081391b0 0x7f010809c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:55.483 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.474+0000 7f010d10d700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0108064d90 con 0x7f010805bf90 2020-04-02T23:46:55.483 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.474+0000 7f010d10d700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01080a0410 con 0x7f01081391b0 2020-04-02T23:46:55.483 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.474+0000 7f010d10d700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f010809ce30 con 0x7f010809ec70 2020-04-02T23:46:55.484 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.474+0000 7f01077fe700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f010809ec70 0x7f010809bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:55.484 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.474+0000 7f010c90c700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f01081391b0 0x7f010809c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:55.484 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.474+0000 7f0107fff700 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f010805bf90 0x7f010812cef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.174:51710/0 (socket says 172.21.15.174:51710) 2020-04-02T23:46:55.484 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.474+0000 7f01077fe700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f010809ec70 0x7f010809bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.174:35168/0 (socket says 172.21.15.174:35168) 2020-04-02T23:46:55.484 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.474+0000 7f0107fff700 1 -- 172.21.15.174:0/2365896170 learned_addr learned my addr 172.21.15.174:0/2365896170 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:46:55.484 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.474+0000 7f01077fe700 1 -- 172.21.15.174:0/2365896170 >> v2:172.21.15.196:3300/0 conn(0x7f01081391b0 msgr2=0x7f010809c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:55.484 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.474+0000 7f01077fe700 1 --2- 172.21.15.174:0/2365896170 >> v2:172.21.15.196:3300/0 conn(0x7f01081391b0 0x7f010809c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:55.485 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.474+0000 7f01077fe700 1 -- 172.21.15.174:0/2365896170 >> v1:172.21.15.196:6789/0 conn(0x7f010805bf90 legacy=0x7f010812cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:55.485 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.474+0000 7f01077fe700 1 -- 172.21.15.174:0/2365896170 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01080a9f30 con 0x7f010809ec70 2020-04-02T23:46:55.485 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.475+0000 7f01077fe700 1 --2- 172.21.15.174:0/2365896170 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f010809ec70 0x7f010809bd50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f010805f350 tx=0x7f00f0001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.485 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.475+0000 7f01077fe700 1 --2- 172.21.15.174:0/2365896170 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f010809ec70 0x7f010809bd50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f010805f350 tx=0x7f00f0001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.485 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.475+0000 7f01077fe700 1 --2- 172.21.15.174:0/2365896170 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f010809ec70 0x7f010809bd50 secure :-1 s=READY pgs=44 cs=0 l=1 rx=0x7f010805f350 tx=0x7f00f0001e40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:55.485 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.475+0000 7f01077fe700 1 --2- 172.21.15.174:0/2365896170 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f010809ec70 0x7f010809bd50 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7f010805f350 tx=0x7f00f0001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.485 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.475+0000 7f01057fa700 1 -- 172.21.15.174:0/2365896170 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00f000cbf0 con 0x7f010809ec70 2020-04-02T23:46:55.485 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.475+0000 7f01077fe700 1 --2- 172.21.15.174:0/2365896170 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f010809ec70 0x7f010809bd50 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7f010805f350 tx=0x7f00f0001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.486 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.475+0000 7f01057fa700 1 -- 172.21.15.174:0/2365896170 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00f000cd50 con 0x7f010809ec70 2020-04-02T23:46:55.486 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.475+0000 7f01077fe700 1 --2- 172.21.15.174:0/2365896170 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f010809ec70 0x7f010809bd50 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7f010805f350 tx=0x7f00f0001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.486 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.475+0000 7f010d10d700 1 -- 172.21.15.174:0/2365896170 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01080a9c90 con 0x7f010809ec70 2020-04-02T23:46:55.486 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.475+0000 7f01057fa700 1 -- 172.21.15.174:0/2365896170 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00f0011100 con 0x7f010809ec70 2020-04-02T23:46:55.486 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.475+0000 7f010d10d700 1 -- 172.21.15.174:0/2365896170 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0108140810 con 0x7f010809ec70 2020-04-02T23:46:55.486 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.475+0000 7f01077fe700 1 --2- 172.21.15.174:0/2365896170 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f010809ec70 0x7f010809bd50 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7f010805f350 tx=0x7f00f0001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.486 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.476+0000 7f010d10d700 1 -- 172.21.15.174:0/2365896170 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0108056c50 con 0x7f010809ec70 2020-04-02T23:46:55.487 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.476+0000 7f01057fa700 1 -- 172.21.15.174:0/2365896170 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f00f00064e0 con 0x7f010809ec70 2020-04-02T23:46:55.487 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.476+0000 7f01077fe700 1 --2- 172.21.15.174:0/2365896170 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f010809ec70 0x7f010809bd50 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7f010805f350 tx=0x7f00f0001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.487 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.476+0000 7f01057fa700 1 --2- 172.21.15.174:0/2365896170 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f00ec04d500 0x7f00ec04f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:55.487 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.476+0000 7f01057fa700 1 -- 172.21.15.174:0/2365896170 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f00f0060a80 con 0x7f010809ec70 2020-04-02T23:46:55.487 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.476+0000 7f0107fff700 1 --2- 172.21.15.174:0/2365896170 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f00ec04d500 0x7f00ec04f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:55.487 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.477+0000 7f0107fff700 1 --2- 172.21.15.174:0/2365896170 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f00ec04d500 0x7f00ec04f9c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f010812e870 tx=0x7f00f800c800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.487 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.477+0000 7f0107fff700 1 --2- 172.21.15.174:0/2365896170 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f00ec04d500 0x7f00ec04f9c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f010812e870 tx=0x7f00f800c800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.487 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.477+0000 7f0107fff700 1 --2- 172.21.15.174:0/2365896170 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f00ec04d500 0x7f00ec04f9c0 secure :-1 s=READY pgs=126 cs=0 l=1 rx=0x7f010812e870 tx=0x7f00f800c800).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:55.488 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.480+0000 7f01077fe700 1 --2- 172.21.15.174:0/2365896170 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f010809ec70 0x7f010809bd50 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7f010805f350 tx=0x7f00f0001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.488 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.480+0000 7f01057fa700 1 -- 172.21.15.174:0/2365896170 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f00f003c160 con 0x7f010809ec70 2020-04-02T23:46:55.621 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.619+0000 7f010d10d700 1 -- 172.21.15.174:0/2365896170 --> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f01080a3130 con 0x7f00ec04d500 2020-04-02T23:46:55.621 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.619+0000 7f0107fff700 1 --2- 172.21.15.174:0/2365896170 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f00ec04d500 0x7f00ec04f9c0 secure :-1 s=THROTTLE_DONE pgs=126 cs=0 l=1 rx=0x7f010812e870 tx=0x7f00f800c800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.622 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.619+0000 7f01057fa700 1 -- 172.21.15.174:0/2365896170 <== mgr.4102 v2:172.21.15.196:6800/23210 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f01080a3130 con 0x7f00ec04d500 2020-04-02T23:46:55.623 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.621+0000 7f010d10d700 1 -- 172.21.15.174:0/2365896170 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f00ec04d500 msgr2=0x7f00ec04f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:55.624 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.621+0000 7f010d10d700 1 --2- 172.21.15.174:0/2365896170 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f00ec04d500 0x7f00ec04f9c0 secure :-1 s=READY pgs=126 cs=0 l=1 rx=0x7f010812e870 tx=0x7f00f800c800).stop 2020-04-02T23:46:55.624 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.621+0000 7f010d10d700 1 -- 172.21.15.174:0/2365896170 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f010809ec70 msgr2=0x7f010809bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:55.624 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.621+0000 7f010d10d700 1 --2- 172.21.15.174:0/2365896170 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f010809ec70 0x7f010809bd50 secure :-1 s=READY pgs=44 cs=0 l=1 rx=0x7f010805f350 tx=0x7f00f0001e40).stop 2020-04-02T23:46:55.624 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.621+0000 7f010d10d700 1 -- 172.21.15.174:0/2365896170 shutdown_connections 2020-04-02T23:46:55.624 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.621+0000 7f010d10d700 1 --2- 172.21.15.174:0/2365896170 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f00ec04d500 0x7f00ec04f9c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:55.624 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.621+0000 7f010d10d700 1 --2- 172.21.15.174:0/2365896170 >> v2:172.21.15.196:3300/0 conn(0x7f01081391b0 0x7f010809c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:55.625 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.621+0000 7f010d10d700 1 --2- 172.21.15.174:0/2365896170 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f010809ec70 0x7f010809bd50 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:55.625 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.621+0000 7f010d10d700 1 -- 172.21.15.174:0/2365896170 >> 172.21.15.174:0/2365896170 conn(0x7f01080a6d00 msgr2=0x7f01080a55d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:46:55.625 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.621+0000 7f010d10d700 1 -- 172.21.15.174:0/2365896170 shutdown_connections 2020-04-02T23:46:55.625 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.621+0000 7f010d10d700 1 -- 172.21.15.174:0/2365896170 wait complete. 2020-04-02T23:46:55.625 INFO:teuthology.orchestra.run.smithi174.stderr:instructed osd(s) 0 to deep-scrub 2020-04-02T23:46:55.633 INFO:tasks.ceph:Scrubbing osd.1 2020-04-02T23:46:55.634 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:46:55.647 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.1 config set osd_debug_deep_scrub_sleep 0 2020-04-02T23:46:55.795 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.793+0000 7fe86f292700 1 Processor -- start 2020-04-02T23:46:55.796 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.793+0000 7fe86f292700 1 -- start start 2020-04-02T23:46:55.803 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.794+0000 7fe86f292700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fe8680a5f00 0x7fe8680a9a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:55.803 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.794+0000 7fe86f292700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe8680a62e0 0x7fe86805ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:55.803 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.794+0000 7fe86f292700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe86813b600 0x7fe86813ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:55.803 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.794+0000 7fe86f292700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8680aa720 con 0x7fe8680a62e0 2020-04-02T23:46:55.803 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.794+0000 7fe86f292700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8680a6770 con 0x7fe8680a5f00 2020-04-02T23:46:55.803 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.794+0000 7fe86f292700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8680a9150 con 0x7fe86813b600 2020-04-02T23:46:55.804 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.794+0000 7fe86c82d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe8680a62e0 0x7fe86805ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:55.804 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.794+0000 7fe86c82d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe8680a62e0 0x7fe86805ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:40586/0 (socket says 172.21.15.174:40586) 2020-04-02T23:46:55.804 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.794+0000 7fe86c82d700 1 -- 172.21.15.174:0/668507339 learned_addr learned my addr 172.21.15.174:0/668507339 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:46:55.804 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.794+0000 7fe86d82f700 1 --2- 172.21.15.174:0/668507339 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe86813b600 0x7fe86813ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:55.804 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.794+0000 7fe86c82d700 1 -- 172.21.15.174:0/668507339 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe86813b600 msgr2=0x7fe86813ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:46:55.804 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.794+0000 7fe86c82d700 1 --2- 172.21.15.174:0/668507339 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe86813b600 0x7fe86813ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:55.804 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.794+0000 7fe86d02e700 1 --2- 172.21.15.174:0/668507339 >> v2:172.21.15.196:3300/0 conn(0x7fe8680a5f00 0x7fe8680a9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:55.805 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.794+0000 7fe86c82d700 1 -- 172.21.15.174:0/668507339 >> v2:172.21.15.196:3300/0 conn(0x7fe8680a5f00 msgr2=0x7fe8680a9a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:46:55.805 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.794+0000 7fe86c82d700 1 --2- 172.21.15.174:0/668507339 >> v2:172.21.15.196:3300/0 conn(0x7fe8680a5f00 0x7fe8680a9a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:55.805 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.794+0000 7fe86c82d700 1 -- 172.21.15.174:0/668507339 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe86805c3b0 con 0x7fe8680a62e0 2020-04-02T23:46:55.805 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.794+0000 7fe86d02e700 1 --2- 172.21.15.174:0/668507339 >> v2:172.21.15.196:3300/0 conn(0x7fe8680a5f00 0x7fe8680a9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-02T23:46:55.805 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.794+0000 7fe86c82d700 1 --2- 172.21.15.174:0/668507339 >> v2:172.21.15.174:3300/0 conn(0x7fe8680a62e0 0x7fe86805ffc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe8680a68b0 tx=0x7fe8640088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.806 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.794+0000 7fe86c82d700 1 --2- 172.21.15.174:0/668507339 >> v2:172.21.15.174:3300/0 conn(0x7fe8680a62e0 0x7fe86805ffc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe8680a68b0 tx=0x7fe8640088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.806 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.794+0000 7fe86c82d700 1 --2- 172.21.15.174:0/668507339 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe8680a62e0 0x7fe86805ffc0 secure :-1 s=READY pgs=232 cs=0 l=1 rx=0x7fe8680a68b0 tx=0x7fe8640088e0).ready entity=mon.0 client_cookie=3cb3fc0ea6034ae7 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:55.806 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.795+0000 7fe86c82d700 1 --2- 172.21.15.174:0/668507339 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe8680a62e0 0x7fe86805ffc0 secure :-1 s=THROTTLE_DONE pgs=232 cs=0 l=1 rx=0x7fe8680a68b0 tx=0x7fe8640088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.806 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.795+0000 7fe857fff700 1 -- 172.21.15.174:0/668507339 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe864011720 con 0x7fe8680a62e0 2020-04-02T23:46:55.806 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.795+0000 7fe86c82d700 1 --2- 172.21.15.174:0/668507339 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe8680a62e0 0x7fe86805ffc0 secure :-1 s=THROTTLE_DONE pgs=232 cs=0 l=1 rx=0x7fe8680a68b0 tx=0x7fe8640088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.806 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.795+0000 7fe86c82d700 1 --2- 172.21.15.174:0/668507339 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe8680a62e0 0x7fe86805ffc0 secure :-1 s=THROTTLE_DONE pgs=232 cs=0 l=1 rx=0x7fe8680a68b0 tx=0x7fe8640088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.807 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.795+0000 7fe857fff700 1 -- 172.21.15.174:0/668507339 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe864011880 con 0x7fe8680a62e0 2020-04-02T23:46:55.807 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.795+0000 7fe857fff700 1 -- 172.21.15.174:0/668507339 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe864011c60 con 0x7fe8680a62e0 2020-04-02T23:46:55.807 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.795+0000 7fe86f292700 1 -- 172.21.15.174:0/668507339 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe8680a62e0 msgr2=0x7fe86805ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:55.807 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.795+0000 7fe86f292700 1 --2- 172.21.15.174:0/668507339 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe8680a62e0 0x7fe86805ffc0 secure :-1 s=READY pgs=232 cs=0 l=1 rx=0x7fe8680a68b0 tx=0x7fe8640088e0).stop 2020-04-02T23:46:55.807 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.795+0000 7fe86f292700 1 -- 172.21.15.174:0/668507339 shutdown_connections 2020-04-02T23:46:55.807 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.795+0000 7fe86f292700 1 --2- 172.21.15.174:0/668507339 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe86813b600 0x7fe86813ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:55.808 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.795+0000 7fe86f292700 1 --2- 172.21.15.174:0/668507339 >> v2:172.21.15.196:3300/0 conn(0x7fe8680a5f00 0x7fe8680a9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:55.808 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.795+0000 7fe86f292700 1 --2- 172.21.15.174:0/668507339 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe8680a62e0 0x7fe86805ffc0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:55.808 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.795+0000 7fe86f292700 1 -- 172.21.15.174:0/668507339 >> 172.21.15.174:0/668507339 conn(0x7fe8680ab320 msgr2=0x7fe8680ab730 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:46:55.808 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.795+0000 7fe86f292700 1 -- 172.21.15.174:0/668507339 shutdown_connections 2020-04-02T23:46:55.808 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.795+0000 7fe86f292700 1 -- 172.21.15.174:0/668507339 wait complete. 2020-04-02T23:46:55.808 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.796+0000 7fe86f292700 1 Processor -- start 2020-04-02T23:46:55.808 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.796+0000 7fe86f292700 1 -- start start 2020-04-02T23:46:55.809 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.797+0000 7fe86f292700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe8680a62e0 0x7fe868137650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:55.809 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.797+0000 7fe86f292700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8681353e0 con 0x7fe8680a5f00 2020-04-02T23:46:55.809 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.797+0000 7fe86f292700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe868135680 con 0x7fe86813b600 2020-04-02T23:46:55.809 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.797+0000 7fe86f292700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe868136810 con 0x7fe8680a62e0 2020-04-02T23:46:55.809 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.797+0000 7fe86c82d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe8680a62e0 0x7fe868137650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:55.809 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.797+0000 7fe86c82d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe8680a62e0 0x7fe868137650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:40592/0 (socket says 172.21.15.174:40592) 2020-04-02T23:46:55.810 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.797+0000 7fe86c82d700 1 -- 172.21.15.174:0/2068414936 learned_addr learned my addr 172.21.15.174:0/2068414936 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:46:55.810 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.797+0000 7fe86d02e700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fe8680a5f00 0x7fe86812e9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:45628/0 (socket says 172.21.15.174:45628) 2020-04-02T23:46:55.810 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.797+0000 7fe86c82d700 1 -- 172.21.15.174:0/2068414936 >> v1:172.21.15.196:6789/0 conn(0x7fe86813b600 legacy=0x7fe86814fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:55.810 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.797+0000 7fe86c82d700 1 -- 172.21.15.174:0/2068414936 >> v1:172.21.15.174:6789/0 conn(0x7fe8680a5f00 legacy=0x7fe86812e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:55.810 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.797+0000 7fe86c82d700 1 -- 172.21.15.174:0/2068414936 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8681358c0 con 0x7fe8680a62e0 2020-04-02T23:46:55.810 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.797+0000 7fe8567fc700 1 -- 172.21.15.174:0/2068414936 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2192128731 0 0) 0x7fe8681353e0 con 0x7fe8680a5f00 2020-04-02T23:46:55.810 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.797+0000 7fe86c82d700 1 --2- 172.21.15.174:0/2068414936 >> v2:172.21.15.174:3300/0 conn(0x7fe8680a62e0 0x7fe868137650 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe8680a68b0 tx=0x7fe8680ac6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.811 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.797+0000 7fe86c82d700 1 --2- 172.21.15.174:0/2068414936 >> v2:172.21.15.174:3300/0 conn(0x7fe8680a62e0 0x7fe868137650 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe8680a68b0 tx=0x7fe8680ac6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.811 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.797+0000 7fe86c82d700 1 --2- 172.21.15.174:0/2068414936 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe8680a62e0 0x7fe868137650 secure :-1 s=READY pgs=234 cs=0 l=1 rx=0x7fe8680a68b0 tx=0x7fe8680ac6e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:55.811 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.797+0000 7fe86c82d700 1 --2- 172.21.15.174:0/2068414936 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe8680a62e0 0x7fe868137650 secure :-1 s=THROTTLE_DONE pgs=234 cs=0 l=1 rx=0x7fe8680a68b0 tx=0x7fe8680ac6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.811 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.797+0000 7fe8567fc700 1 -- 172.21.15.174:0/2068414936 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe8640058b0 con 0x7fe8680a62e0 2020-04-02T23:46:55.811 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.797+0000 7fe86c82d700 1 --2- 172.21.15.174:0/2068414936 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe8680a62e0 0x7fe868137650 secure :-1 s=THROTTLE_DONE pgs=234 cs=0 l=1 rx=0x7fe8680a68b0 tx=0x7fe8680ac6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.811 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.797+0000 7fe86c82d700 1 --2- 172.21.15.174:0/2068414936 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe8680a62e0 0x7fe868137650 secure :-1 s=THROTTLE_DONE pgs=234 cs=0 l=1 rx=0x7fe8680a68b0 tx=0x7fe8680ac6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.812 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.797+0000 7fe8567fc700 1 -- 172.21.15.174:0/2068414936 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe864005a10 con 0x7fe8680a62e0 2020-04-02T23:46:55.812 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.797+0000 7fe8567fc700 1 -- 172.21.15.174:0/2068414936 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe864005db0 con 0x7fe8680a62e0 2020-04-02T23:46:55.812 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.797+0000 7fe86f292700 1 -- 172.21.15.174:0/2068414936 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8680a7530 con 0x7fe8680a62e0 2020-04-02T23:46:55.812 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.798+0000 7fe86f292700 1 -- 172.21.15.174:0/2068414936 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe868138ed0 con 0x7fe8680a62e0 2020-04-02T23:46:55.812 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.798+0000 7fe86c82d700 1 --2- 172.21.15.174:0/2068414936 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe8680a62e0 0x7fe868137650 secure :-1 s=THROTTLE_DONE pgs=234 cs=0 l=1 rx=0x7fe8680a68b0 tx=0x7fe8680ac6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.812 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.798+0000 7fe86f292700 1 -- 172.21.15.174:0/2068414936 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe868133280 con 0x7fe8680a62e0 2020-04-02T23:46:55.812 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.798+0000 7fe8567fc700 1 -- 172.21.15.174:0/2068414936 <== mon.0 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fe864015250 con 0x7fe8680a62e0 2020-04-02T23:46:55.813 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.798+0000 7fe86c82d700 1 --2- 172.21.15.174:0/2068414936 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe8680a62e0 0x7fe868137650 secure :-1 s=THROTTLE_DONE pgs=234 cs=0 l=1 rx=0x7fe8680a68b0 tx=0x7fe8680ac6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.813 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.798+0000 7fe86c82d700 1 --2- 172.21.15.174:0/2068414936 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe8680a62e0 0x7fe868137650 secure :-1 s=THROTTLE_DONE pgs=234 cs=0 l=1 rx=0x7fe8680a68b0 tx=0x7fe8680ac6e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.813 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.799+0000 7fe8567fc700 1 --2- 172.21.15.174:0/2068414936 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fe84804d420 0x7fe84804f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:55.813 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.799+0000 7fe8567fc700 1 -- 172.21.15.174:0/2068414936 <== mon.0 v2:172.21.15.174:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe864061290 con 0x7fe8680a62e0 2020-04-02T23:46:55.813 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.799+0000 7fe8567fc700 1 --2- 172.21.15.174:0/2068414936 >> [v2:172.21.15.174:6808/24754,v1:172.21.15.174:6809/24754] conn(0x7fe848054000 0x7fe848056420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:55.813 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.799+0000 7fe8567fc700 1 -- 172.21.15.174:0/2068414936 --> [v2:172.21.15.174:6808/24754,v1:172.21.15.174:6809/24754] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe8480569e0 con 0x7fe848054000 2020-04-02T23:46:55.814 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.799+0000 7fe8567fc700 1 -- 172.21.15.174:0/2068414936 <== mon.0 v2:172.21.15.174:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe8640626f0 con 0x7fe8680a62e0 2020-04-02T23:46:55.814 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.799+0000 7fe86d02e700 1 --2- 172.21.15.174:0/2068414936 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fe84804d420 0x7fe84804f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:55.814 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.799+0000 7fe86d82f700 1 --2- 172.21.15.174:0/2068414936 >> [v2:172.21.15.174:6808/24754,v1:172.21.15.174:6809/24754] conn(0x7fe848054000 0x7fe848056420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:55.814 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.799+0000 7fe86d02e700 1 --2- 172.21.15.174:0/2068414936 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fe84804d420 0x7fe84804f8e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe858003070 tx=0x7fe8680445b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.814 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.799+0000 7fe86d02e700 1 --2- 172.21.15.174:0/2068414936 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fe84804d420 0x7fe84804f8e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe858003070 tx=0x7fe8680445b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.814 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.799+0000 7fe86d82f700 1 --2- 172.21.15.174:0/2068414936 >> [v2:172.21.15.174:6808/24754,v1:172.21.15.174:6809/24754] conn(0x7fe848054000 0x7fe848056420 crc :-1 s=READY pgs=9 cs=0 l=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:55.815 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.799+0000 7fe86d02e700 1 --2- 172.21.15.174:0/2068414936 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fe84804d420 0x7fe84804f8e0 secure :-1 s=READY pgs=127 cs=0 l=1 rx=0x7fe858003070 tx=0x7fe8680445b0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:55.815 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.800+0000 7fe8567fc700 1 -- 172.21.15.174:0/2068414936 <== osd.1 v2:172.21.15.174:6808/24754 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21407 (crc 0 0 0) 0x7fe8480569e0 con 0x7fe848054000 2020-04-02T23:46:55.816 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.814+0000 7fe86f292700 1 -- 172.21.15.174:0/2068414936 --> [v2:172.21.15.174:6808/24754,v1:172.21.15.174:6809/24754] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe8681369e0 con 0x7fe848054000 2020-04-02T23:46:55.816 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.814+0000 7fe8567fc700 1 -- 172.21.15.174:0/2068414936 <== osd.1 v2:172.21.15.174:6808/24754 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fe8681369e0 con 0x7fe848054000 2020-04-02T23:46:55.816 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2020-04-02T23:46:55.817 INFO:teuthology.orchestra.run.smithi174.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-04-02T23:46:55.817 INFO:teuthology.orchestra.run.smithi174.stdout:} 2020-04-02T23:46:55.818 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.814+0000 7fe86f292700 1 -- 172.21.15.174:0/2068414936 >> [v2:172.21.15.174:6808/24754,v1:172.21.15.174:6809/24754] conn(0x7fe848054000 msgr2=0x7fe848056420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:55.818 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.814+0000 7fe86f292700 1 --2- 172.21.15.174:0/2068414936 >> [v2:172.21.15.174:6808/24754,v1:172.21.15.174:6809/24754] conn(0x7fe848054000 0x7fe848056420 crc :-1 s=READY pgs=9 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:55.818 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.814+0000 7fe86f292700 1 -- 172.21.15.174:0/2068414936 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fe84804d420 msgr2=0x7fe84804f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:55.818 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.814+0000 7fe86f292700 1 --2- 172.21.15.174:0/2068414936 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fe84804d420 0x7fe84804f8e0 secure :-1 s=READY pgs=127 cs=0 l=1 rx=0x7fe858003070 tx=0x7fe8680445b0).stop 2020-04-02T23:46:55.819 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.814+0000 7fe86f292700 1 -- 172.21.15.174:0/2068414936 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe8680a62e0 msgr2=0x7fe868137650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:55.819 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.814+0000 7fe86f292700 1 --2- 172.21.15.174:0/2068414936 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe8680a62e0 0x7fe868137650 secure :-1 s=READY pgs=234 cs=0 l=1 rx=0x7fe8680a68b0 tx=0x7fe8680ac6e0).stop 2020-04-02T23:46:55.819 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.814+0000 7fe86d82f700 1 -- 172.21.15.174:0/2068414936 reap_dead start 2020-04-02T23:46:55.819 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.814+0000 7fe86f292700 1 -- 172.21.15.174:0/2068414936 shutdown_connections 2020-04-02T23:46:55.819 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.814+0000 7fe86f292700 1 --2- 172.21.15.174:0/2068414936 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe8680a62e0 0x7fe868137650 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:55.819 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.814+0000 7fe86f292700 1 -- 172.21.15.174:0/2068414936 >> 172.21.15.174:0/2068414936 conn(0x7fe8680ab320 msgr2=0x7fe868131f40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:46:55.819 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.815+0000 7fe86f292700 1 -- 172.21.15.174:0/2068414936 shutdown_connections 2020-04-02T23:46:55.820 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.815+0000 7fe86f292700 1 -- 172.21.15.174:0/2068414936 wait complete. 2020-04-02T23:46:55.826 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:46:55.840 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd deep-scrub 1 2020-04-02T23:46:55.992 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.983+0000 7f6d572b1700 1 Processor -- start 2020-04-02T23:46:55.992 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.984+0000 7f6d572b1700 1 -- start start 2020-04-02T23:46:55.993 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.984+0000 7f6d572b1700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6d500a5900 0x7f6d50135030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:55.993 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.984+0000 7f6d572b1700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f6d5012e970 0x7f6d5013ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:55.993 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.984+0000 7f6d572b1700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d50134420 con 0x7f6d5005ac00 2020-04-02T23:46:55.993 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.984+0000 7f6d572b1700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d5005b0b0 con 0x7f6d500a5900 2020-04-02T23:46:55.993 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.984+0000 7f6d572b1700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d500a49d0 con 0x7f6d5012e970 2020-04-02T23:46:55.993 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.984+0000 7f6d5504d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6d500a5900 0x7f6d50135030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:55.994 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.984+0000 7f6d5504d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6d500a5900 0x7f6d50135030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:40600/0 (socket says 172.21.15.174:40600) 2020-04-02T23:46:55.994 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.984+0000 7f6d5504d700 1 -- 172.21.15.174:0/4063106595 learned_addr learned my addr 172.21.15.174:0/4063106595 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:46:55.994 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.984+0000 7f6d5584e700 1 --2- 172.21.15.174:0/4063106595 >> v2:172.21.15.196:3300/0 conn(0x7f6d5012e970 0x7f6d5013ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:55.994 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.985+0000 7f6d5504d700 1 -- 172.21.15.174:0/4063106595 >> v2:172.21.15.196:3300/0 conn(0x7f6d5012e970 msgr2=0x7f6d5013ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:46:55.994 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.985+0000 7f6d5504d700 1 --2- 172.21.15.174:0/4063106595 >> v2:172.21.15.196:3300/0 conn(0x7f6d5012e970 0x7f6d5013ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:55.994 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.985+0000 7f6d5504d700 1 -- 172.21.15.174:0/4063106595 >> v1:172.21.15.196:6789/0 conn(0x7f6d5005ac00 legacy=0x7f6d5012e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:55.995 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.985+0000 7f6d5504d700 1 -- 172.21.15.174:0/4063106595 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d50134650 con 0x7f6d500a5900 2020-04-02T23:46:55.995 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.985+0000 7f6d5504d700 1 --2- 172.21.15.174:0/4063106595 >> v2:172.21.15.174:3300/0 conn(0x7f6d500a5900 0x7f6d50135030 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6d40002f30 tx=0x7f6d40007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.995 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.985+0000 7f6d5504d700 1 --2- 172.21.15.174:0/4063106595 >> v2:172.21.15.174:3300/0 conn(0x7f6d500a5900 0x7f6d50135030 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6d40002f30 tx=0x7f6d40007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.995 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.985+0000 7f6d5504d700 1 --2- 172.21.15.174:0/4063106595 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d500a5900 0x7f6d50135030 secure :-1 s=READY pgs=235 cs=0 l=1 rx=0x7f6d40002f30 tx=0x7f6d40007a40).ready entity=mon.0 client_cookie=c70de83ba7def05e server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:55.995 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.985+0000 7f6d5504d700 1 --2- 172.21.15.174:0/4063106595 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d500a5900 0x7f6d50135030 secure :-1 s=THROTTLE_DONE pgs=235 cs=0 l=1 rx=0x7f6d40002f30 tx=0x7f6d40007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.995 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.985+0000 7f6d3ffff700 1 -- 172.21.15.174:0/4063106595 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d40011720 con 0x7f6d500a5900 2020-04-02T23:46:55.995 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.985+0000 7f6d5504d700 1 --2- 172.21.15.174:0/4063106595 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d500a5900 0x7f6d50135030 secure :-1 s=THROTTLE_DONE pgs=235 cs=0 l=1 rx=0x7f6d40002f30 tx=0x7f6d40007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.995 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.985+0000 7f6d5504d700 1 --2- 172.21.15.174:0/4063106595 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d500a5900 0x7f6d50135030 secure :-1 s=THROTTLE_DONE pgs=235 cs=0 l=1 rx=0x7f6d40002f30 tx=0x7f6d40007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.996 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.985+0000 7f6d3ffff700 1 -- 172.21.15.174:0/4063106595 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d40011880 con 0x7f6d500a5900 2020-04-02T23:46:55.996 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.985+0000 7f6d3ffff700 1 -- 172.21.15.174:0/4063106595 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d40011c60 con 0x7f6d500a5900 2020-04-02T23:46:55.996 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.985+0000 7f6d572b1700 1 -- 172.21.15.174:0/4063106595 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d500a5900 msgr2=0x7f6d50135030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:55.996 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.985+0000 7f6d572b1700 1 --2- 172.21.15.174:0/4063106595 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d500a5900 0x7f6d50135030 secure :-1 s=READY pgs=235 cs=0 l=1 rx=0x7f6d40002f30 tx=0x7f6d40007a40).stop 2020-04-02T23:46:55.996 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.985+0000 7f6d572b1700 1 -- 172.21.15.174:0/4063106595 shutdown_connections 2020-04-02T23:46:55.996 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.985+0000 7f6d572b1700 1 --2- 172.21.15.174:0/4063106595 >> v2:172.21.15.196:3300/0 conn(0x7f6d5012e970 0x7f6d5013ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:55.996 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.985+0000 7f6d572b1700 1 --2- 172.21.15.174:0/4063106595 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d500a5900 0x7f6d50135030 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:55.997 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.985+0000 7f6d572b1700 1 -- 172.21.15.174:0/4063106595 >> 172.21.15.174:0/4063106595 conn(0x7f6d500aaf80 msgr2=0x7f6d500a6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:46:55.997 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.985+0000 7f6d572b1700 1 -- 172.21.15.174:0/4063106595 shutdown_connections 2020-04-02T23:46:55.997 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.985+0000 7f6d572b1700 1 -- 172.21.15.174:0/4063106595 wait complete. 2020-04-02T23:46:55.997 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.986+0000 7f6d572b1700 1 Processor -- start 2020-04-02T23:46:55.997 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.986+0000 7f6d572b1700 1 -- start start 2020-04-02T23:46:55.997 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.987+0000 7f6d572b1700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f6d501312f0 0x7f6d5014ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:55.997 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.987+0000 7f6d572b1700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d5009ff80 con 0x7f6d5005ac00 2020-04-02T23:46:55.998 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.987+0000 7f6d572b1700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d50131e90 con 0x7f6d500a5900 2020-04-02T23:46:55.998 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.987+0000 7f6d572b1700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d50069b10 con 0x7f6d501312f0 2020-04-02T23:46:55.998 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.987+0000 7f6d5504d700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f6d5005ac00 0x7f6d50061650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:45644/0 (socket says 172.21.15.174:45644) 2020-04-02T23:46:55.998 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.987+0000 7f6d5504d700 1 -- 172.21.15.174:0/2827223937 learned_addr learned my addr 172.21.15.174:0/2827223937 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:46:55.998 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.987+0000 7f6d5584e700 1 --2- 172.21.15.174:0/2827223937 >> v2:172.21.15.196:3300/0 conn(0x7f6d501312f0 0x7f6d5014ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:55.998 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.987+0000 7f6d3e7fc700 1 -- 172.21.15.174:0/2827223937 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3022402925 0 0) 0x7f6d5009ff80 con 0x7f6d5005ac00 2020-04-02T23:46:55.998 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.987+0000 7f6d3e7fc700 1 -- 172.21.15.174:0/2827223937 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d30002fe0 con 0x7f6d5005ac00 2020-04-02T23:46:55.999 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.987+0000 7f6d3e7fc700 1 -- 172.21.15.174:0/2827223937 <== mon.0 v1:172.21.15.174:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1619350422 0 0) 0x7f6d30002fe0 con 0x7f6d5005ac00 2020-04-02T23:46:55.999 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.987+0000 7f6d3e7fc700 1 -- 172.21.15.174:0/2827223937 --> v1:172.21.15.174:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6d5009ff80 con 0x7f6d5005ac00 2020-04-02T23:46:55.999 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.987+0000 7f6d3e7fc700 1 -- 172.21.15.174:0/2827223937 <== mon.0 v1:172.21.15.174:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2811762909 0 0) 0x7f6d400085c0 con 0x7f6d5005ac00 2020-04-02T23:46:55.999 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.987+0000 7f6d5584e700 1 -- 172.21.15.174:0/2827223937 >> v1:172.21.15.196:6789/0 conn(0x7f6d500a5900 legacy=0x7f6d5009eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:55.999 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.987+0000 7f6d5584e700 1 -- 172.21.15.174:0/2827223937 >> v1:172.21.15.174:6789/0 conn(0x7f6d5005ac00 legacy=0x7f6d50061650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:55.999 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.987+0000 7f6d5584e700 1 -- 172.21.15.174:0/2827223937 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d500a01b0 con 0x7f6d501312f0 2020-04-02T23:46:55.999 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.987+0000 7f6d5584e700 1 --2- 172.21.15.174:0/2827223937 >> v2:172.21.15.196:3300/0 conn(0x7f6d501312f0 0x7f6d5014ed50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6d4c000fe0 tx=0x7f6d48010e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:55.999 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.988+0000 7f6d5584e700 1 --2- 172.21.15.174:0/2827223937 >> v2:172.21.15.196:3300/0 conn(0x7f6d501312f0 0x7f6d5014ed50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6d4c000fe0 tx=0x7f6d48010e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:56.000 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.988+0000 7f6d5584e700 1 --2- 172.21.15.174:0/2827223937 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d501312f0 0x7f6d5014ed50 secure :-1 s=READY pgs=165 cs=0 l=1 rx=0x7f6d4c000fe0 tx=0x7f6d48010e20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:56.000 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.988+0000 7f6d5584e700 1 --2- 172.21.15.174:0/2827223937 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d501312f0 0x7f6d5014ed50 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7f6d4c000fe0 tx=0x7f6d48010e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:56.000 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.988+0000 7f6d3e7fc700 1 -- 172.21.15.174:0/2827223937 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d48012a00 con 0x7f6d501312f0 2020-04-02T23:46:56.000 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.988+0000 7f6d5584e700 1 --2- 172.21.15.174:0/2827223937 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d501312f0 0x7f6d5014ed50 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7f6d4c000fe0 tx=0x7f6d48010e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:56.000 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.988+0000 7f6d3e7fc700 1 -- 172.21.15.174:0/2827223937 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d48012b60 con 0x7f6d501312f0 2020-04-02T23:46:56.000 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.988+0000 7f6d572b1700 1 -- 172.21.15.174:0/2827223937 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d501318b0 con 0x7f6d501312f0 2020-04-02T23:46:56.000 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.988+0000 7f6d5584e700 1 --2- 172.21.15.174:0/2827223937 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d501312f0 0x7f6d5014ed50 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7f6d4c000fe0 tx=0x7f6d48010e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:56.001 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.988+0000 7f6d3e7fc700 1 -- 172.21.15.174:0/2827223937 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d4800a160 con 0x7f6d501312f0 2020-04-02T23:46:56.001 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.988+0000 7f6d572b1700 1 -- 172.21.15.174:0/2827223937 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d500a17c0 con 0x7f6d501312f0 2020-04-02T23:46:56.001 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.988+0000 7f6d5584e700 1 --2- 172.21.15.174:0/2827223937 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d501312f0 0x7f6d5014ed50 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7f6d4c000fe0 tx=0x7f6d48010e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:56.001 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.989+0000 7f6d3e7fc700 1 -- 172.21.15.174:0/2827223937 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f6d4800a360 con 0x7f6d501312f0 2020-04-02T23:46:56.001 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.989+0000 7f6d5584e700 1 --2- 172.21.15.174:0/2827223937 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d501312f0 0x7f6d5014ed50 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7f6d4c000fe0 tx=0x7f6d48010e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:56.001 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.989+0000 7f6d572b1700 1 -- 172.21.15.174:0/2827223937 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d5009fdb0 con 0x7f6d501312f0 2020-04-02T23:46:56.001 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.989+0000 7f6d3e7fc700 1 --2- 172.21.15.174:0/2827223937 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f6d3004db20 0x7f6d3004ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:56.002 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.989+0000 7f6d3e7fc700 1 -- 172.21.15.174:0/2827223937 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f6d48061550 con 0x7f6d501312f0 2020-04-02T23:46:56.002 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.989+0000 7f6d5504d700 1 --2- 172.21.15.174:0/2827223937 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f6d3004db20 0x7f6d3004ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:56.002 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.989+0000 7f6d5504d700 1 --2- 172.21.15.174:0/2827223937 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f6d3004db20 0x7f6d3004ffe0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6d400102e0 tx=0x7f6d40007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:56.002 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.989+0000 7f6d5504d700 1 --2- 172.21.15.174:0/2827223937 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f6d3004db20 0x7f6d3004ffe0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6d400102e0 tx=0x7f6d40007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:56.002 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.989+0000 7f6d5504d700 1 --2- 172.21.15.174:0/2827223937 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f6d3004db20 0x7f6d3004ffe0 secure :-1 s=READY pgs=128 cs=0 l=1 rx=0x7f6d400102e0 tx=0x7f6d40007a40).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:56.003 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.993+0000 7f6d5584e700 1 --2- 172.21.15.174:0/2827223937 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d501312f0 0x7f6d5014ed50 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7f6d4c000fe0 tx=0x7f6d48010e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:56.003 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:55.993+0000 7f6d3e7fc700 1 -- 172.21.15.174:0/2827223937 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f6d4803cbd0 con 0x7f6d501312f0 2020-04-02T23:46:56.131 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.129+0000 7f6d572b1700 1 -- 172.21.15.174:0/2827223937 --> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f6d50131ab0 con 0x7f6d3004db20 2020-04-02T23:46:56.132 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.129+0000 7f6d5504d700 1 --2- 172.21.15.174:0/2827223937 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f6d3004db20 0x7f6d3004ffe0 secure :-1 s=THROTTLE_DONE pgs=128 cs=0 l=1 rx=0x7f6d400102e0 tx=0x7f6d40007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:56.132 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.129+0000 7f6d3e7fc700 1 -- 172.21.15.174:0/2827223937 <== mgr.4102 v2:172.21.15.196:6800/23210 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6d40007880 con 0x7f6d3004db20 2020-04-02T23:46:56.133 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.131+0000 7f6d572b1700 1 -- 172.21.15.174:0/2827223937 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f6d3004db20 msgr2=0x7f6d3004ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:56.133 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.131+0000 7f6d572b1700 1 --2- 172.21.15.174:0/2827223937 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f6d3004db20 0x7f6d3004ffe0 secure :-1 s=READY pgs=128 cs=0 l=1 rx=0x7f6d400102e0 tx=0x7f6d40007a40).stop 2020-04-02T23:46:56.133 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.131+0000 7f6d572b1700 1 -- 172.21.15.174:0/2827223937 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d501312f0 msgr2=0x7f6d5014ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:56.134 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.131+0000 7f6d572b1700 1 --2- 172.21.15.174:0/2827223937 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d501312f0 0x7f6d5014ed50 secure :-1 s=READY pgs=165 cs=0 l=1 rx=0x7f6d4c000fe0 tx=0x7f6d48010e20).stop 2020-04-02T23:46:56.134 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.131+0000 7f6d572b1700 1 -- 172.21.15.174:0/2827223937 shutdown_connections 2020-04-02T23:46:56.134 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.131+0000 7f6d572b1700 1 --2- 172.21.15.174:0/2827223937 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d501312f0 0x7f6d5014ed50 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:56.134 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.131+0000 7f6d572b1700 1 --2- 172.21.15.174:0/2827223937 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f6d3004db20 0x7f6d3004ffe0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:56.134 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.131+0000 7f6d572b1700 1 -- 172.21.15.174:0/2827223937 >> 172.21.15.174:0/2827223937 conn(0x7f6d500aaf80 msgr2=0x7f6d500a6420 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:46:56.134 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.131+0000 7f6d572b1700 1 -- 172.21.15.174:0/2827223937 shutdown_connections 2020-04-02T23:46:56.135 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.131+0000 7f6d572b1700 1 -- 172.21.15.174:0/2827223937 wait complete. 2020-04-02T23:46:56.135 INFO:teuthology.orchestra.run.smithi174.stderr:instructed osd(s) 1 to deep-scrub 2020-04-02T23:46:56.143 INFO:tasks.ceph:Scrubbing osd.2 2020-04-02T23:46:56.143 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:46:56.157 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.2 config set osd_debug_deep_scrub_sleep 0 2020-04-02T23:46:56.306 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.303+0000 7f4c9361f700 1 Processor -- start 2020-04-02T23:46:56.306 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.304+0000 7f4c9361f700 1 -- start start 2020-04-02T23:46:56.309 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.304+0000 7f4c9361f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4c8c0a5900 0x7f4c8c135030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:56.309 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.304+0000 7f4c9361f700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4c8c12e970 0x7f4c8c13ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:56.309 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.304+0000 7f4c9361f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c8c134420 con 0x7f4c8c05ac00 2020-04-02T23:46:56.309 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.304+0000 7f4c9361f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c8c05b0b0 con 0x7f4c8c0a5900 2020-04-02T23:46:56.310 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.304+0000 7f4c9361f700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8c0a49d0 con 0x7f4c8c12e970 2020-04-02T23:46:56.312 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.304+0000 7f4c913bb700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4c8c0a5900 0x7f4c8c135030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:56.312 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.304+0000 7f4c90bba700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f4c8c05ac00 0x7f4c8c12e260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:45652/0 (socket says 172.21.15.174:45652) 2020-04-02T23:46:56.313 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.304+0000 7f4c90bba700 1 -- 172.21.15.174:0/804509293 learned_addr learned my addr 172.21.15.174:0/804509293 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:46:56.313 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.305+0000 7f4c91bbc700 1 --2- 172.21.15.174:0/804509293 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4c8c12e970 0x7f4c8c13ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:56.313 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.305+0000 7f4c913bb700 1 -- 172.21.15.174:0/804509293 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4c8c12e970 msgr2=0x7f4c8c13ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:46:56.313 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.305+0000 7f4c913bb700 1 --2- 172.21.15.174:0/804509293 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4c8c12e970 0x7f4c8c13ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:56.313 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.305+0000 7f4c7bfff700 1 -- 172.21.15.174:0/804509293 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2102972422 0 0) 0x7f4c8c134420 con 0x7f4c8c05ac00 2020-04-02T23:46:56.313 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.305+0000 7f4c913bb700 1 -- 172.21.15.174:0/804509293 >> v1:172.21.15.174:6789/0 conn(0x7f4c8c05ac00 legacy=0x7f4c8c12e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:56.313 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.305+0000 7f4c913bb700 1 -- 172.21.15.174:0/804509293 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c8c134650 con 0x7f4c8c0a5900 2020-04-02T23:46:56.313 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.305+0000 7f4c913bb700 1 --2- 172.21.15.174:0/804509293 >> v2:172.21.15.174:3300/0 conn(0x7f4c8c0a5900 0x7f4c8c135030 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4c7c002f30 tx=0x7f4c7c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:56.314 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.305+0000 7f4c913bb700 1 --2- 172.21.15.174:0/804509293 >> v2:172.21.15.174:3300/0 conn(0x7f4c8c0a5900 0x7f4c8c135030 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4c7c002f30 tx=0x7f4c7c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:56.314 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.305+0000 7f4c913bb700 1 --2- 172.21.15.174:0/804509293 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4c8c0a5900 0x7f4c8c135030 secure :-1 s=READY pgs=238 cs=0 l=1 rx=0x7f4c7c002f30 tx=0x7f4c7c007a40).ready entity=mon.0 client_cookie=ccc603f805487039 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:56.314 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.305+0000 7f4c913bb700 1 --2- 172.21.15.174:0/804509293 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4c8c0a5900 0x7f4c8c135030 secure :-1 s=THROTTLE_DONE pgs=238 cs=0 l=1 rx=0x7f4c7c002f30 tx=0x7f4c7c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:56.314 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.305+0000 7f4c7bfff700 1 -- 172.21.15.174:0/804509293 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c7c012770 con 0x7f4c8c0a5900 2020-04-02T23:46:56.314 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.305+0000 7f4c913bb700 1 --2- 172.21.15.174:0/804509293 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4c8c0a5900 0x7f4c8c135030 secure :-1 s=THROTTLE_DONE pgs=238 cs=0 l=1 rx=0x7f4c7c002f30 tx=0x7f4c7c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:56.314 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.305+0000 7f4c913bb700 1 --2- 172.21.15.174:0/804509293 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4c8c0a5900 0x7f4c8c135030 secure :-1 s=THROTTLE_DONE pgs=238 cs=0 l=1 rx=0x7f4c7c002f30 tx=0x7f4c7c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:56.314 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.305+0000 7f4c7bfff700 1 -- 172.21.15.174:0/804509293 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c7c0128d0 con 0x7f4c8c0a5900 2020-04-02T23:46:56.315 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.305+0000 7f4c7bfff700 1 -- 172.21.15.174:0/804509293 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c7c012cb0 con 0x7f4c8c0a5900 2020-04-02T23:46:56.315 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.305+0000 7f4c9361f700 1 -- 172.21.15.174:0/804509293 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4c8c0a5900 msgr2=0x7f4c8c135030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:56.315 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.305+0000 7f4c9361f700 1 --2- 172.21.15.174:0/804509293 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4c8c0a5900 0x7f4c8c135030 secure :-1 s=READY pgs=238 cs=0 l=1 rx=0x7f4c7c002f30 tx=0x7f4c7c007a40).stop 2020-04-02T23:46:56.315 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.305+0000 7f4c9361f700 1 -- 172.21.15.174:0/804509293 shutdown_connections 2020-04-02T23:46:56.315 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.305+0000 7f4c9361f700 1 --2- 172.21.15.174:0/804509293 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4c8c12e970 0x7f4c8c13ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:56.315 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.305+0000 7f4c9361f700 1 --2- 172.21.15.174:0/804509293 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4c8c0a5900 0x7f4c8c135030 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:56.315 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.305+0000 7f4c9361f700 1 -- 172.21.15.174:0/804509293 >> 172.21.15.174:0/804509293 conn(0x7f4c8c0aaf80 msgr2=0x7f4c8c0a6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:46:56.316 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.306+0000 7f4c9361f700 1 -- 172.21.15.174:0/804509293 shutdown_connections 2020-04-02T23:46:56.316 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.306+0000 7f4c9361f700 1 -- 172.21.15.174:0/804509293 wait complete. 2020-04-02T23:46:56.316 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.306+0000 7f4c9361f700 1 Processor -- start 2020-04-02T23:46:56.316 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.306+0000 7f4c9361f700 1 -- start start 2020-04-02T23:46:56.322 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.307+0000 7f4c9361f700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4c8c05ac00 0x7f4c8c09e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:56.322 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.307+0000 7f4c9361f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c8c131870 con 0x7f4c8c137d90 2020-04-02T23:46:56.322 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.307+0000 7f4c9361f700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c8c131b10 con 0x7f4c8c0a5900 2020-04-02T23:46:56.322 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.307+0000 7f4c9361f700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8c130020 con 0x7f4c8c05ac00 2020-04-02T23:46:56.323 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.307+0000 7f4c91bbc700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f4c8c137d90 0x7f4c8c12a750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:45662/0 (socket says 172.21.15.174:45662) 2020-04-02T23:46:56.323 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.307+0000 7f4c91bbc700 1 -- 172.21.15.174:0/3797044826 learned_addr learned my addr 172.21.15.174:0/3797044826 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:46:56.323 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.307+0000 7f4c913bb700 1 --2- 172.21.15.174:0/3797044826 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4c8c05ac00 0x7f4c8c09e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:56.323 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.307+0000 7f4c7a7fc700 1 -- 172.21.15.174:0/3797044826 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 911112058 0 0) 0x7f4c8c131870 con 0x7f4c8c137d90 2020-04-02T23:46:56.323 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.307+0000 7f4c7a7fc700 1 -- 172.21.15.174:0/3797044826 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c6c002fe0 con 0x7f4c8c137d90 2020-04-02T23:46:56.323 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.307+0000 7f4c7a7fc700 1 -- 172.21.15.174:0/3797044826 <== mon.0 v1:172.21.15.174:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2074253590 0 0) 0x7f4c6c002fe0 con 0x7f4c8c137d90 2020-04-02T23:46:56.323 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.307+0000 7f4c7a7fc700 1 -- 172.21.15.174:0/3797044826 --> v1:172.21.15.174:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4c8c131870 con 0x7f4c8c137d90 2020-04-02T23:46:56.324 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.307+0000 7f4c7a7fc700 1 -- 172.21.15.174:0/3797044826 <== mon.0 v1:172.21.15.174:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2811762909 0 0) 0x7f4c840018e0 con 0x7f4c8c137d90 2020-04-02T23:46:56.324 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.308+0000 7f4c7a7fc700 1 -- 172.21.15.174:0/3797044826 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4c8c05ac00 msgr2=0x7f4c8c09e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:56.324 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.308+0000 7f4c7a7fc700 1 --2- 172.21.15.174:0/3797044826 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4c8c05ac00 0x7f4c8c09e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:56.324 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.308+0000 7f4c7a7fc700 1 -- 172.21.15.174:0/3797044826 >> v1:172.21.15.196:6789/0 conn(0x7f4c8c0a5900 legacy=0x7f4c8c1304c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:56.324 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.308+0000 7f4c7a7fc700 1 -- 172.21.15.174:0/3797044826 >> v1:172.21.15.174:6789/0 conn(0x7f4c8c137d90 legacy=0x7f4c8c12a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:56.324 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.308+0000 7f4c7a7fc700 1 --2- 172.21.15.174:0/3797044826 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4c6c0049b0 0x7f4c6c004d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:56.325 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.308+0000 7f4c7a7fc700 1 --2- 172.21.15.174:0/3797044826 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4c6c005210 0x7f4c6c003920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:56.325 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.308+0000 7f4c7a7fc700 1 --2- 172.21.15.174:0/3797044826 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4c6c003e70 0x7f4c6c0042f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:56.325 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.308+0000 7f4c7a7fc700 1 -- 172.21.15.174:0/3797044826 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8c130020 con 0x7f4c6c005210 2020-04-02T23:46:56.325 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.308+0000 7f4c7a7fc700 1 -- 172.21.15.174:0/3797044826 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c6c00b750 con 0x7f4c6c003e70 2020-04-02T23:46:56.325 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.308+0000 7f4c7a7fc700 1 -- 172.21.15.174:0/3797044826 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c6c00b910 con 0x7f4c6c0049b0 2020-04-02T23:46:56.325 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.308+0000 7f4c913bb700 1 --2- 172.21.15.174:0/3797044826 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4c8c05ac00 0x7f4c8c09e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:46:56.325 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.308+0000 7f4c90bba700 1 --2- 172.21.15.174:0/3797044826 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4c6c005210 0x7f4c6c003920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:56.326 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.308+0000 7f4c91bbc700 1 --2- 172.21.15.174:0/3797044826 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4c6c003e70 0x7f4c6c0042f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:56.326 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.308+0000 7f4c913bb700 1 --2- 172.21.15.174:0/3797044826 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4c6c0049b0 0x7f4c6c004d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:56.326 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.308+0000 7f4c90bba700 1 -- 172.21.15.174:0/3797044826 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4c6c0049b0 msgr2=0x7f4c6c004d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:56.326 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.308+0000 7f4c90bba700 1 --2- 172.21.15.174:0/3797044826 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4c6c0049b0 0x7f4c6c004d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:56.326 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.308+0000 7f4c90bba700 1 -- 172.21.15.174:0/3797044826 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4c6c003e70 msgr2=0x7f4c6c0042f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:56.326 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.308+0000 7f4c90bba700 1 --2- 172.21.15.174:0/3797044826 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4c6c003e70 0x7f4c6c0042f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:56.327 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.308+0000 7f4c90bba700 1 -- 172.21.15.174:0/3797044826 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c8c130bd0 con 0x7f4c6c005210 2020-04-02T23:46:56.327 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.308+0000 7f4c9361f700 1 -- 172.21.15.174:0/3797044826 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c8c12ae60 con 0x7f4c6c005210 2020-04-02T23:46:56.327 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.308+0000 7f4c90bba700 1 --2- 172.21.15.174:0/3797044826 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4c6c005210 0x7f4c6c003920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4c88000ee0 tx=0x7f4c88010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:56.327 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.308+0000 7f4c90bba700 1 --2- 172.21.15.174:0/3797044826 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4c6c005210 0x7f4c6c003920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4c88000ee0 tx=0x7f4c88010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:56.327 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.308+0000 7f4c90bba700 1 --2- 172.21.15.174:0/3797044826 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4c6c005210 0x7f4c6c003920 secure :-1 s=READY pgs=240 cs=0 l=1 rx=0x7f4c88000ee0 tx=0x7f4c88010aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:56.327 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.308+0000 7f4c9361f700 1 -- 172.21.15.174:0/3797044826 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c8c09e5e0 con 0x7f4c6c005210 2020-04-02T23:46:56.327 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.308+0000 7f4c90bba700 1 --2- 172.21.15.174:0/3797044826 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4c6c005210 0x7f4c6c003920 secure :-1 s=THROTTLE_DONE pgs=240 cs=0 l=1 rx=0x7f4c88000ee0 tx=0x7f4c88010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:56.328 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.308+0000 7f4c7a7fc700 1 -- 172.21.15.174:0/3797044826 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c8800cc50 con 0x7f4c6c005210 2020-04-02T23:46:56.328 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.308+0000 7f4c90bba700 1 --2- 172.21.15.174:0/3797044826 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4c6c005210 0x7f4c6c003920 secure :-1 s=THROTTLE_DONE pgs=240 cs=0 l=1 rx=0x7f4c88000ee0 tx=0x7f4c88010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:56.328 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.308+0000 7f4c7a7fc700 1 -- 172.21.15.174:0/3797044826 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c8800cdf0 con 0x7f4c6c005210 2020-04-02T23:46:56.328 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.308+0000 7f4c90bba700 1 --2- 172.21.15.174:0/3797044826 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4c6c005210 0x7f4c6c003920 secure :-1 s=THROTTLE_DONE pgs=240 cs=0 l=1 rx=0x7f4c88000ee0 tx=0x7f4c88010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:56.328 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.308+0000 7f4c7a7fc700 1 -- 172.21.15.174:0/3797044826 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c880046e0 con 0x7f4c6c005210 2020-04-02T23:46:56.328 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.309+0000 7f4c90bba700 1 --2- 172.21.15.174:0/3797044826 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4c6c005210 0x7f4c6c003920 secure :-1 s=THROTTLE_DONE pgs=240 cs=0 l=1 rx=0x7f4c88000ee0 tx=0x7f4c88010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:56.328 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.309+0000 7f4c9361f700 1 -- 172.21.15.174:0/3797044826 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4c8c0a7ec0 con 0x7f4c6c005210 2020-04-02T23:46:56.328 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.309+0000 7f4c7a7fc700 1 -- 172.21.15.174:0/3797044826 <== mon.0 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f4c88004840 con 0x7f4c6c005210 2020-04-02T23:46:56.329 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.309+0000 7f4c90bba700 1 --2- 172.21.15.174:0/3797044826 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4c6c005210 0x7f4c6c003920 secure :-1 s=THROTTLE_DONE pgs=240 cs=0 l=1 rx=0x7f4c88000ee0 tx=0x7f4c88010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:56.329 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.309+0000 7f4c90bba700 1 --2- 172.21.15.174:0/3797044826 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4c6c005210 0x7f4c6c003920 secure :-1 s=THROTTLE_DONE pgs=240 cs=0 l=1 rx=0x7f4c88000ee0 tx=0x7f4c88010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:56.329 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.309+0000 7f4c7a7fc700 1 --2- 172.21.15.174:0/3797044826 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f4c6c055c10 0x7f4c6c0580d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:56.329 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.310+0000 7f4c7a7fc700 1 -- 172.21.15.174:0/3797044826 <== mon.0 v2:172.21.15.174:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4c880609f0 con 0x7f4c6c005210 2020-04-02T23:46:56.329 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.310+0000 7f4c913bb700 1 --2- 172.21.15.174:0/3797044826 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f4c6c055c10 0x7f4c6c0580d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:56.329 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.310+0000 7f4c7a7fc700 1 --2- 172.21.15.174:0/3797044826 >> [v2:172.21.15.174:6816/24781,v1:172.21.15.174:6817/24781] conn(0x7f4c6c05c700 0x7f4c6c05eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:56.329 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.310+0000 7f4c7a7fc700 1 -- 172.21.15.174:0/3797044826 --> [v2:172.21.15.174:6816/24781,v1:172.21.15.174:6817/24781] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4c6c05f170 con 0x7f4c6c05c700 2020-04-02T23:46:56.330 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.310+0000 7f4c7a7fc700 1 -- 172.21.15.174:0/3797044826 <== mon.0 v2:172.21.15.174:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4c88061f10 con 0x7f4c6c005210 2020-04-02T23:46:56.330 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.310+0000 7f4c91bbc700 1 --2- 172.21.15.174:0/3797044826 >> [v2:172.21.15.174:6816/24781,v1:172.21.15.174:6817/24781] conn(0x7f4c6c05c700 0x7f4c6c05eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:56.330 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.310+0000 7f4c913bb700 1 --2- 172.21.15.174:0/3797044826 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f4c6c055c10 0x7f4c6c0580d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4c7c002f30 tx=0x7f4c7c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:56.330 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.310+0000 7f4c913bb700 1 --2- 172.21.15.174:0/3797044826 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f4c6c055c10 0x7f4c6c0580d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4c7c002f30 tx=0x7f4c7c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:56.330 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.310+0000 7f4c913bb700 1 --2- 172.21.15.174:0/3797044826 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f4c6c055c10 0x7f4c6c0580d0 secure :-1 s=READY pgs=129 cs=0 l=1 rx=0x7f4c7c002f30 tx=0x7f4c7c007a40).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:56.330 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.310+0000 7f4c91bbc700 1 --2- 172.21.15.174:0/3797044826 >> [v2:172.21.15.174:6816/24781,v1:172.21.15.174:6817/24781] conn(0x7f4c6c05c700 0x7f4c6c05eb20 crc :-1 s=READY pgs=11 cs=0 l=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:56.330 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.311+0000 7f4c7a7fc700 1 -- 172.21.15.174:0/3797044826 <== osd.2 v2:172.21.15.174:6816/24781 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21407 (crc 0 0 0) 0x7f4c6c05f170 con 0x7f4c6c05c700 2020-04-02T23:46:56.332 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.325+0000 7f4c9361f700 1 -- 172.21.15.174:0/3797044826 --> [v2:172.21.15.174:6816/24781,v1:172.21.15.174:6817/24781] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f4c8c130dc0 con 0x7f4c6c05c700 2020-04-02T23:46:56.332 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.325+0000 7f4c7a7fc700 1 -- 172.21.15.174:0/3797044826 <== osd.2 v2:172.21.15.174:6816/24781 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f4c84005a40 con 0x7f4c6c05c700 2020-04-02T23:46:56.332 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.326+0000 7f4c9361f700 1 -- 172.21.15.174:0/3797044826 >> [v2:172.21.15.174:6816/24781,v1:172.21.15.174:6817/24781] conn(0x7f4c6c05c700 msgr2=0x7f4c6c05eb20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:56.333 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.326+0000 7f4c9361f700 1 --2- 172.21.15.174:0/3797044826 >> [v2:172.21.15.174:6816/24781,v1:172.21.15.174:6817/24781] conn(0x7f4c6c05c700 0x7f4c6c05eb20 crc :-1 s=READY pgs=11 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:56.333 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.326+0000 7f4c91bbc700 1 -- 172.21.15.174:0/3797044826 reap_dead start 2020-04-02T23:46:56.333 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.326+0000 7f4c9361f700 1 -- 172.21.15.174:0/3797044826 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f4c6c055c10 msgr2=0x7f4c6c0580d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:56.333 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.326+0000 7f4c9361f700 1 --2- 172.21.15.174:0/3797044826 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f4c6c055c10 0x7f4c6c0580d0 secure :-1 s=READY pgs=129 cs=0 l=1 rx=0x7f4c7c002f30 tx=0x7f4c7c007a40).stop 2020-04-02T23:46:56.333 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.326+0000 7f4c9361f700 1 -- 172.21.15.174:0/3797044826 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4c6c005210 msgr2=0x7f4c6c003920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:56.333 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.326+0000 7f4c9361f700 1 --2- 172.21.15.174:0/3797044826 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4c6c005210 0x7f4c6c003920 secure :-1 s=READY pgs=240 cs=0 l=1 rx=0x7f4c88000ee0 tx=0x7f4c88010aa0).stop 2020-04-02T23:46:56.333 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.326+0000 7f4c9361f700 1 -- 172.21.15.174:0/3797044826 shutdown_connections 2020-04-02T23:46:56.334 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.326+0000 7f4c9361f700 1 --2- 172.21.15.174:0/3797044826 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f4c6c055c10 0x7f4c6c0580d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:56.334 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.326+0000 7f4c9361f700 1 --2- 172.21.15.174:0/3797044826 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4c6c005210 0x7f4c6c003920 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:56.334 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.326+0000 7f4c9361f700 1 -- 172.21.15.174:0/3797044826 >> 172.21.15.174:0/3797044826 conn(0x7f4c8c0aaf80 msgr2=0x7f4c8c05b220 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:46:56.334 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.326+0000 7f4c9361f700 1 -- 172.21.15.174:0/3797044826 shutdown_connections 2020-04-02T23:46:56.334 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.326+0000 7f4c9361f700 1 -- 172.21.15.174:0/3797044826 wait complete. 2020-04-02T23:46:56.334 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2020-04-02T23:46:56.334 INFO:teuthology.orchestra.run.smithi174.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-04-02T23:46:56.335 INFO:teuthology.orchestra.run.smithi174.stdout:} 2020-04-02T23:46:56.338 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:46:56.351 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd deep-scrub 2 2020-04-02T23:46:56.496 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.494+0000 7f000dcf3700 1 Processor -- start 2020-04-02T23:46:56.497 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.495+0000 7f000dcf3700 1 -- start start 2020-04-02T23:46:56.500 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.495+0000 7f000dcf3700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f00080a38f0 0x7f0008138480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:56.500 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.495+0000 7f000dcf3700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f00081388e0 0x7f0008134d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:56.500 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.495+0000 7f000dcf3700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00080a3e30 con 0x7f00080a7a60 2020-04-02T23:46:56.500 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.495+0000 7f000dcf3700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00080a40d0 con 0x7f00080a38f0 2020-04-02T23:46:56.500 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.495+0000 7f000dcf3700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00080a4370 con 0x7f00081388e0 2020-04-02T23:46:56.500 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.495+0000 7f0006ffd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f00080a38f0 0x7f0008138480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:56.501 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.495+0000 7f0006ffd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f00080a38f0 0x7f0008138480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:40636/0 (socket says 172.21.15.174:40636) 2020-04-02T23:46:56.501 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.495+0000 7f0006ffd700 1 -- 172.21.15.174:0/3218979245 learned_addr learned my addr 172.21.15.174:0/3218979245 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:46:56.501 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.495+0000 7f0007fff700 1 --2- 172.21.15.174:0/3218979245 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f00081388e0 0x7f0008134d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:56.501 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.496+0000 7f0006ffd700 1 -- 172.21.15.174:0/3218979245 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f00081388e0 msgr2=0x7f0008134d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:46:56.501 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.496+0000 7f0006ffd700 1 --2- 172.21.15.174:0/3218979245 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f00081388e0 0x7f0008134d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:56.501 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.496+0000 7f0006ffd700 1 -- 172.21.15.174:0/3218979245 >> v1:172.21.15.196:6789/0 conn(0x7f00080a7a60 legacy=0x7f00080a1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:56.501 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.496+0000 7f0006ffd700 1 -- 172.21.15.174:0/3218979245 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0008138d20 con 0x7f00080a38f0 2020-04-02T23:46:56.502 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.496+0000 7f0006ffd700 1 --2- 172.21.15.174:0/3218979245 >> v2:172.21.15.174:3300/0 conn(0x7f00080a38f0 0x7f0008138480 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7efffc002f30 tx=0x7efffc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:56.502 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.496+0000 7f0006ffd700 1 --2- 172.21.15.174:0/3218979245 >> v2:172.21.15.174:3300/0 conn(0x7f00080a38f0 0x7f0008138480 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7efffc002f30 tx=0x7efffc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:56.502 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.496+0000 7f0006ffd700 1 --2- 172.21.15.174:0/3218979245 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f00080a38f0 0x7f0008138480 secure :-1 s=READY pgs=241 cs=0 l=1 rx=0x7efffc002f30 tx=0x7efffc007a40).ready entity=mon.0 client_cookie=3e5ea9b37834aba9 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:56.502 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.496+0000 7f0006ffd700 1 --2- 172.21.15.174:0/3218979245 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f00080a38f0 0x7f0008138480 secure :-1 s=THROTTLE_DONE pgs=241 cs=0 l=1 rx=0x7efffc002f30 tx=0x7efffc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:56.502 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.496+0000 7f00067fc700 1 -- 172.21.15.174:0/3218979245 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efffc011720 con 0x7f00080a38f0 2020-04-02T23:46:56.502 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.496+0000 7f0006ffd700 1 --2- 172.21.15.174:0/3218979245 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f00080a38f0 0x7f0008138480 secure :-1 s=THROTTLE_DONE pgs=241 cs=0 l=1 rx=0x7efffc002f30 tx=0x7efffc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:56.502 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.496+0000 7f0006ffd700 1 --2- 172.21.15.174:0/3218979245 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f00080a38f0 0x7f0008138480 secure :-1 s=THROTTLE_DONE pgs=241 cs=0 l=1 rx=0x7efffc002f30 tx=0x7efffc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:56.502 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.496+0000 7f00067fc700 1 -- 172.21.15.174:0/3218979245 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efffc011880 con 0x7f00080a38f0 2020-04-02T23:46:56.503 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.496+0000 7f00067fc700 1 -- 172.21.15.174:0/3218979245 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efffc011ca0 con 0x7f00080a38f0 2020-04-02T23:46:56.503 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.496+0000 7f000dcf3700 1 -- 172.21.15.174:0/3218979245 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f00080a38f0 msgr2=0x7f0008138480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:56.503 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.496+0000 7f000dcf3700 1 --2- 172.21.15.174:0/3218979245 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f00080a38f0 0x7f0008138480 secure :-1 s=READY pgs=241 cs=0 l=1 rx=0x7efffc002f30 tx=0x7efffc007a40).stop 2020-04-02T23:46:56.503 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.496+0000 7f000dcf3700 1 -- 172.21.15.174:0/3218979245 shutdown_connections 2020-04-02T23:46:56.503 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.496+0000 7f000dcf3700 1 --2- 172.21.15.174:0/3218979245 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f00081388e0 0x7f0008134d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:56.503 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.496+0000 7f000dcf3700 1 --2- 172.21.15.174:0/3218979245 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f00080a38f0 0x7f0008138480 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:56.503 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.496+0000 7f000dcf3700 1 -- 172.21.15.174:0/3218979245 >> 172.21.15.174:0/3218979245 conn(0x7f00080aaf80 msgr2=0x7f00080a6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:46:56.504 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.497+0000 7f000dcf3700 1 -- 172.21.15.174:0/3218979245 shutdown_connections 2020-04-02T23:46:56.504 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.497+0000 7f000dcf3700 1 -- 172.21.15.174:0/3218979245 wait complete. 2020-04-02T23:46:56.504 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.497+0000 7f000dcf3700 1 Processor -- start 2020-04-02T23:46:56.504 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.498+0000 7f000dcf3700 1 -- start start 2020-04-02T23:46:56.507 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.498+0000 7f000dcf3700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f00080a38f0 0x7f0008128730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:56.507 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.498+0000 7f000dcf3700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f00080a7a60 0x7f0008128b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:56.508 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.498+0000 7f000dcf3700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f000812a570 con 0x7f00081388e0 2020-04-02T23:46:56.508 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.498+0000 7f000dcf3700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f000812a8c0 con 0x7f00080a38f0 2020-04-02T23:46:56.508 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.498+0000 7f000dcf3700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0008135ef0 con 0x7f00080a7a60 2020-04-02T23:46:56.508 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.498+0000 7f00077fe700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f00080a38f0 0x7f0008128730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:56.508 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.498+0000 7f00077fe700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f00080a38f0 0x7f0008128730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:40642/0 (socket says 172.21.15.174:40642) 2020-04-02T23:46:56.508 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.498+0000 7f00077fe700 1 -- 172.21.15.174:0/1100600890 learned_addr learned my addr 172.21.15.174:0/1100600890 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:46:56.508 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.498+0000 7f0006ffd700 1 --2- 172.21.15.174:0/1100600890 >> v2:172.21.15.196:3300/0 conn(0x7f00080a7a60 0x7f0008128b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:56.509 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.498+0000 7f00077fe700 1 -- 172.21.15.174:0/1100600890 >> v2:172.21.15.196:3300/0 conn(0x7f00080a7a60 msgr2=0x7f0008128b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:56.509 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.498+0000 7f00077fe700 1 --2- 172.21.15.174:0/1100600890 >> v2:172.21.15.196:3300/0 conn(0x7f00080a7a60 0x7f0008128b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:56.509 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.498+0000 7f00077fe700 1 -- 172.21.15.174:0/1100600890 >> v1:172.21.15.196:6789/0 conn(0x7f00081388e0 legacy=0x7f0008133d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:56.509 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.498+0000 7f00077fe700 1 -- 172.21.15.174:0/1100600890 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0008128ff0 con 0x7f00080a38f0 2020-04-02T23:46:56.509 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.498+0000 7f0006ffd700 1 --2- 172.21.15.174:0/1100600890 >> v2:172.21.15.196:3300/0 conn(0x7f00080a7a60 0x7f0008128b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-02T23:46:56.509 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.499+0000 7f00077fe700 1 --2- 172.21.15.174:0/1100600890 >> v2:172.21.15.174:3300/0 conn(0x7f00080a38f0 0x7f0008128730 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0008069f20 tx=0x7efff8010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:56.509 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.499+0000 7f00077fe700 1 --2- 172.21.15.174:0/1100600890 >> v2:172.21.15.174:3300/0 conn(0x7f00080a38f0 0x7f0008128730 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0008069f20 tx=0x7efff8010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:56.510 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.499+0000 7f00077fe700 1 --2- 172.21.15.174:0/1100600890 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f00080a38f0 0x7f0008128730 secure :-1 s=READY pgs=242 cs=0 l=1 rx=0x7f0008069f20 tx=0x7efff8010a70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:56.510 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.499+0000 7f00077fe700 1 --2- 172.21.15.174:0/1100600890 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f00080a38f0 0x7f0008128730 secure :-1 s=THROTTLE_DONE pgs=242 cs=0 l=1 rx=0x7f0008069f20 tx=0x7efff8010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:56.510 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.499+0000 7f0004ff9700 1 -- 172.21.15.174:0/1100600890 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efff800cbf0 con 0x7f00080a38f0 2020-04-02T23:46:56.510 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.499+0000 7f00077fe700 1 --2- 172.21.15.174:0/1100600890 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f00080a38f0 0x7f0008128730 secure :-1 s=THROTTLE_DONE pgs=242 cs=0 l=1 rx=0x7f0008069f20 tx=0x7efff8010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:56.510 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.499+0000 7f00077fe700 1 --2- 172.21.15.174:0/1100600890 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f00080a38f0 0x7f0008128730 secure :-1 s=THROTTLE_DONE pgs=242 cs=0 l=1 rx=0x7f0008069f20 tx=0x7efff8010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:56.510 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.499+0000 7f0004ff9700 1 -- 172.21.15.174:0/1100600890 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efff800cd50 con 0x7f00080a38f0 2020-04-02T23:46:56.510 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.499+0000 7f000dcf3700 1 -- 172.21.15.174:0/1100600890 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00080a11c0 con 0x7f00080a38f0 2020-04-02T23:46:56.511 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.499+0000 7f0004ff9700 1 -- 172.21.15.174:0/1100600890 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efff80122c0 con 0x7f00080a38f0 2020-04-02T23:46:56.511 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.499+0000 7f000dcf3700 1 -- 172.21.15.174:0/1100600890 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f000812c0e0 con 0x7f00080a38f0 2020-04-02T23:46:56.511 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.499+0000 7f00077fe700 1 --2- 172.21.15.174:0/1100600890 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f00080a38f0 0x7f0008128730 secure :-1 s=THROTTLE_DONE pgs=242 cs=0 l=1 rx=0x7f0008069f20 tx=0x7efff8010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:56.511 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.500+0000 7f000dcf3700 1 -- 172.21.15.174:0/1100600890 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0008056c50 con 0x7f00080a38f0 2020-04-02T23:46:56.511 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.500+0000 7f0004ff9700 1 -- 172.21.15.174:0/1100600890 <== mon.0 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7efff8012530 con 0x7f00080a38f0 2020-04-02T23:46:56.511 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.500+0000 7f00077fe700 1 --2- 172.21.15.174:0/1100600890 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f00080a38f0 0x7f0008128730 secure :-1 s=THROTTLE_DONE pgs=242 cs=0 l=1 rx=0x7f0008069f20 tx=0x7efff8010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:56.511 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.500+0000 7f0004ff9700 1 --2- 172.21.15.174:0/1100600890 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7effe804d610 0x7effe804fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:56.512 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.500+0000 7f0004ff9700 1 -- 172.21.15.174:0/1100600890 <== mon.0 v2:172.21.15.174:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7efff8060ce0 con 0x7f00080a38f0 2020-04-02T23:46:56.512 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.500+0000 7f0006ffd700 1 --2- 172.21.15.174:0/1100600890 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7effe804d610 0x7effe804fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:56.512 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.500+0000 7f0006ffd700 1 --2- 172.21.15.174:0/1100600890 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7effe804d610 0x7effe804fad0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efffc002f30 tx=0x7efffc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:56.512 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.501+0000 7f0006ffd700 1 --2- 172.21.15.174:0/1100600890 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7effe804d610 0x7effe804fad0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efffc002f30 tx=0x7efffc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:56.512 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.501+0000 7f0006ffd700 1 --2- 172.21.15.174:0/1100600890 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7effe804d610 0x7effe804fad0 secure :-1 s=READY pgs=130 cs=0 l=1 rx=0x7efffc002f30 tx=0x7efffc007a40).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:56.512 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.503+0000 7f00077fe700 1 --2- 172.21.15.174:0/1100600890 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f00080a38f0 0x7f0008128730 secure :-1 s=THROTTLE_DONE pgs=242 cs=0 l=1 rx=0x7f0008069f20 tx=0x7efff8010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:56.512 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.503+0000 7f0004ff9700 1 -- 172.21.15.174:0/1100600890 <== mon.0 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7efff803c3e0 con 0x7f00080a38f0 2020-04-02T23:46:56.642 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.640+0000 7f000dcf3700 1 -- 172.21.15.174:0/1100600890 --> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f000805a690 con 0x7effe804d610 2020-04-02T23:46:56.643 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.642+0000 7f0006ffd700 1 --2- 172.21.15.174:0/1100600890 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7effe804d610 0x7effe804fad0 secure :-1 s=THROTTLE_DONE pgs=130 cs=0 l=1 rx=0x7efffc002f30 tx=0x7efffc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:56.643 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.642+0000 7f0004ff9700 1 -- 172.21.15.174:0/1100600890 <== mgr.4102 v2:172.21.15.196:6800/23210 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f000805a690 con 0x7effe804d610 2020-04-02T23:46:56.645 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.642+0000 7f000dcf3700 1 -- 172.21.15.174:0/1100600890 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7effe804d610 msgr2=0x7effe804fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:56.645 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.642+0000 7f000dcf3700 1 --2- 172.21.15.174:0/1100600890 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7effe804d610 0x7effe804fad0 secure :-1 s=READY pgs=130 cs=0 l=1 rx=0x7efffc002f30 tx=0x7efffc007a40).stop 2020-04-02T23:46:56.645 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.642+0000 7f000dcf3700 1 -- 172.21.15.174:0/1100600890 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f00080a38f0 msgr2=0x7f0008128730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:56.646 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.642+0000 7f000dcf3700 1 --2- 172.21.15.174:0/1100600890 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f00080a38f0 0x7f0008128730 secure :-1 s=READY pgs=242 cs=0 l=1 rx=0x7f0008069f20 tx=0x7efff8010a70).stop 2020-04-02T23:46:56.646 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.642+0000 7f000dcf3700 1 -- 172.21.15.174:0/1100600890 shutdown_connections 2020-04-02T23:46:56.646 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.642+0000 7f000dcf3700 1 --2- 172.21.15.174:0/1100600890 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7effe804d610 0x7effe804fad0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:56.646 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.642+0000 7f000dcf3700 1 --2- 172.21.15.174:0/1100600890 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f00080a38f0 0x7f0008128730 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:56.646 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.642+0000 7f000dcf3700 1 --2- 172.21.15.174:0/1100600890 >> v2:172.21.15.196:3300/0 conn(0x7f00080a7a60 0x7f0008128b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:56.646 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.642+0000 7f000dcf3700 1 -- 172.21.15.174:0/1100600890 >> 172.21.15.174:0/1100600890 conn(0x7f00080aaf80 msgr2=0x7f000809d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:46:56.646 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.642+0000 7f000dcf3700 1 -- 172.21.15.174:0/1100600890 shutdown_connections 2020-04-02T23:46:56.647 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.642+0000 7f000dcf3700 1 -- 172.21.15.174:0/1100600890 wait complete. 2020-04-02T23:46:56.647 INFO:teuthology.orchestra.run.smithi174.stderr:instructed osd(s) 2 to deep-scrub 2020-04-02T23:46:56.655 INFO:tasks.ceph:Scrubbing osd.3 2020-04-02T23:46:56.655 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:46:56.668 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.3 config set osd_debug_deep_scrub_sleep 0 2020-04-02T23:46:56.817 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.815+0000 7f224bae3700 1 Processor -- start 2020-04-02T23:46:56.817 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.815+0000 7f224bae3700 1 -- start start 2020-04-02T23:46:56.825 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.816+0000 7f224bae3700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f22440a62b0 0x7f224409d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:56.825 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.816+0000 7f224bae3700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22440a6d40 con 0x7f224413bc30 2020-04-02T23:46:56.825 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.816+0000 7f224bae3700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f224409dbe0 con 0x7f2244066e50 2020-04-02T23:46:56.825 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.816+0000 7f224bae3700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2244060000 con 0x7f22440a62b0 2020-04-02T23:46:56.825 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.816+0000 7f224a080700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f224413bc30 0x7f2244142950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:45692/0 (socket says 172.21.15.174:45692) 2020-04-02T23:46:56.825 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.816+0000 7f224a080700 1 -- 172.21.15.174:0/1298536027 learned_addr learned my addr 172.21.15.174:0/1298536027 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:46:56.825 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.816+0000 7f224887d700 1 -- 172.21.15.174:0/1298536027 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2687248450 0 0) 0x7f22440a6d40 con 0x7f224413bc30 2020-04-02T23:46:56.826 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.816+0000 7f224887d700 1 -- 172.21.15.174:0/1298536027 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f222c003230 con 0x7f224413bc30 2020-04-02T23:46:56.826 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.816+0000 7f224907e700 1 --2- 172.21.15.174:0/1298536027 >> v2:172.21.15.196:3300/0 conn(0x7f22440a62b0 0x7f224409d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:56.826 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.816+0000 7f224887d700 1 -- 172.21.15.174:0/1298536027 <== mon.0 v1:172.21.15.174:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 939416287 0 0) 0x7f222c003230 con 0x7f224413bc30 2020-04-02T23:46:56.826 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.816+0000 7f224887d700 1 -- 172.21.15.174:0/1298536027 >> v2:172.21.15.196:3300/0 conn(0x7f22440a62b0 msgr2=0x7f224409d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:46:56.826 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.816+0000 7f224887d700 1 --2- 172.21.15.174:0/1298536027 >> v2:172.21.15.196:3300/0 conn(0x7f22440a62b0 0x7f224409d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:56.826 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.816+0000 7f224887d700 1 -- 172.21.15.174:0/1298536027 >> v1:172.21.15.196:6789/0 conn(0x7f2244066e50 legacy=0x7f224405f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:56.826 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.816+0000 7f224887d700 1 -- 172.21.15.174:0/1298536027 --> v1:172.21.15.174:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f224409d940 con 0x7f224413bc30 2020-04-02T23:46:56.827 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.816+0000 7f224887d700 1 -- 172.21.15.174:0/1298536027 <== mon.0 v1:172.21.15.174:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2811762909 0 0) 0x7f223c001a50 con 0x7f224413bc30 2020-04-02T23:46:56.827 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.816+0000 7f224887d700 1 -- 172.21.15.174:0/1298536027 >> v1:172.21.15.174:6789/0 conn(0x7f224413bc30 legacy=0x7f2244142950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:56.827 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.816+0000 7f224887d700 1 --2- 172.21.15.174:0/1298536027 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f222c003720 0x7f222c003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:56.827 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.816+0000 7f224887d700 1 --2- 172.21.15.174:0/1298536027 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f222c0044d0 0x7f222c004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:56.827 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.816+0000 7f224887d700 1 --2- 172.21.15.174:0/1298536027 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f222c004db0 0x7f222c00b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:56.827 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.816+0000 7f224887d700 1 -- 172.21.15.174:0/1298536027 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2244060000 con 0x7f222c0044d0 2020-04-02T23:46:56.827 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.816+0000 7f224887d700 1 -- 172.21.15.174:0/1298536027 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f222c0041c0 con 0x7f222c004db0 2020-04-02T23:46:56.828 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.816+0000 7f224887d700 1 -- 172.21.15.174:0/1298536027 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f222c00bb80 con 0x7f222c003720 2020-04-02T23:46:56.828 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.817+0000 7f224907e700 1 --2- 172.21.15.174:0/1298536027 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f222c0044d0 0x7f222c004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:56.828 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.817+0000 7f224a080700 1 --2- 172.21.15.174:0/1298536027 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f222c004db0 0x7f222c00b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:56.828 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.817+0000 7f224987f700 1 --2- 172.21.15.174:0/1298536027 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f222c003720 0x7f222c003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:56.828 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.817+0000 7f224907e700 1 -- 172.21.15.174:0/1298536027 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f222c003720 msgr2=0x7f222c003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:46:56.828 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.817+0000 7f224907e700 1 --2- 172.21.15.174:0/1298536027 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f222c003720 0x7f222c003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:56.828 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.817+0000 7f224907e700 1 -- 172.21.15.174:0/1298536027 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f222c004db0 msgr2=0x7f222c00b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:46:56.828 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.817+0000 7f224907e700 1 --2- 172.21.15.174:0/1298536027 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f222c004db0 0x7f222c00b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:56.829 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.817+0000 7f224a080700 1 -- 172.21.15.174:0/1298536027 reap_dead start 2020-04-02T23:46:56.829 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.817+0000 7f224907e700 1 -- 172.21.15.174:0/1298536027 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f222c003230 con 0x7f222c0044d0 2020-04-02T23:46:56.829 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.817+0000 7f224907e700 1 --2- 172.21.15.174:0/1298536027 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f222c0044d0 0x7f222c004950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2234008910 tx=0x7f2234010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:56.829 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.817+0000 7f224907e700 1 --2- 172.21.15.174:0/1298536027 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f222c0044d0 0x7f222c004950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2234008910 tx=0x7f2234010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:56.829 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.817+0000 7f224907e700 1 --2- 172.21.15.174:0/1298536027 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f222c0044d0 0x7f222c004950 secure :-1 s=READY pgs=244 cs=0 l=1 rx=0x7f2234008910 tx=0x7f2234010050).ready entity=mon.0 client_cookie=79eb05b881ded622 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:56.829 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.817+0000 7f224907e700 1 --2- 172.21.15.174:0/1298536027 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f222c0044d0 0x7f222c004950 secure :-1 s=THROTTLE_DONE pgs=244 cs=0 l=1 rx=0x7f2234008910 tx=0x7f2234010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:56.830 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.817+0000 7f224887d700 1 -- 172.21.15.174:0/1298536027 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2234008d30 con 0x7f222c0044d0 2020-04-02T23:46:56.830 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.817+0000 7f224907e700 1 --2- 172.21.15.174:0/1298536027 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f222c0044d0 0x7f222c004950 secure :-1 s=THROTTLE_DONE pgs=244 cs=0 l=1 rx=0x7f2234008910 tx=0x7f2234010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:56.830 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.817+0000 7f224887d700 1 -- 172.21.15.174:0/1298536027 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2234008e90 con 0x7f222c0044d0 2020-04-02T23:46:56.830 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.817+0000 7f224907e700 1 --2- 172.21.15.174:0/1298536027 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f222c0044d0 0x7f222c004950 secure :-1 s=THROTTLE_DONE pgs=244 cs=0 l=1 rx=0x7f2234008910 tx=0x7f2234010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:56.830 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.817+0000 7f224887d700 1 -- 172.21.15.174:0/1298536027 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2234010a80 con 0x7f222c0044d0 2020-04-02T23:46:56.830 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.817+0000 7f224bae3700 1 -- 172.21.15.174:0/1298536027 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f222c0044d0 msgr2=0x7f222c004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:56.830 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.817+0000 7f224bae3700 1 --2- 172.21.15.174:0/1298536027 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f222c0044d0 0x7f222c004950 secure :-1 s=READY pgs=244 cs=0 l=1 rx=0x7f2234008910 tx=0x7f2234010050).stop 2020-04-02T23:46:56.831 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.818+0000 7f224bae3700 1 -- 172.21.15.174:0/1298536027 shutdown_connections 2020-04-02T23:46:56.831 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.818+0000 7f224bae3700 1 --2- 172.21.15.174:0/1298536027 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f222c0044d0 0x7f222c004950 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:56.831 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.818+0000 7f224bae3700 1 -- 172.21.15.174:0/1298536027 >> 172.21.15.174:0/1298536027 conn(0x7f22440a8050 msgr2=0x7f22440a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:46:56.831 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.818+0000 7f224bae3700 1 -- 172.21.15.174:0/1298536027 shutdown_connections 2020-04-02T23:46:56.831 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.818+0000 7f224bae3700 1 -- 172.21.15.174:0/1298536027 wait complete. 2020-04-02T23:46:56.831 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.818+0000 7f224bae3700 1 Processor -- start 2020-04-02T23:46:56.831 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.818+0000 7f224bae3700 1 -- start start 2020-04-02T23:46:56.832 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.819+0000 7f224bae3700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f22440a2c70 0x7f22441355c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:56.832 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.819+0000 7f224bae3700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2244131380 0x7f2244131830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:56.832 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.819+0000 7f224bae3700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22440a5680 con 0x7f222c0044d0 2020-04-02T23:46:56.832 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.819+0000 7f224bae3700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22440a4300 con 0x7f22440a2c70 2020-04-02T23:46:56.832 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.819+0000 7f224bae3700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22440a44f0 con 0x7f2244131380 2020-04-02T23:46:56.832 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.819+0000 7f224907e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f22440a2c70 0x7f22441355c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:56.832 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.819+0000 7f224907e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f22440a2c70 0x7f22441355c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:40664/0 (socket says 172.21.15.174:40664) 2020-04-02T23:46:56.833 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.819+0000 7f224907e700 1 -- 172.21.15.174:0/700557835 learned_addr learned my addr 172.21.15.174:0/700557835 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:46:56.833 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.819+0000 7f224a080700 1 --2- 172.21.15.174:0/700557835 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2244131380 0x7f2244131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:56.833 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.819+0000 7f224907e700 1 -- 172.21.15.174:0/700557835 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2244131380 msgr2=0x7f2244131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:56.833 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.819+0000 7f224907e700 1 --2- 172.21.15.174:0/700557835 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2244131380 0x7f2244131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:56.833 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.819+0000 7f2232ffd700 1 -- 172.21.15.174:0/700557835 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3445289004 0 0) 0x7f22440a5680 con 0x7f222c0044d0 2020-04-02T23:46:56.833 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.819+0000 7f224907e700 1 -- 172.21.15.174:0/700557835 >> v1:172.21.15.196:6789/0 conn(0x7f222c0044d0 legacy=0x7f2244134720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:56.833 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.819+0000 7f224907e700 1 -- 172.21.15.174:0/700557835 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22440a5370 con 0x7f22440a2c70 2020-04-02T23:46:56.833 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.819+0000 7f224907e700 1 --2- 172.21.15.174:0/700557835 >> v2:172.21.15.174:3300/0 conn(0x7f22440a2c70 0x7f22441355c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2244134e90 tx=0x7f2234010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:56.834 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.819+0000 7f224907e700 1 --2- 172.21.15.174:0/700557835 >> v2:172.21.15.174:3300/0 conn(0x7f22440a2c70 0x7f22441355c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2244134e90 tx=0x7f2234010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:56.834 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.819+0000 7f224907e700 1 --2- 172.21.15.174:0/700557835 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22440a2c70 0x7f22441355c0 secure :-1 s=READY pgs=245 cs=0 l=1 rx=0x7f2244134e90 tx=0x7f2234010050).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:56.834 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.820+0000 7f224907e700 1 --2- 172.21.15.174:0/700557835 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22440a2c70 0x7f22441355c0 secure :-1 s=THROTTLE_DONE pgs=245 cs=0 l=1 rx=0x7f2244134e90 tx=0x7f2234010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:56.834 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.820+0000 7f2232ffd700 1 -- 172.21.15.174:0/700557835 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2234010e60 con 0x7f22440a2c70 2020-04-02T23:46:56.834 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.820+0000 7f224907e700 1 --2- 172.21.15.174:0/700557835 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22440a2c70 0x7f22441355c0 secure :-1 s=THROTTLE_DONE pgs=245 cs=0 l=1 rx=0x7f2244134e90 tx=0x7f2234010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:56.834 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.820+0000 7f224907e700 1 --2- 172.21.15.174:0/700557835 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22440a2c70 0x7f22441355c0 secure :-1 s=THROTTLE_DONE pgs=245 cs=0 l=1 rx=0x7f2244134e90 tx=0x7f2234010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:56.834 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.820+0000 7f2232ffd700 1 -- 172.21.15.174:0/700557835 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2234005ac0 con 0x7f22440a2c70 2020-04-02T23:46:56.835 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.820+0000 7f224bae3700 1 -- 172.21.15.174:0/700557835 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22440a1fb0 con 0x7f22440a2c70 2020-04-02T23:46:56.835 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.820+0000 7f2232ffd700 1 -- 172.21.15.174:0/700557835 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2234005e20 con 0x7f22440a2c70 2020-04-02T23:46:56.835 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.820+0000 7f224bae3700 1 -- 172.21.15.174:0/700557835 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22440a4b50 con 0x7f22440a2c70 2020-04-02T23:46:56.835 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.820+0000 7f224907e700 1 --2- 172.21.15.174:0/700557835 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22440a2c70 0x7f22441355c0 secure :-1 s=THROTTLE_DONE pgs=245 cs=0 l=1 rx=0x7f2244134e90 tx=0x7f2234010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:56.835 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.821+0000 7f224bae3700 1 -- 172.21.15.174:0/700557835 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f22440a46f0 con 0x7f22440a2c70 2020-04-02T23:46:56.835 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.821+0000 7f2232ffd700 1 -- 172.21.15.174:0/700557835 <== mon.0 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f223400f1f0 con 0x7f22440a2c70 2020-04-02T23:46:56.835 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.821+0000 7f224907e700 1 --2- 172.21.15.174:0/700557835 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22440a2c70 0x7f22441355c0 secure :-1 s=THROTTLE_DONE pgs=245 cs=0 l=1 rx=0x7f2244134e90 tx=0x7f2234010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:56.836 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.821+0000 7f224907e700 1 --2- 172.21.15.174:0/700557835 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22440a2c70 0x7f22441355c0 secure :-1 s=THROTTLE_DONE pgs=245 cs=0 l=1 rx=0x7f2244134e90 tx=0x7f2234010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:56.836 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.821+0000 7f2232ffd700 1 --2- 172.21.15.174:0/700557835 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f222404d4c0 0x7f222404f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:56.836 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.821+0000 7f2232ffd700 1 -- 172.21.15.174:0/700557835 <== mon.0 v2:172.21.15.174:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f22340610a0 con 0x7f22440a2c70 2020-04-02T23:46:56.836 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.821+0000 7f2232ffd700 1 --2- 172.21.15.174:0/700557835 >> [v2:172.21.15.174:6824/24972,v1:172.21.15.174:6825/24972] conn(0x7f22240540a0 0x7f22240564c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:56.836 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.821+0000 7f2232ffd700 1 -- 172.21.15.174:0/700557835 --> [v2:172.21.15.174:6824/24972,v1:172.21.15.174:6825/24972] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2224056a80 con 0x7f22240540a0 2020-04-02T23:46:56.836 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.821+0000 7f224987f700 1 --2- 172.21.15.174:0/700557835 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f222404d4c0 0x7f222404f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:56.836 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.821+0000 7f2232ffd700 1 -- 172.21.15.174:0/700557835 <== mon.0 v2:172.21.15.174:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2234062500 con 0x7f22440a2c70 2020-04-02T23:46:56.837 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.821+0000 7f224a080700 1 --2- 172.21.15.174:0/700557835 >> [v2:172.21.15.174:6824/24972,v1:172.21.15.174:6825/24972] conn(0x7f22240540a0 0x7f22240564c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:56.837 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.821+0000 7f224987f700 1 --2- 172.21.15.174:0/700557835 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f222404d4c0 0x7f222404f980 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2240000fa0 tx=0x7f2240003dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:56.837 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.821+0000 7f224987f700 1 --2- 172.21.15.174:0/700557835 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f222404d4c0 0x7f222404f980 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2240000fa0 tx=0x7f2240003dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:56.837 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.821+0000 7f224987f700 1 --2- 172.21.15.174:0/700557835 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f222404d4c0 0x7f222404f980 secure :-1 s=READY pgs=131 cs=0 l=1 rx=0x7f2240000fa0 tx=0x7f2240003dc0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:56.837 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.821+0000 7f224a080700 1 --2- 172.21.15.174:0/700557835 >> [v2:172.21.15.174:6824/24972,v1:172.21.15.174:6825/24972] conn(0x7f22240540a0 0x7f22240564c0 crc :-1 s=READY pgs=12 cs=0 l=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:56.837 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.822+0000 7f2232ffd700 1 -- 172.21.15.174:0/700557835 <== osd.3 v2:172.21.15.174:6824/24972 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21407 (crc 0 0 0) 0x7f2224056a80 con 0x7f22240540a0 2020-04-02T23:46:56.839 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.837+0000 7f224bae3700 1 -- 172.21.15.174:0/700557835 --> [v2:172.21.15.174:6824/24972,v1:172.21.15.174:6825/24972] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f2244056c50 con 0x7f22240540a0 2020-04-02T23:46:56.839 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.837+0000 7f2232ffd700 1 -- 172.21.15.174:0/700557835 <== osd.3 v2:172.21.15.174:6824/24972 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f2244056c50 con 0x7f22240540a0 2020-04-02T23:46:56.839 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2020-04-02T23:46:56.839 INFO:teuthology.orchestra.run.smithi174.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-04-02T23:46:56.840 INFO:teuthology.orchestra.run.smithi174.stdout:} 2020-04-02T23:46:56.841 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.837+0000 7f224bae3700 1 -- 172.21.15.174:0/700557835 >> [v2:172.21.15.174:6824/24972,v1:172.21.15.174:6825/24972] conn(0x7f22240540a0 msgr2=0x7f22240564c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:56.841 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.837+0000 7f224bae3700 1 --2- 172.21.15.174:0/700557835 >> [v2:172.21.15.174:6824/24972,v1:172.21.15.174:6825/24972] conn(0x7f22240540a0 0x7f22240564c0 crc :-1 s=READY pgs=12 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:56.841 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.837+0000 7f224bae3700 1 -- 172.21.15.174:0/700557835 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f222404d4c0 msgr2=0x7f222404f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:56.841 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.837+0000 7f224bae3700 1 --2- 172.21.15.174:0/700557835 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f222404d4c0 0x7f222404f980 secure :-1 s=READY pgs=131 cs=0 l=1 rx=0x7f2240000fa0 tx=0x7f2240003dc0).stop 2020-04-02T23:46:56.841 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.837+0000 7f224bae3700 1 -- 172.21.15.174:0/700557835 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22440a2c70 msgr2=0x7f22441355c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:56.842 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.837+0000 7f224bae3700 1 --2- 172.21.15.174:0/700557835 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22440a2c70 0x7f22441355c0 secure :-1 s=READY pgs=245 cs=0 l=1 rx=0x7f2244134e90 tx=0x7f2234010050).stop 2020-04-02T23:46:56.842 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.837+0000 7f224a080700 1 -- 172.21.15.174:0/700557835 reap_dead start 2020-04-02T23:46:56.842 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.837+0000 7f224bae3700 1 -- 172.21.15.174:0/700557835 shutdown_connections 2020-04-02T23:46:56.842 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.837+0000 7f224bae3700 1 --2- 172.21.15.174:0/700557835 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22440a2c70 0x7f22441355c0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:56.842 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.837+0000 7f224bae3700 1 -- 172.21.15.174:0/700557835 >> 172.21.15.174:0/700557835 conn(0x7f22440a8050 msgr2=0x7f22440abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:46:56.842 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.837+0000 7f224bae3700 1 -- 172.21.15.174:0/700557835 shutdown_connections 2020-04-02T23:46:56.842 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:56.837+0000 7f224bae3700 1 -- 172.21.15.174:0/700557835 wait complete. 2020-04-02T23:46:56.849 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:46:56.862 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd deep-scrub 3 2020-04-02T23:46:57.008 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.006+0000 7ff247fff700 1 Processor -- start 2020-04-02T23:46:57.008 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.006+0000 7ff247fff700 1 -- start start 2020-04-02T23:46:57.014 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.006+0000 7ff247fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff24805bf90 0x7ff2480a32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:57.014 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.006+0000 7ff247fff700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff248067090 con 0x7ff24809ee60 2020-04-02T23:46:57.014 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.006+0000 7ff247fff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff24809ea00 con 0x7ff24809fa00 2020-04-02T23:46:57.015 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.006+0000 7ff247fff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff24809e810 con 0x7ff24805bf90 2020-04-02T23:46:57.015 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.006+0000 7ff246ffd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff24805bf90 0x7ff2480a32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:57.015 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.006+0000 7ff2467fc700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7ff24809ee60 0x7ff24809f2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:45710/0 (socket says 172.21.15.174:45710) 2020-04-02T23:46:57.015 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.007+0000 7ff2467fc700 1 -- 172.21.15.174:0/906057324 learned_addr learned my addr 172.21.15.174:0/906057324 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:46:57.015 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.007+0000 7ff246ffd700 1 -- 172.21.15.174:0/906057324 >> v1:172.21.15.196:6789/0 conn(0x7ff24809fa00 legacy=0x7ff24813fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:57.015 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.007+0000 7ff246ffd700 1 -- 172.21.15.174:0/906057324 >> v1:172.21.15.174:6789/0 conn(0x7ff24809ee60 legacy=0x7ff24809f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:57.015 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.007+0000 7ff246ffd700 1 -- 172.21.15.174:0/906057324 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff24809e140 con 0x7ff24805bf90 2020-04-02T23:46:57.016 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.007+0000 7ff245ffb700 1 -- 172.21.15.174:0/906057324 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3413302398 0 0) 0x7ff248067090 con 0x7ff24809ee60 2020-04-02T23:46:57.016 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.007+0000 7ff246ffd700 1 --2- 172.21.15.174:0/906057324 >> v2:172.21.15.174:3300/0 conn(0x7ff24805bf90 0x7ff2480a32b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff23c002f30 tx=0x7ff23c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:57.016 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.007+0000 7ff246ffd700 1 --2- 172.21.15.174:0/906057324 >> v2:172.21.15.174:3300/0 conn(0x7ff24805bf90 0x7ff2480a32b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff23c002f30 tx=0x7ff23c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:57.016 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.007+0000 7ff246ffd700 1 --2- 172.21.15.174:0/906057324 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff24805bf90 0x7ff2480a32b0 secure :-1 s=READY pgs=247 cs=0 l=1 rx=0x7ff23c002f30 tx=0x7ff23c007a40).ready entity=mon.0 client_cookie=2a8089e68fb97f06 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:57.016 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.007+0000 7ff246ffd700 1 --2- 172.21.15.174:0/906057324 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff24805bf90 0x7ff2480a32b0 secure :-1 s=THROTTLE_DONE pgs=247 cs=0 l=1 rx=0x7ff23c002f30 tx=0x7ff23c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:57.016 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.007+0000 7ff245ffb700 1 -- 172.21.15.174:0/906057324 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff23c011470 con 0x7ff24805bf90 2020-04-02T23:46:57.016 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.007+0000 7ff246ffd700 1 --2- 172.21.15.174:0/906057324 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff24805bf90 0x7ff2480a32b0 secure :-1 s=THROTTLE_DONE pgs=247 cs=0 l=1 rx=0x7ff23c002f30 tx=0x7ff23c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:57.017 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.007+0000 7ff245ffb700 1 -- 172.21.15.174:0/906057324 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff23c0115d0 con 0x7ff24805bf90 2020-04-02T23:46:57.017 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.007+0000 7ff246ffd700 1 --2- 172.21.15.174:0/906057324 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff24805bf90 0x7ff2480a32b0 secure :-1 s=THROTTLE_DONE pgs=247 cs=0 l=1 rx=0x7ff23c002f30 tx=0x7ff23c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:57.017 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.007+0000 7ff245ffb700 1 -- 172.21.15.174:0/906057324 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff23c0119b0 con 0x7ff24805bf90 2020-04-02T23:46:57.017 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.007+0000 7ff247fff700 1 -- 172.21.15.174:0/906057324 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff24805bf90 msgr2=0x7ff2480a32b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:57.017 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.007+0000 7ff247fff700 1 --2- 172.21.15.174:0/906057324 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff24805bf90 0x7ff2480a32b0 secure :-1 s=READY pgs=247 cs=0 l=1 rx=0x7ff23c002f30 tx=0x7ff23c007a40).stop 2020-04-02T23:46:57.017 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.008+0000 7ff247fff700 1 -- 172.21.15.174:0/906057324 shutdown_connections 2020-04-02T23:46:57.017 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.008+0000 7ff247fff700 1 --2- 172.21.15.174:0/906057324 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff24805bf90 0x7ff2480a32b0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:57.017 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.008+0000 7ff247fff700 1 -- 172.21.15.174:0/906057324 >> 172.21.15.174:0/906057324 conn(0x7ff2480a6d00 msgr2=0x7ff2480a7110 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:46:57.018 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.008+0000 7ff247fff700 1 -- 172.21.15.174:0/906057324 shutdown_connections 2020-04-02T23:46:57.018 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.008+0000 7ff247fff700 1 -- 172.21.15.174:0/906057324 wait complete. 2020-04-02T23:46:57.018 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.008+0000 7ff247fff700 1 Processor -- start 2020-04-02T23:46:57.018 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.008+0000 7ff247fff700 1 -- start start 2020-04-02T23:46:57.018 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.009+0000 7ff247fff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff24809ee60 0x7ff2480648d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:57.018 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.009+0000 7ff247fff700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff248064d30 con 0x7ff24805bf90 2020-04-02T23:46:57.018 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.009+0000 7ff247fff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff248065a20 con 0x7ff24809fa00 2020-04-02T23:46:57.019 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.009+0000 7ff247fff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff248063ef0 con 0x7ff24809ee60 2020-04-02T23:46:57.019 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.009+0000 7ff246ffd700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7ff24805bf90 0x7ff2480637e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:45716/0 (socket says 172.21.15.174:45716) 2020-04-02T23:46:57.019 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.009+0000 7ff246ffd700 1 -- 172.21.15.174:0/2064534196 learned_addr learned my addr 172.21.15.174:0/2064534196 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:46:57.019 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.009+0000 7ff2467fc700 1 --2- 172.21.15.174:0/2064534196 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff24809ee60 0x7ff2480648d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:57.019 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.009+0000 7ff237fff700 1 -- 172.21.15.174:0/2064534196 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2062862672 0 0) 0x7ff24809e140 con 0x7ff24805bf90 2020-04-02T23:46:57.019 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.009+0000 7ff237fff700 1 -- 172.21.15.174:0/2064534196 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff224002fe0 con 0x7ff24805bf90 2020-04-02T23:46:57.019 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.009+0000 7ff237fff700 1 -- 172.21.15.174:0/2064534196 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4002316986 0 0) 0x7ff248065a20 con 0x7ff24809fa00 2020-04-02T23:46:57.020 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.009+0000 7ff237fff700 1 -- 172.21.15.174:0/2064534196 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff24809e140 con 0x7ff24809fa00 2020-04-02T23:46:57.020 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.010+0000 7ff237fff700 1 -- 172.21.15.174:0/2064534196 <== mon.0 v1:172.21.15.174:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3142884628 0 0) 0x7ff224002fe0 con 0x7ff24805bf90 2020-04-02T23:46:57.020 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.010+0000 7ff237fff700 1 -- 172.21.15.174:0/2064534196 --> v1:172.21.15.174:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff248065a20 con 0x7ff24805bf90 2020-04-02T23:46:57.020 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.010+0000 7ff237fff700 1 -- 172.21.15.174:0/2064534196 <== mon.0 v1:172.21.15.174:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2811762909 0 0) 0x7ff23c008e10 con 0x7ff24805bf90 2020-04-02T23:46:57.020 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.010+0000 7ff2467fc700 1 -- 172.21.15.174:0/2064534196 >> v1:172.21.15.196:6789/0 conn(0x7ff24809fa00 legacy=0x7ff24814d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:57.020 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.010+0000 7ff2467fc700 1 -- 172.21.15.174:0/2064534196 >> v1:172.21.15.174:6789/0 conn(0x7ff24805bf90 legacy=0x7ff2480637e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:57.021 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.010+0000 7ff2467fc700 1 -- 172.21.15.174:0/2064534196 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff248065cc0 con 0x7ff24809ee60 2020-04-02T23:46:57.021 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.010+0000 7ff2467fc700 1 --2- 172.21.15.174:0/2064534196 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff24809ee60 0x7ff2480648d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff238000b80 tx=0x7ff2380108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:57.021 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.010+0000 7ff2467fc700 1 --2- 172.21.15.174:0/2064534196 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff24809ee60 0x7ff2480648d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff238000b80 tx=0x7ff2380108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:57.021 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.010+0000 7ff2467fc700 1 --2- 172.21.15.174:0/2064534196 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff24809ee60 0x7ff2480648d0 secure :-1 s=READY pgs=45 cs=0 l=1 rx=0x7ff238000b80 tx=0x7ff2380108e0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:57.021 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.010+0000 7ff2467fc700 1 --2- 172.21.15.174:0/2064534196 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff24809ee60 0x7ff2480648d0 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7ff238000b80 tx=0x7ff2380108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:57.021 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.010+0000 7ff237fff700 1 -- 172.21.15.174:0/2064534196 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff238005a90 con 0x7ff24809ee60 2020-04-02T23:46:57.021 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.010+0000 7ff2467fc700 1 --2- 172.21.15.174:0/2064534196 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff24809ee60 0x7ff2480648d0 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7ff238000b80 tx=0x7ff2380108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:57.021 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.010+0000 7ff237fff700 1 -- 172.21.15.174:0/2064534196 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff238005bf0 con 0x7ff24809ee60 2020-04-02T23:46:57.022 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.010+0000 7ff2467fc700 1 --2- 172.21.15.174:0/2064534196 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff24809ee60 0x7ff2480648d0 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7ff238000b80 tx=0x7ff2380108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:57.022 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.010+0000 7ff247fff700 1 -- 172.21.15.174:0/2064534196 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2480662e0 con 0x7ff24809ee60 2020-04-02T23:46:57.022 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.010+0000 7ff237fff700 1 -- 172.21.15.174:0/2064534196 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2380060c0 con 0x7ff24809ee60 2020-04-02T23:46:57.022 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.010+0000 7ff247fff700 1 -- 172.21.15.174:0/2064534196 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2480a08f0 con 0x7ff24809ee60 2020-04-02T23:46:57.022 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.011+0000 7ff2467fc700 1 --2- 172.21.15.174:0/2064534196 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff24809ee60 0x7ff2480648d0 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7ff238000b80 tx=0x7ff2380108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:57.022 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.011+0000 7ff247fff700 1 -- 172.21.15.174:0/2064534196 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff248064440 con 0x7ff24809ee60 2020-04-02T23:46:57.022 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.011+0000 7ff237fff700 1 -- 172.21.15.174:0/2064534196 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7ff23800a320 con 0x7ff24809ee60 2020-04-02T23:46:57.023 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.011+0000 7ff2467fc700 1 --2- 172.21.15.174:0/2064534196 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff24809ee60 0x7ff2480648d0 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7ff238000b80 tx=0x7ff2380108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:57.023 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.011+0000 7ff237fff700 1 --2- 172.21.15.174:0/2064534196 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7ff22404dcb0 0x7ff224050170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:57.023 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.011+0000 7ff237fff700 1 -- 172.21.15.174:0/2064534196 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff238060bc0 con 0x7ff24809ee60 2020-04-02T23:46:57.023 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.011+0000 7ff246ffd700 1 --2- 172.21.15.174:0/2064534196 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7ff22404dcb0 0x7ff224050170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:57.023 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.012+0000 7ff246ffd700 1 --2- 172.21.15.174:0/2064534196 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7ff22404dcb0 0x7ff224050170 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff23c010240 tx=0x7ff23c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:57.023 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.012+0000 7ff246ffd700 1 --2- 172.21.15.174:0/2064534196 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7ff22404dcb0 0x7ff224050170 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff23c010240 tx=0x7ff23c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:57.023 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.012+0000 7ff246ffd700 1 --2- 172.21.15.174:0/2064534196 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7ff22404dcb0 0x7ff224050170 secure :-1 s=READY pgs=132 cs=0 l=1 rx=0x7ff23c010240 tx=0x7ff23c007a40).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:57.024 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.015+0000 7ff2467fc700 1 --2- 172.21.15.174:0/2064534196 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff24809ee60 0x7ff2480648d0 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7ff238000b80 tx=0x7ff2380108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:57.024 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.015+0000 7ff237fff700 1 -- 172.21.15.174:0/2064534196 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7ff23803c240 con 0x7ff24809ee60 2020-04-02T23:46:57.152 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.150+0000 7ff247fff700 1 -- 172.21.15.174:0/2064534196 --> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7ff248066780 con 0x7ff22404dcb0 2020-04-02T23:46:57.152 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.150+0000 7ff246ffd700 1 --2- 172.21.15.174:0/2064534196 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7ff22404dcb0 0x7ff224050170 secure :-1 s=THROTTLE_DONE pgs=132 cs=0 l=1 rx=0x7ff23c010240 tx=0x7ff23c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:57.153 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.150+0000 7ff237fff700 1 -- 172.21.15.174:0/2064534196 <== mgr.4102 v2:172.21.15.196:6800/23210 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff23c011be0 con 0x7ff22404dcb0 2020-04-02T23:46:57.154 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.152+0000 7ff247fff700 1 -- 172.21.15.174:0/2064534196 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7ff22404dcb0 msgr2=0x7ff224050170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:57.155 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.152+0000 7ff247fff700 1 --2- 172.21.15.174:0/2064534196 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7ff22404dcb0 0x7ff224050170 secure :-1 s=READY pgs=132 cs=0 l=1 rx=0x7ff23c010240 tx=0x7ff23c007a40).stop 2020-04-02T23:46:57.155 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.152+0000 7ff247fff700 1 -- 172.21.15.174:0/2064534196 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff24809ee60 msgr2=0x7ff2480648d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:57.155 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.152+0000 7ff247fff700 1 --2- 172.21.15.174:0/2064534196 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff24809ee60 0x7ff2480648d0 secure :-1 s=READY pgs=45 cs=0 l=1 rx=0x7ff238000b80 tx=0x7ff2380108e0).stop 2020-04-02T23:46:57.155 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.152+0000 7ff247fff700 1 -- 172.21.15.174:0/2064534196 shutdown_connections 2020-04-02T23:46:57.155 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.152+0000 7ff247fff700 1 --2- 172.21.15.174:0/2064534196 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7ff22404dcb0 0x7ff224050170 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:57.155 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.152+0000 7ff247fff700 1 --2- 172.21.15.174:0/2064534196 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff24809ee60 0x7ff2480648d0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:57.155 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.152+0000 7ff247fff700 1 -- 172.21.15.174:0/2064534196 >> 172.21.15.174:0/2064534196 conn(0x7ff2480a6d00 msgr2=0x7ff2480a70e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:46:57.156 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.152+0000 7ff247fff700 1 -- 172.21.15.174:0/2064534196 shutdown_connections 2020-04-02T23:46:57.156 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.152+0000 7ff247fff700 1 -- 172.21.15.174:0/2064534196 wait complete. 2020-04-02T23:46:57.156 INFO:teuthology.orchestra.run.smithi174.stderr:instructed osd(s) 3 to deep-scrub 2020-04-02T23:46:57.164 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:46:57.177 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-04-02T23:46:57.322 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.319+0000 7fd441b69700 1 Processor -- start 2020-04-02T23:46:57.322 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.320+0000 7fd441b69700 1 -- start start 2020-04-02T23:46:57.325 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.320+0000 7fd441b69700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd43c0a5900 0x7fd43c135030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:57.325 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.320+0000 7fd441b69700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fd43c05ac00 0x7fd43c12e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:46:57.325 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.320+0000 7fd441b69700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd43c134420 con 0x7fd43c12e6c0 2020-04-02T23:46:57.325 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.320+0000 7fd441b69700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd43c0a49d0 con 0x7fd43c05ac00 2020-04-02T23:46:57.325 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.320+0000 7fd441b69700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd43c05b080 con 0x7fd43c0a5900 2020-04-02T23:46:57.326 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.320+0000 7fd43bfff700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fd43c12e6c0 0x7fd43c1379f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:45728/0 (socket says 172.21.15.174:45728) 2020-04-02T23:46:57.326 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.320+0000 7fd43bfff700 1 -- 172.21.15.174:0/293760349 learned_addr learned my addr 172.21.15.174:0/293760349 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:46:57.326 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.320+0000 7fd43b7fe700 1 --2- 172.21.15.174:0/293760349 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd43c0a5900 0x7fd43c135030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:57.326 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.320+0000 7fd43affd700 1 --2- 172.21.15.174:0/293760349 >> v2:172.21.15.196:3300/0 conn(0x7fd43c05ac00 0x7fd43c12e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:57.326 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.321+0000 7fd43a7fc700 1 -- 172.21.15.174:0/293760349 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1302863108 0 0) 0x7fd43c134420 con 0x7fd43c12e6c0 2020-04-02T23:46:57.326 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.321+0000 7fd43a7fc700 1 -- 172.21.15.174:0/293760349 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd428003230 con 0x7fd43c12e6c0 2020-04-02T23:46:57.326 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.321+0000 7fd43affd700 1 -- 172.21.15.174:0/293760349 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd43c0a5900 msgr2=0x7fd43c135030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:46:57.326 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.321+0000 7fd43affd700 1 --2- 172.21.15.174:0/293760349 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd43c0a5900 0x7fd43c135030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:57.327 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.321+0000 7fd43affd700 1 -- 172.21.15.174:0/293760349 >> v1:172.21.15.174:6789/0 conn(0x7fd43c12e6c0 legacy=0x7fd43c1379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:57.327 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.321+0000 7fd43affd700 1 -- 172.21.15.174:0/293760349 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd43c134650 con 0x7fd43c05ac00 2020-04-02T23:46:57.327 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.321+0000 7fd43b7fe700 1 --2- 172.21.15.174:0/293760349 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd43c0a5900 0x7fd43c135030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:46:57.327 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.321+0000 7fd43affd700 1 --2- 172.21.15.174:0/293760349 >> v2:172.21.15.196:3300/0 conn(0x7fd43c05ac00 0x7fd43c12e260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd430002f30 tx=0x7fd430007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:57.327 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.321+0000 7fd43affd700 1 --2- 172.21.15.174:0/293760349 >> v2:172.21.15.196:3300/0 conn(0x7fd43c05ac00 0x7fd43c12e260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd430002f30 tx=0x7fd430007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:57.327 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.321+0000 7fd43affd700 1 --2- 172.21.15.174:0/293760349 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd43c05ac00 0x7fd43c12e260 secure :-1 s=READY pgs=173 cs=0 l=1 rx=0x7fd430002f30 tx=0x7fd430007a40).ready entity=mon.1 client_cookie=2743f8cfa1f8c60e server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:57.327 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.321+0000 7fd43affd700 1 --2- 172.21.15.174:0/293760349 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd43c05ac00 0x7fd43c12e260 secure :-1 s=THROTTLE_DONE pgs=173 cs=0 l=1 rx=0x7fd430002f30 tx=0x7fd430007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:57.327 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.321+0000 7fd43a7fc700 1 -- 172.21.15.174:0/293760349 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd430011310 con 0x7fd43c05ac00 2020-04-02T23:46:57.328 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.321+0000 7fd43affd700 1 --2- 172.21.15.174:0/293760349 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd43c05ac00 0x7fd43c12e260 secure :-1 s=THROTTLE_DONE pgs=173 cs=0 l=1 rx=0x7fd430002f30 tx=0x7fd430007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:57.328 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.321+0000 7fd43a7fc700 1 -- 172.21.15.174:0/293760349 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd430011470 con 0x7fd43c05ac00 2020-04-02T23:46:57.328 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.321+0000 7fd43affd700 1 --2- 172.21.15.174:0/293760349 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd43c05ac00 0x7fd43c12e260 secure :-1 s=THROTTLE_DONE pgs=173 cs=0 l=1 rx=0x7fd430002f30 tx=0x7fd430007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:57.328 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.321+0000 7fd43a7fc700 1 -- 172.21.15.174:0/293760349 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd430011850 con 0x7fd43c05ac00 2020-04-02T23:46:57.328 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.321+0000 7fd441b69700 1 -- 172.21.15.174:0/293760349 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd43c05ac00 msgr2=0x7fd43c12e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:57.328 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.321+0000 7fd441b69700 1 --2- 172.21.15.174:0/293760349 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd43c05ac00 0x7fd43c12e260 secure :-1 s=READY pgs=173 cs=0 l=1 rx=0x7fd430002f30 tx=0x7fd430007a40).stop 2020-04-02T23:46:57.328 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.322+0000 7fd441b69700 1 -- 172.21.15.174:0/293760349 shutdown_connections 2020-04-02T23:46:57.329 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.322+0000 7fd441b69700 1 --2- 172.21.15.174:0/293760349 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd43c0a5900 0x7fd43c135030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:46:57.329 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.322+0000 7fd441b69700 1 --2- 172.21.15.174:0/293760349 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd43c05ac00 0x7fd43c12e260 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:57.329 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.322+0000 7fd441b69700 1 -- 172.21.15.174:0/293760349 >> 172.21.15.174:0/293760349 conn(0x7fd43c0aaf80 msgr2=0x7fd43c0a6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:46:57.329 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.322+0000 7fd441b69700 1 -- 172.21.15.174:0/293760349 shutdown_connections 2020-04-02T23:46:57.329 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.322+0000 7fd441b69700 1 -- 172.21.15.174:0/293760349 wait complete. 2020-04-02T23:46:57.329 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.322+0000 7fd441b69700 1 Processor -- start 2020-04-02T23:46:57.329 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.323+0000 7fd441b69700 1 -- start start 2020-04-02T23:46:57.332 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.323+0000 7fd441b69700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd43c12e6c0 0x7fd43c09eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:57.333 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.323+0000 7fd441b69700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd43c09f340 con 0x7fd43c05ac00 2020-04-02T23:46:57.333 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.323+0000 7fd441b69700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd43c09f5b0 con 0x7fd43c0a5900 2020-04-02T23:46:57.333 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.323+0000 7fd441b69700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd43c143450 con 0x7fd43c12e6c0 2020-04-02T23:46:57.333 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.323+0000 7fd43b7fe700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fd43c05ac00 0x7fd43c12c8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:45730/0 (socket says 172.21.15.174:45730) 2020-04-02T23:46:57.333 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.323+0000 7fd43b7fe700 1 -- 172.21.15.174:0/807977405 learned_addr learned my addr 172.21.15.174:0/807977405 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:46:57.333 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.323+0000 7fd43bfff700 1 --2- 172.21.15.174:0/807977405 >> v2:172.21.15.174:3300/0 conn(0x7fd43c12e6c0 0x7fd43c09eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:57.333 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.323+0000 7fd438ff9700 1 -- 172.21.15.174:0/807977405 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1207690267 0 0) 0x7fd43c09f340 con 0x7fd43c05ac00 2020-04-02T23:46:57.334 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.323+0000 7fd438ff9700 1 -- 172.21.15.174:0/807977405 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd41c002fe0 con 0x7fd43c05ac00 2020-04-02T23:46:57.334 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.324+0000 7fd43bfff700 1 -- 172.21.15.174:0/807977405 >> v1:172.21.15.196:6789/0 conn(0x7fd43c0a5900 legacy=0x7fd43c143b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:57.336 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.324+0000 7fd438ff9700 1 -- 172.21.15.174:0/807977405 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3983595976 0 0) 0x7fd43c09f5b0 con 0x7fd43c0a5900 2020-04-02T23:46:57.336 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.324+0000 7fd43bfff700 1 -- 172.21.15.174:0/807977405 >> v1:172.21.15.174:6789/0 conn(0x7fd43c05ac00 legacy=0x7fd43c12c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:57.336 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.324+0000 7fd43bfff700 1 -- 172.21.15.174:0/807977405 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd43c1436f0 con 0x7fd43c12e6c0 2020-04-02T23:46:57.336 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.324+0000 7fd43bfff700 1 --2- 172.21.15.174:0/807977405 >> v2:172.21.15.174:3300/0 conn(0x7fd43c12e6c0 0x7fd43c09eee0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd434001450 tx=0x7fd434010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:57.336 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.324+0000 7fd43bfff700 1 --2- 172.21.15.174:0/807977405 >> v2:172.21.15.174:3300/0 conn(0x7fd43c12e6c0 0x7fd43c09eee0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd434001450 tx=0x7fd434010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:57.341 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.324+0000 7fd43bfff700 1 --2- 172.21.15.174:0/807977405 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd43c12e6c0 0x7fd43c09eee0 secure :-1 s=READY pgs=251 cs=0 l=1 rx=0x7fd434001450 tx=0x7fd434010bd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:57.341 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.324+0000 7fd43bfff700 1 --2- 172.21.15.174:0/807977405 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd43c12e6c0 0x7fd43c09eee0 secure :-1 s=THROTTLE_DONE pgs=251 cs=0 l=1 rx=0x7fd434001450 tx=0x7fd434010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:57.341 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.324+0000 7fd438ff9700 1 -- 172.21.15.174:0/807977405 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd434005e50 con 0x7fd43c12e6c0 2020-04-02T23:46:57.341 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.324+0000 7fd43bfff700 1 --2- 172.21.15.174:0/807977405 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd43c12e6c0 0x7fd43c09eee0 secure :-1 s=THROTTLE_DONE pgs=251 cs=0 l=1 rx=0x7fd434001450 tx=0x7fd434010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:57.341 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.324+0000 7fd438ff9700 1 -- 172.21.15.174:0/807977405 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd434012460 con 0x7fd43c12e6c0 2020-04-02T23:46:57.341 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.324+0000 7fd43bfff700 1 --2- 172.21.15.174:0/807977405 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd43c12e6c0 0x7fd43c09eee0 secure :-1 s=THROTTLE_DONE pgs=251 cs=0 l=1 rx=0x7fd434001450 tx=0x7fd434010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:57.341 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.324+0000 7fd438ff9700 1 -- 172.21.15.174:0/807977405 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd434012800 con 0x7fd43c12e6c0 2020-04-02T23:46:57.342 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.324+0000 7fd441b69700 1 -- 172.21.15.174:0/807977405 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd43c09d3d0 con 0x7fd43c12e6c0 2020-04-02T23:46:57.342 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.324+0000 7fd441b69700 1 -- 172.21.15.174:0/807977405 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd43c1343a0 con 0x7fd43c12e6c0 2020-04-02T23:46:57.342 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.325+0000 7fd43bfff700 1 --2- 172.21.15.174:0/807977405 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd43c12e6c0 0x7fd43c09eee0 secure :-1 s=THROTTLE_DONE pgs=251 cs=0 l=1 rx=0x7fd434001450 tx=0x7fd434010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:57.342 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.325+0000 7fd441b69700 1 -- 172.21.15.174:0/807977405 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd43c056c50 con 0x7fd43c12e6c0 2020-04-02T23:46:57.342 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.325+0000 7fd438ff9700 1 -- 172.21.15.174:0/807977405 <== mon.0 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fd4340129f0 con 0x7fd43c12e6c0 2020-04-02T23:46:57.342 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.325+0000 7fd43bfff700 1 --2- 172.21.15.174:0/807977405 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd43c12e6c0 0x7fd43c09eee0 secure :-1 s=THROTTLE_DONE pgs=251 cs=0 l=1 rx=0x7fd434001450 tx=0x7fd434010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:57.342 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.325+0000 7fd438ff9700 1 --2- 172.21.15.174:0/807977405 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fd41c04d830 0x7fd41c04fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:46:57.342 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.325+0000 7fd438ff9700 1 -- 172.21.15.174:0/807977405 <== mon.0 v2:172.21.15.174:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd434061250 con 0x7fd43c12e6c0 2020-04-02T23:46:57.343 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.325+0000 7fd43b7fe700 1 --2- 172.21.15.174:0/807977405 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fd41c04d830 0x7fd41c04fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:46:57.343 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.326+0000 7fd43b7fe700 1 --2- 172.21.15.174:0/807977405 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fd41c04d830 0x7fd41c04fcf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd42c002f30 tx=0x7fd42c0093b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:57.343 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.326+0000 7fd43b7fe700 1 --2- 172.21.15.174:0/807977405 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fd41c04d830 0x7fd41c04fcf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd42c002f30 tx=0x7fd42c0093b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:57.343 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.326+0000 7fd43b7fe700 1 --2- 172.21.15.174:0/807977405 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fd41c04d830 0x7fd41c04fcf0 secure :-1 s=READY pgs=133 cs=0 l=1 rx=0x7fd42c002f30 tx=0x7fd42c0093b0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:46:57.343 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.328+0000 7fd43bfff700 1 --2- 172.21.15.174:0/807977405 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd43c12e6c0 0x7fd43c09eee0 secure :-1 s=THROTTLE_DONE pgs=251 cs=0 l=1 rx=0x7fd434001450 tx=0x7fd434010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:57.343 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.328+0000 7fd438ff9700 1 -- 172.21.15.174:0/807977405 <== mon.0 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fd43403c9f0 con 0x7fd43c12e6c0 2020-04-02T23:46:57.462 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.460+0000 7fd441b69700 1 -- 172.21.15.174:0/807977405 --> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd43c144460 con 0x7fd41c04d830 2020-04-02T23:46:57.467 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.464+0000 7fd43b7fe700 1 --2- 172.21.15.174:0/807977405 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fd41c04d830 0x7fd41c04fcf0 secure :-1 s=THROTTLE_DONE pgs=133 cs=0 l=1 rx=0x7fd42c002f30 tx=0x7fd42c0093b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:46:57.467 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.464+0000 7fd438ff9700 1 -- 172.21.15.174:0/807977405 <== mgr.4102 v2:172.21.15.196:6800/23210 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+106862 (secure 0 0 0) 0x7fd43c144460 con 0x7fd41c04d830 2020-04-02T23:46:57.468 INFO:teuthology.orchestra.run.smithi174.stdout: 2020-04-02T23:46:57.469 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.466+0000 7fd441b69700 1 -- 172.21.15.174:0/807977405 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fd41c04d830 msgr2=0x7fd41c04fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:57.469 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.466+0000 7fd441b69700 1 --2- 172.21.15.174:0/807977405 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fd41c04d830 0x7fd41c04fcf0 secure :-1 s=READY pgs=133 cs=0 l=1 rx=0x7fd42c002f30 tx=0x7fd42c0093b0).stop 2020-04-02T23:46:57.469 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.466+0000 7fd441b69700 1 -- 172.21.15.174:0/807977405 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd43c12e6c0 msgr2=0x7fd43c09eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:46:57.470 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.466+0000 7fd441b69700 1 --2- 172.21.15.174:0/807977405 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd43c12e6c0 0x7fd43c09eee0 secure :-1 s=READY pgs=251 cs=0 l=1 rx=0x7fd434001450 tx=0x7fd434010bd0).stop 2020-04-02T23:46:57.470 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.466+0000 7fd441b69700 1 -- 172.21.15.174:0/807977405 shutdown_connections 2020-04-02T23:46:57.470 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.466+0000 7fd441b69700 1 --2- 172.21.15.174:0/807977405 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd43c12e6c0 0x7fd43c09eee0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:57.470 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.466+0000 7fd441b69700 1 --2- 172.21.15.174:0/807977405 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fd41c04d830 0x7fd41c04fcf0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:46:57.470 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.466+0000 7fd441b69700 1 -- 172.21.15.174:0/807977405 >> 172.21.15.174:0/807977405 conn(0x7fd43c0aaf80 msgr2=0x7fd43c05b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:46:57.470 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.466+0000 7fd441b69700 1 -- 172.21.15.174:0/807977405 shutdown_connections 2020-04-02T23:46:57.470 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:46:57.466+0000 7fd441b69700 1 -- 172.21.15.174:0/807977405 wait complete. 2020-04-02T23:46:57.470 INFO:teuthology.orchestra.run.smithi174.stderr:dumped all 2020-04-02T23:46:57.479 INFO:teuthology.orchestra.run.smithi174.stdout:{"pg_ready":true,"pg_map":{"version":787,"stamp":"2020-04-02T23:46:56.445590+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":181735019,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":3277,"num_read_kb":10591,"num_write":316341,"num_write_kb":6259909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160673,"ondisk_log_size":160673,"up":50,"acting":50,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":749595040,"kb_used":6964096,"kb_used_data":742630996,"kb_used_omap":319337,"kb_used_meta":0,"kb_avail":742630944,"statfs":{"total":767585320960,"available":760454086656,"internally_reserved":53248,"allocated":760454139904,"data_stored":760454139904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":327001677,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-98040926,"num_objects":-331,"num_object_clones":0,"num_object_copies":-662,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-331,"num_whiteouts":0,"num_read":13,"num_read_kb":42,"num_write":417,"num_write_kb":1034,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-112,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003140"},"pg_stats":[{"pgid":"4.2","version":"23'23015","reported_seq":"23024","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:46:43.939898+0000","last_change":"2020-04-02T23:21:40.541967+0000","last_active":"2020-04-02T23:46:43.939898+0000","last_peered":"2020-04-02T23:46:43.939898+0000","last_clean":"2020-04-02T23:46:43.939898+0000","last_became_active":"2020-04-02T23:21:40.541485+0000","last_became_peered":"2020-04-02T23:21:40.541485+0000","last_unstale":"2020-04-02T23:46:43.939898+0000","last_undegraded":"2020-04-02T23:46:43.939898+0000","last_fullsized":"2020-04-02T23:46:43.939898+0000","mapping_epoch":21,"log_start":"23'13000","ondisk_log_start":"23'13000","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:40.142809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:40.142809+0000","last_clean_scrub_stamp":"2020-04-02T23:21:40.142809+0000","log_size":10015,"ondisk_log_size":10015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17420,"num_write_kb":364698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"12","reported_epoch":"22","state":"active+clean","last_fresh":"2020-04-02T23:21:40.539398+0000","last_change":"2020-04-02T23:21:37.552581+0000","last_active":"2020-04-02T23:21:40.539398+0000","last_peered":"2020-04-02T23:21:40.539398+0000","last_clean":"2020-04-02T23:21:40.539398+0000","last_became_active":"2020-04-02T23:21:37.552244+0000","last_became_peered":"2020-04-02T23:21:37.552244+0000","last_unstale":"2020-04-02T23:21:40.539398+0000","last_undegraded":"2020-04-02T23:21:40.539398+0000","last_fullsized":"2020-04-02T23:21:40.539398+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:36.120823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:36.120823+0000","last_clean_scrub_stamp":"2020-04-02T23:21:36.120823+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"23'27518","reported_seq":"27528","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:46:44.931482+0000","last_change":"2020-04-02T23:21:40.162228+0000","last_active":"2020-04-02T23:46:44.931482+0000","last_peered":"2020-04-02T23:46:44.931482+0000","last_clean":"2020-04-02T23:46:44.931482+0000","last_became_active":"2020-04-02T23:21:40.161797+0000","last_became_peered":"2020-04-02T23:21:40.161797+0000","last_unstale":"2020-04-02T23:46:44.931482+0000","last_undegraded":"2020-04-02T23:46:44.931482+0000","last_fullsized":"2020-04-02T23:46:44.931482+0000","mapping_epoch":20,"log_start":"23'17500","ondisk_log_start":"23'17500","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:39.137888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:39.137888+0000","last_clean_scrub_stamp":"2020-04-02T23:21:39.137888+0000","log_size":10018,"ondisk_log_size":10018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20971680,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27528,"num_write_kb":139085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"23'24404","reported_seq":"24413","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:46:44.010353+0000","last_change":"2020-04-02T23:21:40.542743+0000","last_active":"2020-04-02T23:46:44.010353+0000","last_peered":"2020-04-02T23:46:44.010353+0000","last_clean":"2020-04-02T23:46:44.010353+0000","last_became_active":"2020-04-02T23:21:40.542398+0000","last_became_peered":"2020-04-02T23:21:40.542398+0000","last_unstale":"2020-04-02T23:46:44.010353+0000","last_undegraded":"2020-04-02T23:46:44.010353+0000","last_fullsized":"2020-04-02T23:46:44.010353+0000","mapping_epoch":21,"log_start":"23'14400","ondisk_log_start":"23'14400","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:40.142809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:40.142809+0000","last_clean_scrub_stamp":"2020-04-02T23:21:40.142809+0000","log_size":10004,"ondisk_log_size":10004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18960,"num_write_kb":915362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"12","reported_epoch":"22","state":"active+clean","last_fresh":"2020-04-02T23:21:40.536883+0000","last_change":"2020-04-02T23:21:37.552581+0000","last_active":"2020-04-02T23:21:40.536883+0000","last_peered":"2020-04-02T23:21:40.536883+0000","last_clean":"2020-04-02T23:21:40.536883+0000","last_became_active":"2020-04-02T23:21:37.552288+0000","last_became_peered":"2020-04-02T23:21:37.552288+0000","last_unstale":"2020-04-02T23:21:40.536883+0000","last_undegraded":"2020-04-02T23:21:40.536883+0000","last_fullsized":"2020-04-02T23:21:40.536883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:36.120823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:36.120823+0000","last_clean_scrub_stamp":"2020-04-02T23:21:36.120823+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"23'22417","reported_seq":"22427","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:46:43.040389+0000","last_change":"2020-04-02T23:21:40.158169+0000","last_active":"2020-04-02T23:46:43.040389+0000","last_peered":"2020-04-02T23:46:43.040389+0000","last_clean":"2020-04-02T23:46:43.040389+0000","last_became_active":"2020-04-02T23:21:40.157809+0000","last_became_peered":"2020-04-02T23:21:40.157809+0000","last_unstale":"2020-04-02T23:46:43.040389+0000","last_undegraded":"2020-04-02T23:46:43.040389+0000","last_fullsized":"2020-04-02T23:46:43.040389+0000","mapping_epoch":20,"log_start":"23'12400","ondisk_log_start":"23'12400","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:39.137888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:39.137888+0000","last_clean_scrub_stamp":"2020-04-02T23:21:39.137888+0000","log_size":10017,"ondisk_log_size":10017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":33554466,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22437,"num_write_kb":119909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"23'22440","reported_seq":"22449","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:46:43.977248+0000","last_change":"2020-04-02T23:21:40.551966+0000","last_active":"2020-04-02T23:46:43.977248+0000","last_peered":"2020-04-02T23:46:43.977248+0000","last_clean":"2020-04-02T23:46:43.977248+0000","last_became_active":"2020-04-02T23:21:40.551607+0000","last_became_peered":"2020-04-02T23:21:40.551607+0000","last_unstale":"2020-04-02T23:46:43.977248+0000","last_undegraded":"2020-04-02T23:46:43.977248+0000","last_fullsized":"2020-04-02T23:46:43.977248+0000","mapping_epoch":21,"log_start":"23'12400","ondisk_log_start":"23'12400","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:40.142809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:40.142809+0000","last_clean_scrub_stamp":"2020-04-02T23:21:40.142809+0000","log_size":10040,"ondisk_log_size":10040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16873,"num_write_kb":829941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"12","reported_epoch":"22","state":"active+clean","last_fresh":"2020-04-02T23:21:40.537856+0000","last_change":"2020-04-02T23:21:37.135095+0000","last_active":"2020-04-02T23:21:40.537856+0000","last_peered":"2020-04-02T23:21:40.537856+0000","last_clean":"2020-04-02T23:21:40.537856+0000","last_became_active":"2020-04-02T23:21:37.134712+0000","last_became_peered":"2020-04-02T23:21:37.134712+0000","last_unstale":"2020-04-02T23:21:40.537856+0000","last_undegraded":"2020-04-02T23:21:40.537856+0000","last_fullsized":"2020-04-02T23:21:40.537856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:36.120823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:36.120823+0000","last_clean_scrub_stamp":"2020-04-02T23:21:36.120823+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"23'23910","reported_seq":"23920","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:46:43.028296+0000","last_change":"2020-04-02T23:21:40.162349+0000","last_active":"2020-04-02T23:46:43.028296+0000","last_peered":"2020-04-02T23:46:43.028296+0000","last_clean":"2020-04-02T23:46:43.028296+0000","last_became_active":"2020-04-02T23:21:40.161970+0000","last_became_peered":"2020-04-02T23:21:40.161970+0000","last_unstale":"2020-04-02T23:46:43.028296+0000","last_undegraded":"2020-04-02T23:46:43.028296+0000","last_fullsized":"2020-04-02T23:46:43.028296+0000","mapping_epoch":20,"log_start":"23'13900","ondisk_log_start":"23'13900","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:39.137888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:39.137888+0000","last_clean_scrub_stamp":"2020-04-02T23:21:39.137888+0000","log_size":10010,"ondisk_log_size":10010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":29360128,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23937,"num_write_kb":128370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"23'23333","reported_seq":"23342","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:46:43.994326+0000","last_change":"2020-04-02T23:21:40.550015+0000","last_active":"2020-04-02T23:46:43.994326+0000","last_peered":"2020-04-02T23:46:43.994326+0000","last_clean":"2020-04-02T23:46:43.994326+0000","last_became_active":"2020-04-02T23:21:40.549758+0000","last_became_peered":"2020-04-02T23:21:40.549758+0000","last_unstale":"2020-04-02T23:46:43.994326+0000","last_undegraded":"2020-04-02T23:46:43.994326+0000","last_fullsized":"2020-04-02T23:46:43.994326+0000","mapping_epoch":21,"log_start":"23'13300","ondisk_log_start":"23'13300","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:40.142809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:40.142809+0000","last_clean_scrub_stamp":"2020-04-02T23:21:40.142809+0000","log_size":10033,"ondisk_log_size":10033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17769,"num_write_kb":673677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"12","reported_epoch":"22","state":"active+clean","last_fresh":"2020-04-02T23:21:40.536894+0000","last_change":"2020-04-02T23:21:37.691403+0000","last_active":"2020-04-02T23:21:40.536894+0000","last_peered":"2020-04-02T23:21:40.536894+0000","last_clean":"2020-04-02T23:21:40.536894+0000","last_became_active":"2020-04-02T23:21:37.691080+0000","last_became_peered":"2020-04-02T23:21:37.691080+0000","last_unstale":"2020-04-02T23:21:40.536894+0000","last_undegraded":"2020-04-02T23:21:40.536894+0000","last_fullsized":"2020-04-02T23:21:40.536894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:36.120823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:36.120823+0000","last_clean_scrub_stamp":"2020-04-02T23:21:36.120823+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'2","reported_seq":"16","reported_epoch":"22","state":"active+clean","last_fresh":"2020-04-02T23:21:40.549160+0000","last_change":"2020-04-02T23:21:30.497862+0000","last_active":"2020-04-02T23:21:40.549160+0000","last_peered":"2020-04-02T23:21:40.549160+0000","last_clean":"2020-04-02T23:21:40.549160+0000","last_became_active":"2020-04-02T23:21:30.497574+0000","last_became_peered":"2020-04-02T23:21:30.497574+0000","last_unstale":"2020-04-02T23:21:40.549160+0000","last_undegraded":"2020-04-02T23:21:40.549160+0000","last_fullsized":"2020-04-02T23:21:40.549160+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":3,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:23.179251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:23.179251+0000","last_clean_scrub_stamp":"2020-04-02T23:21:23.179251+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"23'24595","reported_seq":"24608","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:46:54.688373+0000","last_change":"2020-04-02T23:46:54.688426+0000","last_active":"2020-04-02T23:46:54.688373+0000","last_peered":"2020-04-02T23:46:54.688373+0000","last_clean":"2020-04-02T23:46:54.688373+0000","last_became_active":"2020-04-02T23:21:40.157383+0000","last_became_peered":"2020-04-02T23:21:40.157383+0000","last_unstale":"2020-04-02T23:46:54.688373+0000","last_undegraded":"2020-04-02T23:46:54.688373+0000","last_fullsized":"2020-04-02T23:46:54.688373+0000","mapping_epoch":20,"log_start":"23'14500","ondisk_log_start":"23'14500","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'24595","last_scrub_stamp":"2020-04-02T23:46:54.688367+0000","last_deep_scrub":"23'24595","last_deep_scrub_stamp":"2020-04-02T23:46:54.688367+0000","last_clean_scrub_stamp":"2020-04-02T23:46:54.688367+0000","log_size":10095,"ondisk_log_size":10095,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":24605,"num_write_kb":128888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.6","version":"23'22311","reported_seq":"22320","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:46:42.155320+0000","last_change":"2020-04-02T23:21:40.541839+0000","last_active":"2020-04-02T23:46:42.155320+0000","last_peered":"2020-04-02T23:46:42.155320+0000","last_clean":"2020-04-02T23:46:42.155320+0000","last_became_active":"2020-04-02T23:21:40.541400+0000","last_became_peered":"2020-04-02T23:21:40.541400+0000","last_unstale":"2020-04-02T23:46:42.155320+0000","last_undegraded":"2020-04-02T23:46:42.155320+0000","last_fullsized":"2020-04-02T23:46:42.155320+0000","mapping_epoch":21,"log_start":"23'12300","ondisk_log_start":"23'12300","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:40.142809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:40.142809+0000","last_clean_scrub_stamp":"2020-04-02T23:21:40.142809+0000","log_size":10011,"ondisk_log_size":10011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16691,"num_write_kb":542620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"12","reported_epoch":"22","state":"active+clean","last_fresh":"2020-04-02T23:21:40.536882+0000","last_change":"2020-04-02T23:21:37.134760+0000","last_active":"2020-04-02T23:21:40.536882+0000","last_peered":"2020-04-02T23:21:40.536882+0000","last_clean":"2020-04-02T23:21:40.536882+0000","last_became_active":"2020-04-02T23:21:37.134489+0000","last_became_peered":"2020-04-02T23:21:37.134489+0000","last_unstale":"2020-04-02T23:21:40.536882+0000","last_undegraded":"2020-04-02T23:21:40.536882+0000","last_fullsized":"2020-04-02T23:21:40.536882+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:36.120823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:36.120823+0000","last_clean_scrub_stamp":"2020-04-02T23:21:36.120823+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"23'18082","reported_seq":"20214","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:46:43.034590+0000","last_change":"2020-04-02T23:21:40.160984+0000","last_active":"2020-04-02T23:46:43.034590+0000","last_peered":"2020-04-02T23:46:43.034590+0000","last_clean":"2020-04-02T23:46:43.034590+0000","last_became_active":"2020-04-02T23:21:40.160398+0000","last_became_peered":"2020-04-02T23:21:40.160398+0000","last_unstale":"2020-04-02T23:46:43.034590+0000","last_undegraded":"2020-04-02T23:46:43.034590+0000","last_fullsized":"2020-04-02T23:46:43.034590+0000","mapping_epoch":20,"log_start":"23'8000","ondisk_log_start":"23'8000","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:39.137888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:39.137888+0000","last_clean_scrub_stamp":"2020-04-02T23:21:39.137888+0000","log_size":10082,"ondisk_log_size":10082,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2122,"num_read_kb":5519,"num_write":18089,"num_write_kb":94359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"23'23331","reported_seq":"23340","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:46:48.931688+0000","last_change":"2020-04-02T23:21:40.550387+0000","last_active":"2020-04-02T23:46:48.931688+0000","last_peered":"2020-04-02T23:46:48.931688+0000","last_clean":"2020-04-02T23:46:48.931688+0000","last_became_active":"2020-04-02T23:21:40.550121+0000","last_became_peered":"2020-04-02T23:21:40.550121+0000","last_unstale":"2020-04-02T23:46:48.931688+0000","last_undegraded":"2020-04-02T23:46:48.931688+0000","last_fullsized":"2020-04-02T23:46:48.931688+0000","mapping_epoch":21,"log_start":"23'13300","ondisk_log_start":"23'13300","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:40.142809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:40.142809+0000","last_clean_scrub_stamp":"2020-04-02T23:21:40.142809+0000","log_size":10031,"ondisk_log_size":10031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17594,"num_write_kb":769580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"12","reported_epoch":"22","state":"active+clean","last_fresh":"2020-04-02T23:21:40.537250+0000","last_change":"2020-04-02T23:21:37.134441+0000","last_active":"2020-04-02T23:21:40.537250+0000","last_peered":"2020-04-02T23:21:40.537250+0000","last_clean":"2020-04-02T23:21:40.537250+0000","last_became_active":"2020-04-02T23:21:37.134185+0000","last_became_peered":"2020-04-02T23:21:37.134185+0000","last_unstale":"2020-04-02T23:21:40.537250+0000","last_undegraded":"2020-04-02T23:21:40.537250+0000","last_fullsized":"2020-04-02T23:21:40.537250+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:36.120823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:36.120823+0000","last_clean_scrub_stamp":"2020-04-02T23:21:36.120823+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"23'21893","reported_seq":"21945","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:46:48.923028+0000","last_change":"2020-04-02T23:21:40.160705+0000","last_active":"2020-04-02T23:46:48.923028+0000","last_peered":"2020-04-02T23:46:48.923028+0000","last_clean":"2020-04-02T23:46:48.923028+0000","last_became_active":"2020-04-02T23:21:40.160330+0000","last_became_peered":"2020-04-02T23:21:40.160330+0000","last_unstale":"2020-04-02T23:46:48.923028+0000","last_undegraded":"2020-04-02T23:46:48.923028+0000","last_fullsized":"2020-04-02T23:46:48.923028+0000","mapping_epoch":20,"log_start":"23'11800","ondisk_log_start":"23'11800","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:39.137888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:39.137888+0000","last_clean_scrub_stamp":"2020-04-02T23:21:39.137888+0000","log_size":10093,"ondisk_log_size":10093,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25345478,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":42,"num_read_kb":204,"num_write":21903,"num_write_kb":115846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"23'23884","reported_seq":"23893","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:46:44.014944+0000","last_change":"2020-04-02T23:21:40.549980+0000","last_active":"2020-04-02T23:46:44.014944+0000","last_peered":"2020-04-02T23:46:44.014944+0000","last_clean":"2020-04-02T23:46:44.014944+0000","last_became_active":"2020-04-02T23:21:40.549674+0000","last_became_peered":"2020-04-02T23:21:40.549674+0000","last_unstale":"2020-04-02T23:46:44.014944+0000","last_undegraded":"2020-04-02T23:46:44.014944+0000","last_fullsized":"2020-04-02T23:46:44.014944+0000","mapping_epoch":21,"log_start":"23'13800","ondisk_log_start":"23'13800","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:40.142809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:40.142809+0000","last_clean_scrub_stamp":"2020-04-02T23:21:40.142809+0000","log_size":10084,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18292,"num_write_kb":701037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"23'14162","reported_seq":"15284","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:46:43.013133+0000","last_change":"2020-04-02T23:21:40.162904+0000","last_active":"2020-04-02T23:46:43.013133+0000","last_peered":"2020-04-02T23:46:43.013133+0000","last_clean":"2020-04-02T23:46:43.013133+0000","last_became_active":"2020-04-02T23:21:40.162580+0000","last_became_peered":"2020-04-02T23:21:40.162580+0000","last_unstale":"2020-04-02T23:46:43.013133+0000","last_undegraded":"2020-04-02T23:46:43.013133+0000","last_fullsized":"2020-04-02T23:46:43.013133+0000","mapping_epoch":20,"log_start":"23'4100","ondisk_log_start":"23'4100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:39.137888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:39.137888+0000","last_clean_scrub_stamp":"2020-04-02T23:21:39.137888+0000","log_size":10062,"ondisk_log_size":10062,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12583478,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1112,"num_read_kb":4868,"num_write":14188,"num_write_kb":75851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"16","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:46:53.707157+0000","last_change":"2020-04-02T23:46:53.707211+0000","last_active":"2020-04-02T23:46:53.707157+0000","last_peered":"2020-04-02T23:46:53.707157+0000","last_clean":"2020-04-02T23:46:53.707157+0000","last_became_active":"2020-04-02T23:21:37.743135+0000","last_became_peered":"2020-04-02T23:21:37.743135+0000","last_unstale":"2020-04-02T23:46:53.707157+0000","last_undegraded":"2020-04-02T23:46:53.707157+0000","last_fullsized":"2020-04-02T23:46:53.707157+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:53.707151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:53.707151+0000","last_clean_scrub_stamp":"2020-04-02T23:46:53.707151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"23'23262","reported_seq":"23271","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:46:44.010581+0000","last_change":"2020-04-02T23:21:40.540076+0000","last_active":"2020-04-02T23:46:44.010581+0000","last_peered":"2020-04-02T23:46:44.010581+0000","last_clean":"2020-04-02T23:46:44.010581+0000","last_became_active":"2020-04-02T23:21:40.539853+0000","last_became_peered":"2020-04-02T23:21:40.539853+0000","last_unstale":"2020-04-02T23:46:44.010581+0000","last_undegraded":"2020-04-02T23:46:44.010581+0000","last_fullsized":"2020-04-02T23:46:44.010581+0000","mapping_epoch":21,"log_start":"23'13200","ondisk_log_start":"23'13200","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:40.142809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:40.142809+0000","last_clean_scrub_stamp":"2020-04-02T23:21:40.142809+0000","log_size":10062,"ondisk_log_size":10062,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17651,"num_write_kb":545191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"12","reported_epoch":"22","state":"active+clean","last_fresh":"2020-04-02T23:21:40.536908+0000","last_change":"2020-04-02T23:21:37.743177+0000","last_active":"2020-04-02T23:21:40.536908+0000","last_peered":"2020-04-02T23:21:40.536908+0000","last_clean":"2020-04-02T23:21:40.536908+0000","last_became_active":"2020-04-02T23:21:37.742857+0000","last_became_peered":"2020-04-02T23:21:37.742857+0000","last_unstale":"2020-04-02T23:21:40.536908+0000","last_undegraded":"2020-04-02T23:21:40.536908+0000","last_fullsized":"2020-04-02T23:21:40.536908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:36.120823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:36.120823+0000","last_clean_scrub_stamp":"2020-04-02T23:21:36.120823+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'21814","reported_seq":"21824","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:46:53.584881+0000","last_change":"2020-04-02T23:21:40.162268+0000","last_active":"2020-04-02T23:46:53.584881+0000","last_peered":"2020-04-02T23:46:53.584881+0000","last_clean":"2020-04-02T23:46:53.584881+0000","last_became_active":"2020-04-02T23:21:40.161928+0000","last_became_peered":"2020-04-02T23:21:40.161928+0000","last_unstale":"2020-04-02T23:46:53.584881+0000","last_undegraded":"2020-04-02T23:46:53.584881+0000","last_fullsized":"2020-04-02T23:46:53.584881+0000","mapping_epoch":20,"log_start":"23'11800","ondisk_log_start":"23'11800","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:39.137888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:39.137888+0000","last_clean_scrub_stamp":"2020-04-02T23:21:39.137888+0000","log_size":10014,"ondisk_log_size":10014,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":17976749,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22402,"num_write_kb":115485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141250,"num_write_kb":5342106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80280,"ondisk_log_size":80280,"up":16,"acting":16,"num_store_stats":0},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":181735019,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":3277,"num_read_kb":10591,"num_write":175089,"num_write_kb":917793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80391,"ondisk_log_size":80391,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542453,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":869744,"kb_used_data":92829648,"kb_used_omap":56726,"kb_used_meta":0,"kb_avail":92829636,"statfs":{"total":95948165120,"available":95057547264,"internally_reserved":12288,"allocated":95057559552,"data_stored":95057559552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58087593,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 2 23:46:17 2020","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.39400000000000002,"15min":0.36599999999999999},"min":{"1min":0.20100000000000001,"5min":0.185,"15min":0.17599999999999999},"max":{"1min":0.61899999999999999,"5min":3.6829999999999998,"15min":3.6829999999999998},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39300000000000002,"15min":0.41899999999999998},"min":{"1min":0.215,"5min":0.19400000000000001,"15min":0.193},"max":{"1min":1.3129999999999999,"5min":2.669,"15min":9.5700000000000003},"last":0.39200000000000002}]},{"osd":1,"last update":"Thu Apr 2 23:46:17 2020","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.47399999999999998,"15min":0.45000000000000001},"min":{"1min":0.23599999999999999,"5min":0.20699999999999999,"15min":0.192},"max":{"1min":0.57399999999999995,"5min":3.7250000000000001,"15min":3.7250000000000001},"last":0.435},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.53200000000000003,"15min":0.47999999999999998},"min":{"1min":0.221,"5min":0.20399999999999999,"15min":0.189},"max":{"1min":1.341,"5min":5.306,"15min":9.5280000000000005},"last":0.48099999999999998}]},{"osd":2,"last update":"Thu Apr 2 23:46:17 2020","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.51700000000000002,"15min":0.433},"min":{"1min":0.22600000000000001,"5min":0.215,"15min":0.20999999999999999},"max":{"1min":3.8900000000000001,"5min":4.1100000000000003,"15min":4.1100000000000003},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.52300000000000002,"15min":0.46700000000000003},"min":{"1min":0.219,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.67600000000000005,"5min":3.7970000000000002,"15min":3.7970000000000002},"last":0.29299999999999998}]},{"osd":3,"last update":"Thu Apr 2 23:46:17 2020","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.55900000000000005,"15min":0.47699999999999998},"min":{"1min":0.26400000000000001,"5min":0.224,"15min":0.221},"max":{"1min":1.5820000000000001,"5min":4.2009999999999996,"15min":4.2009999999999996},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.57299999999999995,"15min":0.54800000000000004},"min":{"1min":0.311,"5min":0.29199999999999998,"15min":0.253},"max":{"1min":0.71199999999999997,"5min":3.7629999999999999,"15min":4.9199999999999999},"last":0.372}]},{"osd":4,"last update":"Thu Apr 2 23:46:17 2020","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.63500000000000001,"15min":0.505},"min":{"1min":0.214,"5min":0.214,"15min":0.20000000000000001},"max":{"1min":2.5739999999999998,"5min":5.7910000000000004,"15min":5.7910000000000004},"last":0.314},{"interface":"front","average":{"1min":0.434,"5min":0.52400000000000002,"15min":0.45100000000000001},"min":{"1min":0.247,"5min":0.23699999999999999,"15min":0.22600000000000001},"max":{"1min":0.63400000000000001,"5min":4.1639999999999997,"15min":4.1639999999999997},"last":0.33000000000000002}]},{"osd":5,"last update":"Thu Apr 2 23:46:17 2020","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.56799999999999995,"15min":0.52200000000000002},"min":{"1min":0.252,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.76700000000000002,"5min":4.0750000000000002,"15min":4.0750000000000002},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.64300000000000002,"15min":0.54900000000000004},"min":{"1min":0.33000000000000002,"5min":0.26100000000000001,"15min":0.24299999999999999},"max":{"1min":2.617,"5min":5.8310000000000004,"15min":5.8310000000000004},"last":0.55400000000000005}]},{"osd":6,"last update":"Thu Apr 2 23:46:17 2020","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.72199999999999998,"15min":0.58899999999999997},"min":{"1min":0.318,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":3.1960000000000002,"5min":5.8700000000000001,"15min":5.8700000000000001},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.56799999999999995,"15min":0.52300000000000002},"min":{"1min":0.34899999999999998,"5min":0.28699999999999998,"15min":0.215},"max":{"1min":0.78000000000000003,"5min":4.2370000000000001,"15min":4.2370000000000001},"last":0.56899999999999995}]}]},{"osd":6,"up_from":14,"seq":60129542453,"num_pgs":10,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":953988,"kb_used_data":92745392,"kb_used_omap":54815,"kb_used_meta":0,"kb_avail":92745392,"statfs":{"total":95948165120,"available":94971281408,"internally_reserved":0,"allocated":94971281408,"data_stored":94971281408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":56131398,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 2 23:46:06 2020","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.46500000000000002,"15min":0.374},"min":{"1min":0.191,"5min":0.16900000000000001,"15min":0.156},"max":{"1min":3.927,"5min":5.6079999999999997,"15min":5.6079999999999997},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.46300000000000002,"15min":0.436},"min":{"1min":0.218,"5min":0.20399999999999999,"15min":0.17199999999999999},"max":{"1min":0.60099999999999998,"5min":3.411,"15min":4.4950000000000001},"last":0.39400000000000002}]},{"osd":1,"last update":"Thu Apr 2 23:46:06 2020","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.443,"15min":0.44400000000000001},"min":{"1min":0.23400000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":3.976,"5min":3.976,"15min":3.976},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.53300000000000003,"15min":0.47199999999999998},"min":{"1min":0.23599999999999999,"5min":0.218,"15min":0.188},"max":{"1min":4.0010000000000003,"5min":5.532,"15min":5.532},"last":0.57399999999999995}]},{"osd":2,"last update":"Thu Apr 2 23:46:06 2020","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.47699999999999998,"15min":0.45600000000000002},"min":{"1min":0.218,"5min":0.218,"15min":0.20499999999999999},"max":{"1min":4.0300000000000002,"5min":4.0300000000000002,"15min":4.0300000000000002},"last":0.438},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.57599999999999996,"15min":0.46899999999999997},"min":{"1min":0.28100000000000003,"5min":0.221,"15min":0.216},"max":{"1min":4.056,"5min":5.5599999999999996,"15min":5.5599999999999996},"last":0.54300000000000004}]},{"osd":3,"last update":"Thu Apr 2 23:46:06 2020","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.55200000000000005,"15min":0.51300000000000001},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.20799999999999999},"max":{"1min":0.61299999999999999,"5min":3.4990000000000001,"15min":4.6130000000000004},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.59499999999999997,"15min":0.56100000000000005},"min":{"1min":0.29999999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":4.133,"5min":4.133,"15min":4.133},"last":0.55700000000000005}]},{"osd":4,"last update":"Thu Apr 2 23:46:06 2020","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.53600000000000003,"15min":0.45600000000000002},"min":{"1min":0.26400000000000001,"5min":0.249,"15min":0.189},"max":{"1min":4.1139999999999999,"5min":5.4509999999999996,"15min":5.4509999999999996},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.57099999999999995,"15min":0.51700000000000002},"min":{"1min":0.33200000000000002,"5min":0.26800000000000002,"15min":0.23100000000000001},"max":{"1min":4.0910000000000002,"5min":4.0910000000000002,"15min":4.0910000000000002},"last":0.52300000000000002}]},{"osd":5,"last update":"Thu Apr 2 23:46:06 2020","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.55700000000000005,"15min":0.54900000000000004},"min":{"1min":0.35499999999999998,"5min":0.25700000000000001,"15min":0.224},"max":{"1min":4.1719999999999997,"5min":4.1719999999999997,"15min":5.1970000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.628,"15min":0.57399999999999995},"min":{"1min":0.29899999999999999,"5min":0.27100000000000002,"15min":0.224},"max":{"1min":4.1529999999999996,"5min":5.4989999999999997,"15min":5.4989999999999997},"last":0.60199999999999998}]},{"osd":7,"last update":"Thu Apr 2 23:46:06 2020","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.59599999999999997,"15min":0.55900000000000005},"min":{"1min":0.30299999999999999,"5min":0.28799999999999998,"15min":0.22800000000000001},"max":{"1min":0.72799999999999998,"5min":3.464,"15min":4.6539999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.64400000000000002,"15min":0.621},"min":{"1min":0.40600000000000003,"5min":0.33100000000000002,"15min":0.32600000000000001},"max":{"1min":4.202,"5min":4.202,"15min":4.5300000000000002},"last":0.61799999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542452,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796132,"kb_used_data":92903248,"kb_used_omap":25684,"kb_used_meta":0,"kb_avail":92903248,"statfs":{"total":95948165120,"available":95132925952,"internally_reserved":0,"allocated":95132925952,"data_stored":95132925952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26300488,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 2 23:46:24 2020","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.33600000000000002,"15min":0.30499999999999999},"min":{"1min":0.17199999999999999,"5min":0.16400000000000001,"15min":0.155},"max":{"1min":4.5439999999999996,"5min":4.5439999999999996,"15min":4.5439999999999996},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.32600000000000001,"15min":0.317},"min":{"1min":0.153,"5min":0.153,"15min":0.153},"max":{"1min":0.54900000000000004,"5min":0.64500000000000002,"15min":0.748},"last":0.219}]},{"osd":2,"last update":"Thu Apr 2 23:46:24 2020","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.505,"15min":0.39900000000000002},"min":{"1min":0.188,"5min":0.183,"15min":0.17199999999999999},"max":{"1min":3.5710000000000002,"5min":5.2240000000000002,"15min":5.2240000000000002},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.45700000000000002,"15min":0.38700000000000001},"min":{"1min":0.224,"5min":0.20000000000000001,"15min":0.16900000000000001},"max":{"1min":4.6310000000000002,"5min":5.1609999999999996,"15min":5.1609999999999996},"last":0.28000000000000003}]},{"osd":3,"last update":"Thu Apr 2 23:46:24 2020","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.39400000000000002,"15min":0.376},"min":{"1min":0.19900000000000001,"5min":0.19700000000000001,"15min":0.189},"max":{"1min":0.623,"5min":3.27,"15min":6.9539999999999997},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.46100000000000002,"15min":0.46300000000000002},"min":{"1min":0.22800000000000001,"5min":0.20399999999999999,"15min":0.17899999999999999},"max":{"1min":1.22,"5min":5.181,"15min":5.181},"last":0.29699999999999999}]},{"osd":4,"last update":"Thu Apr 2 23:46:24 2020","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.63,"15min":0.51400000000000001},"min":{"1min":0.27100000000000002,"5min":0.245,"15min":0.245},"max":{"1min":4.601,"5min":4.992,"15min":4.992},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.46000000000000002,"15min":0.439},"min":{"1min":0.25600000000000001,"5min":0.253,"15min":0.23000000000000001},"max":{"1min":0.59299999999999997,"5min":3.1619999999999999,"15min":3.1619999999999999},"last":0.64000000000000001}]},{"osd":5,"last update":"Thu Apr 2 23:46:24 2020","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.48799999999999999,"15min":0.48099999999999998},"min":{"1min":0.26400000000000001,"5min":0.25700000000000001,"15min":0.24099999999999999},"max":{"1min":0.64100000000000001,"5min":3.2069999999999999,"15min":3.7490000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.56799999999999995,"15min":0.51500000000000001},"min":{"1min":0.36599999999999999,"5min":0.254,"15min":0.246},"max":{"1min":4.0190000000000001,"5min":5.2770000000000001,"15min":5.2770000000000001},"last":0.50900000000000001}]},{"osd":6,"last update":"Thu Apr 2 23:46:24 2020","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.65600000000000003,"15min":0.58199999999999996},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":4.5030000000000001,"5min":5.0609999999999999,"15min":5.0609999999999999},"last":0.496},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.59899999999999998,"15min":0.54200000000000004},"min":{"1min":0.308,"5min":0.28299999999999997,"15min":0.26700000000000002},"max":{"1min":1.5209999999999999,"5min":3.6269999999999998,"15min":3.6269999999999998},"last":0.55400000000000005}]},{"osd":7,"last update":"Thu Apr 2 23:46:24 2020","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.66900000000000004,"15min":0.56200000000000006},"min":{"1min":0.35499999999999998,"5min":0.311,"15min":0.28100000000000003},"max":{"1min":4.3520000000000003,"5min":5.3099999999999996,"15min":5.3099999999999996},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.80800000000000005,"15min":0.66400000000000003},"min":{"1min":0.36099999999999999,"5min":0.35499999999999998,"15min":0.33300000000000002},"max":{"1min":4.569,"5min":5.1299999999999999,"15min":7.8810000000000002},"last":0.53100000000000003}]}]},{"osd":0,"up_from":14,"seq":60129542452,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":829164,"kb_used_data":92870220,"kb_used_omap":37271,"kb_used_meta":0,"kb_avail":92870216,"statfs":{"total":95948165120,"available":95099101184,"internally_reserved":4096,"allocated":95099105280,"data_stored":95099105280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":38166351,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 2 23:46:24 2020","interfaces":[{"interface":"back","average":{"1min":0.29699999999999999,"5min":0.35499999999999998,"15min":0.30499999999999999},"min":{"1min":0.17199999999999999,"5min":0.156,"15min":0.155},"max":{"1min":0.61899999999999999,"5min":7.1180000000000003,"15min":7.1180000000000003},"last":0.23799999999999999},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.193,"5min":0.16900000000000001,"15min":0.16200000000000001},"max":{"1min":0.57899999999999996,"5min":0.97699999999999998,"15min":3.46},"last":0.26800000000000002}]},{"osd":2,"last update":"Thu Apr 2 23:46:24 2020","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.44600000000000001,"15min":0.39900000000000002},"min":{"1min":0.17999999999999999,"5min":0.17999999999999999,"15min":0.159},"max":{"1min":0.59599999999999997,"5min":4.3200000000000003,"15min":4.3200000000000003},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.32700000000000001,"15min":0.35599999999999998},"min":{"1min":0.192,"5min":0.16300000000000001,"15min":0.16300000000000001},"max":{"1min":4.2889999999999997,"5min":4.2889999999999997,"15min":4.2999999999999998},"last":0.36799999999999999}]},{"osd":3,"last update":"Thu Apr 2 23:46:24 2020","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.434,"15min":0.40899999999999997},"min":{"1min":0.222,"5min":0.19800000000000001,"15min":0.182},"max":{"1min":0.76100000000000001,"5min":3.113,"15min":3.113},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.44400000000000001,"15min":0.433},"min":{"1min":0.22800000000000001,"5min":0.20799999999999999,"15min":0.20599999999999999},"max":{"1min":0.751,"5min":3.1000000000000001,"15min":3.6850000000000001},"last":0.314}]},{"osd":4,"last update":"Thu Apr 2 23:46:24 2020","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.442,"15min":0.44700000000000001},"min":{"1min":0.27000000000000002,"5min":0.247,"15min":0.22600000000000001},"max":{"1min":0.745,"5min":1.048,"15min":3.9420000000000002},"last":0.433},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.503,"15min":0.47999999999999998},"min":{"1min":0.26300000000000001,"5min":0.24299999999999999,"15min":0.22700000000000001},"max":{"1min":0.74099999999999999,"5min":6.1479999999999997,"15min":6.1479999999999997},"last":0.54000000000000004}]},{"osd":5,"last update":"Thu Apr 2 23:46:24 2020","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.45800000000000002,"15min":0.47699999999999998},"min":{"1min":0.27600000000000002,"5min":0.24299999999999999,"15min":0.23100000000000001},"max":{"1min":4.3849999999999998,"5min":4.3849999999999998,"15min":4.423},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.50600000000000001,"15min":0.49099999999999999},"min":{"1min":0.31900000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.73599999999999999,"5min":1.254,"15min":2.6899999999999999},"last":0.46700000000000003}]},{"osd":6,"last update":"Thu Apr 2 23:46:24 2020","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.57699999999999996,"15min":0.55800000000000005},"min":{"1min":0.28999999999999998,"5min":0.27500000000000002,"15min":0.26900000000000002},"max":{"1min":0.82599999999999996,"5min":5.2720000000000002,"15min":5.2720000000000002},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.61099999999999999,"15min":0.56000000000000005},"min":{"1min":0.315,"5min":0.26600000000000001,"15min":0.26500000000000001},"max":{"1min":4.3470000000000004,"5min":7.0979999999999999,"15min":7.0979999999999999},"last":0.55300000000000005}]},{"osd":7,"last update":"Thu Apr 2 23:46:24 2020","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.625,"15min":0.56999999999999995},"min":{"1min":0.35499999999999998,"5min":0.30299999999999999,"15min":0.25},"max":{"1min":4.4119999999999999,"5min":7.1539999999999999,"15min":7.1539999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.54400000000000004,"15min":0.52000000000000002},"min":{"1min":0.36299999999999999,"5min":0.34699999999999998,"15min":0.33700000000000002},"max":{"1min":0.78900000000000003,"5min":1.0840000000000001,"15min":2.7930000000000001},"last":0.58499999999999996}]}]},{"osd":2,"up_from":14,"seq":60129542452,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":957996,"kb_used_data":92741400,"kb_used_omap":17193,"kb_used_meta":0,"kb_avail":92741384,"statfs":{"total":95948165120,"available":94967177216,"internally_reserved":16384,"allocated":94967193600,"data_stored":94967193600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17605657,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 2 23:46:15 2020","interfaces":[{"interface":"back","average":{"1min":0.30299999999999999,"5min":0.31,"15min":0.32900000000000001},"min":{"1min":0.159,"5min":0.14000000000000001,"15min":0.14000000000000001},"max":{"1min":0.63600000000000001,"5min":3.2090000000000001,"15min":4.3929999999999998},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.28599999999999998,"5min":0.308,"15min":0.28999999999999998},"min":{"1min":0.161,"5min":0.161,"15min":0.161},"max":{"1min":0.64100000000000001,"5min":0.84999999999999998,"15min":0.97499999999999998},"last":0.29399999999999998}]},{"osd":1,"last update":"Thu Apr 2 23:46:15 2020","interfaces":[{"interface":"back","average":{"1min":0.28699999999999998,"5min":0.45000000000000001,"15min":0.40400000000000003},"min":{"1min":0.184,"5min":0.17899999999999999,"15min":0.16700000000000001},"max":{"1min":0.49299999999999999,"5min":4.4000000000000004,"15min":4.4000000000000004},"last":0.23799999999999999},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.443,"15min":0.41699999999999998},"min":{"1min":0.186,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.52700000000000002,"5min":4.7839999999999998,"15min":4.7839999999999998},"last":0.25700000000000001}]},{"osd":3,"last update":"Thu Apr 2 23:46:15 2020","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.47499999999999998,"15min":0.40100000000000002},"min":{"1min":0.221,"5min":0.188,"15min":0.182},"max":{"1min":0.91100000000000003,"5min":4.3499999999999996,"15min":4.3499999999999996},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.441,"5min":0.47899999999999998,"15min":0.45300000000000001},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":1.0169999999999999,"5min":3.387,"15min":4.6269999999999998},"last":0.373}]},{"osd":4,"last update":"Thu Apr 2 23:46:15 2020","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.52400000000000002,"15min":0.497},"min":{"1min":0.28299999999999997,"5min":0.23200000000000001,"15min":0.22700000000000001},"max":{"1min":0.63400000000000001,"5min":3.5699999999999998,"15min":4.5570000000000004},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.47999999999999998,"15min":0.44900000000000001},"min":{"1min":0.251,"5min":0.251,"15min":0.23499999999999999},"max":{"1min":0.54600000000000004,"5min":3.1669999999999998,"15min":5.3230000000000004},"last":0.42799999999999999}]},{"osd":5,"last update":"Thu Apr 2 23:46:15 2020","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.502,"15min":0.47199999999999998},"min":{"1min":0.27900000000000003,"5min":0.26400000000000001,"15min":0.246},"max":{"1min":0.72099999999999997,"5min":4.5359999999999996,"15min":4.5359999999999996},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.57399999999999995,"15min":0.55100000000000005},"min":{"1min":0.26000000000000001,"5min":0.255,"15min":0.254},"max":{"1min":3.8919999999999999,"5min":3.8919999999999999,"15min":4.5960000000000001},"last":0.55000000000000004}]},{"osd":6,"last update":"Thu Apr 2 23:46:15 2020","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.54800000000000004,"15min":0.48999999999999999},"min":{"1min":0.28599999999999998,"5min":0.28399999999999997,"15min":0.27100000000000002},"max":{"1min":0.60599999999999998,"5min":4.8360000000000003,"15min":4.8360000000000003},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.64400000000000002,"15min":0.56399999999999995},"min":{"1min":0.30299999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.69299999999999995,"5min":4.984,"15min":5.2690000000000001},"last":0.51300000000000001}]},{"osd":7,"last update":"Thu Apr 2 23:46:15 2020","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.56100000000000005,"15min":0.51400000000000001},"min":{"1min":0.35399999999999998,"5min":0.32600000000000001,"15min":0.26900000000000002},"max":{"1min":0.65500000000000003,"5min":3.4119999999999999,"15min":3.4119999999999999},"last":0.499},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.68799999999999994,"15min":0.59699999999999998},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.30399999999999999},"max":{"1min":3.8100000000000001,"5min":4.5750000000000002,"15min":5.2439999999999998},"last":0.45400000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542451,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796132,"kb_used_data":92903248,"kb_used_omap":37812,"kb_used_meta":0,"kb_avail":92903248,"statfs":{"total":95948165120,"available":95132925952,"internally_reserved":0,"allocated":95132925952,"data_stored":95132925952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":38719574,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 2 23:46:10 2020","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.34100000000000003,"15min":0.314},"min":{"1min":0.17100000000000001,"5min":0.161,"15min":0.154},"max":{"1min":3.129,"5min":3.129,"15min":4.3159999999999998},"last":0.23000000000000001},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.46200000000000002,"15min":0.39000000000000001},"min":{"1min":0.192,"5min":0.186,"15min":0.186},"max":{"1min":3.258,"5min":6.7939999999999996,"15min":6.7939999999999996},"last":0.33400000000000002}]},{"osd":1,"last update":"Thu Apr 2 23:46:10 2020","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.45100000000000001,"15min":0.34300000000000003},"min":{"1min":0.185,"5min":0.16900000000000001,"15min":0.16800000000000001},"max":{"1min":2.3919999999999999,"5min":4.4850000000000003,"15min":4.4850000000000003},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.40699999999999997,"15min":0.38500000000000001},"min":{"1min":0.26500000000000001,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":2.927,"5min":2.927,"15min":2.927},"last":0.377}]},{"osd":2,"last update":"Thu Apr 2 23:46:10 2020","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.42599999999999999,"15min":0.39400000000000002},"min":{"1min":0.188,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":3.0299999999999998,"5min":3.0299999999999998,"15min":3.0299999999999998},"last":0.311},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.58999999999999997,"15min":0.45000000000000001},"min":{"1min":0.20499999999999999,"5min":0.19600000000000001,"15min":0.17699999999999999},"max":{"1min":4.6260000000000003,"5min":6.8179999999999996,"15min":6.8179999999999996},"last":0.29999999999999999}]},{"osd":4,"last update":"Thu Apr 2 23:46:10 2020","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.438},"min":{"1min":0.251,"5min":0.23000000000000001,"15min":0.21199999999999999},"max":{"1min":2.452,"5min":4.5309999999999997,"15min":4.5309999999999997},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.53200000000000003,"15min":0.49299999999999999},"min":{"1min":0.28799999999999998,"5min":0.247,"15min":0.23599999999999999},"max":{"1min":2.9620000000000002,"5min":2.9620000000000002,"15min":2.9620000000000002},"last":0.43099999999999999}]},{"osd":5,"last update":"Thu Apr 2 23:46:10 2020","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.64200000000000002,"15min":0.57599999999999996},"min":{"1min":0.32600000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":3.5299999999999998,"5min":6.7229999999999999,"15min":6.7229999999999999},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.629,"15min":0.495},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.251},"max":{"1min":2.5070000000000001,"5min":4.5679999999999996,"15min":4.5679999999999996},"last":0.45500000000000002}]},{"osd":6,"last update":"Thu Apr 2 23:46:10 2020","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.59099999999999997,"15min":0.54200000000000004},"min":{"1min":0.36199999999999999,"5min":0.28000000000000003,"15min":0.27000000000000002},"max":{"1min":3.0739999999999998,"5min":3.0739999999999998,"15min":3.8639999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.67000000000000004,"15min":0.57699999999999996},"min":{"1min":0.29899999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":3.5579999999999998,"5min":6.6680000000000001,"15min":6.6680000000000001},"last":0.47499999999999998}]},{"osd":7,"last update":"Thu Apr 2 23:46:10 2020","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.60599999999999998,"15min":0.55700000000000005},"min":{"1min":0.39100000000000001,"5min":0.32600000000000001,"15min":0.32100000000000001},"max":{"1min":2.992,"5min":4.7839999999999998,"15min":4.7839999999999998},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.67700000000000005,"15min":0.58999999999999997},"min":{"1min":0.374,"5min":0.31900000000000001,"15min":0.28199999999999997},"max":{"1min":3.4990000000000001,"5min":6.7599999999999998,"15min":6.7599999999999998},"last":0.41999999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542452,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":876800,"kb_used_data":92822600,"kb_used_omap":52313,"kb_used_meta":0,"kb_avail":92822580,"statfs":{"total":95948165120,"available":95050321920,"internally_reserved":20480,"allocated":95050342400,"data_stored":95050342400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":53568833,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 2 23:46:20 2020","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.371,"15min":0.35499999999999998},"min":{"1min":0.191,"5min":0.184,"15min":0.17199999999999999},"max":{"1min":3.5129999999999999,"5min":3.5129999999999999,"15min":3.758},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41699999999999998,"15min":0.41499999999999998},"min":{"1min":0.251,"5min":0.216,"15min":0.185},"max":{"1min":0.63400000000000001,"5min":2.5800000000000001,"15min":4.1189999999999998},"last":0.54300000000000004}]},{"osd":1,"last update":"Thu Apr 2 23:46:20 2020","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.40799999999999997},"min":{"1min":0.24399999999999999,"5min":0.189,"15min":0.17299999999999999},"max":{"1min":0.66100000000000003,"5min":1.137,"15min":4.1559999999999997},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.24199999999999999,"5min":0.22700000000000001,"15min":0.19700000000000001},"max":{"1min":3.891,"5min":3.891,"15min":4.1970000000000001},"last":0.43099999999999999}]},{"osd":2,"last update":"Thu Apr 2 23:46:20 2020","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.221,"5min":0.20999999999999999,"15min":0.20399999999999999},"max":{"1min":3.8570000000000002,"5min":3.8570000000000002,"15min":4.2489999999999997},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.751,"5min":0.48699999999999999,"15min":0.437},"min":{"1min":0.222,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":4.7160000000000002,"5min":4.7160000000000002,"15min":4.7160000000000002},"last":0.44500000000000001}]},{"osd":3,"last update":"Thu Apr 2 23:46:20 2020","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.501,"15min":0.51400000000000001},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.72799999999999998,"5min":3.4769999999999999,"15min":5.3780000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.52100000000000002,"15min":0.55100000000000005},"min":{"1min":0.32700000000000001,"5min":0.27900000000000003,"15min":0.26200000000000001},"max":{"1min":3.956,"5min":3.956,"15min":5.359},"last":0.504}]},{"osd":5,"last update":"Thu Apr 2 23:46:20 2020","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.45200000000000001,"15min":0.439},"min":{"1min":0.27200000000000002,"5min":0.22,"15min":0.217},"max":{"1min":3.5449999999999999,"5min":3.5449999999999999,"15min":3.8029999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.54900000000000004,"15min":0.498},"min":{"1min":0.23699999999999999,"5min":0.23000000000000001,"15min":0.21299999999999999},"max":{"1min":5.1900000000000004,"5min":5.1900000000000004,"15min":5.1900000000000004},"last":0.40799999999999997}]},{"osd":6,"last update":"Thu Apr 2 23:46:20 2020","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.52600000000000002,"15min":0.51800000000000002},"min":{"1min":0.25700000000000001,"5min":0.23699999999999999,"15min":0.20000000000000001},"max":{"1min":3.7999999999999998,"5min":3.7999999999999998,"15min":4.29},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.56399999999999995,"15min":0.54800000000000004},"min":{"1min":0.29099999999999998,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":3.4700000000000002,"5min":3.4700000000000002,"15min":5.9420000000000002},"last":0.63100000000000001}]},{"osd":7,"last update":"Thu Apr 2 23:46:20 2020","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.53000000000000003,"15min":0.56499999999999995},"min":{"1min":0.255,"5min":0.255,"15min":0.22600000000000001},"max":{"1min":0.76400000000000001,"5min":1.0429999999999999,"15min":4.1870000000000003},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.53800000000000003,"15min":0.58799999999999997},"min":{"1min":0.315,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":3.927,"5min":3.927,"15min":4.4429999999999996},"last":0.57899999999999996}]}]},{"osd":5,"up_from":14,"seq":60129542452,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":884140,"kb_used_data":92815240,"kb_used_omap":37521,"kb_used_meta":0,"kb_avail":92815240,"statfs":{"total":95948165120,"available":95042805760,"internally_reserved":0,"allocated":95042805760,"data_stored":95042805760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":38421783,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 2 23:46:25 2020","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.34899999999999998,"15min":0.34200000000000003},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.16700000000000001},"max":{"1min":1.2929999999999999,"5min":1.607,"15min":3.2669999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.47599999999999998,"15min":0.46100000000000002},"min":{"1min":0.221,"5min":0.19800000000000001,"15min":0.191},"max":{"1min":1.321,"5min":5.0970000000000004,"15min":5.0970000000000004},"last":0.379}]},{"osd":1,"last update":"Thu Apr 2 23:46:25 2020","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.54900000000000004,"15min":0.502},"min":{"1min":0.23400000000000001,"5min":0.214,"15min":0.159},"max":{"1min":4.2530000000000001,"5min":5.1360000000000001,"15min":5.1360000000000001},"last":0.438},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.48099999999999998,"15min":0.44600000000000001},"min":{"1min":0.217,"5min":0.20799999999999999,"15min":0.20599999999999999},"max":{"1min":1.593,"5min":4.1879999999999997,"15min":4.9790000000000001},"last":0.54000000000000004}]},{"osd":2,"last update":"Thu Apr 2 23:46:25 2020","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.53600000000000003,"15min":0.50600000000000001},"min":{"1min":0.23799999999999999,"5min":0.23100000000000001,"15min":0.223},"max":{"1min":0.70999999999999996,"5min":4.4409999999999998,"15min":4.9509999999999996},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.47199999999999998,"15min":0.433},"min":{"1min":0.255,"5min":0.224,"15min":0.20999999999999999},"max":{"1min":1.262,"5min":4.1609999999999996,"15min":4.1609999999999996},"last":0.41699999999999998}]},{"osd":3,"last update":"Thu Apr 2 23:46:25 2020","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.69599999999999995,"15min":0.59499999999999997},"min":{"1min":0.27700000000000002,"5min":0.27000000000000002,"15min":0.22700000000000001},"max":{"1min":4.1840000000000002,"5min":5.1630000000000003,"15min":5.1630000000000003},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.51300000000000001,"15min":0.50700000000000001},"min":{"1min":0.27600000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.61599999999999999,"5min":4.4960000000000004,"15min":4.9240000000000004},"last":0.501}]},{"osd":4,"last update":"Thu Apr 2 23:46:25 2020","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.46700000000000003,"15min":0.433},"min":{"1min":0.252,"5min":0.23200000000000001,"15min":0.20999999999999999},"max":{"1min":1.222,"5min":2.1419999999999999,"15min":4.8540000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.626,"15min":0.58799999999999997},"min":{"1min":0.32200000000000001,"5min":0.26900000000000002,"15min":0.23100000000000001},"max":{"1min":4.2779999999999996,"5min":5.1909999999999998,"15min":5.1909999999999998},"last":0.59899999999999998}]},{"osd":6,"last update":"Thu Apr 2 23:46:25 2020","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.70999999999999996,"15min":0.60099999999999998},"min":{"1min":0.27800000000000002,"5min":0.25900000000000001,"15min":0.22700000000000001},"max":{"1min":3.2320000000000002,"5min":5.6740000000000004,"15min":5.6740000000000004},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.54300000000000004,"15min":0.53900000000000003},"min":{"1min":0.28699999999999998,"5min":0.25,"15min":0.25},"max":{"1min":2.6760000000000002,"5min":2.6760000000000002,"15min":4.6769999999999996},"last":0.56200000000000006}]},{"osd":7,"last update":"Thu Apr 2 23:46:25 2020","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.73799999999999999,"15min":0.65500000000000003},"min":{"1min":0.34399999999999997,"5min":0.33700000000000002,"15min":0.28299999999999997},"max":{"1min":4.2220000000000004,"5min":5.2190000000000003,"15min":5.2190000000000003},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.59399999999999997,"15min":0.59699999999999998},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.26500000000000001},"max":{"1min":0.754,"5min":4.5330000000000004,"15min":4.8879999999999999},"last":0.66300000000000003}]}]}]}} 2020-04-02T23:46:57.485 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2020-04-02T23:21:40.142809+0000 time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=21, tm_sec=40, tm_wday=3, tm_yday=93, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=46, tm_sec=52, tm_wday=3, tm_yday=93, tm_isdst=0) 2020-04-02T23:46:57.485 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2020-04-02T23:21:36.120823+0000 time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=21, tm_sec=36, tm_wday=3, tm_yday=93, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=46, tm_sec=52, tm_wday=3, tm_yday=93, tm_isdst=0) 2020-04-02T23:46:57.486 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2020-04-02T23:21:39.137888+0000 time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=21, tm_sec=39, tm_wday=3, tm_yday=93, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=46, tm_sec=52, tm_wday=3, tm_yday=93, tm_isdst=0) 2020-04-02T23:46:57.486 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2020-04-02T23:21:40.142809+0000 time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=21, tm_sec=40, tm_wday=3, tm_yday=93, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=46, tm_sec=52, tm_wday=3, tm_yday=93, tm_isdst=0) 2020-04-02T23:46:57.486 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2020-04-02T23:21:36.120823+0000 time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=21, tm_sec=36, tm_wday=3, tm_yday=93, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=46, tm_sec=52, tm_wday=3, tm_yday=93, tm_isdst=0) 2020-04-02T23:46:57.486 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2020-04-02T23:21:39.137888+0000 time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=21, tm_sec=39, tm_wday=3, tm_yday=93, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=46, tm_sec=52, tm_wday=3, tm_yday=93, tm_isdst=0) 2020-04-02T23:46:57.486 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2020-04-02T23:21:40.142809+0000 time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=21, tm_sec=40, tm_wday=3, tm_yday=93, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=46, tm_sec=52, tm_wday=3, tm_yday=93, tm_isdst=0) 2020-04-02T23:46:57.486 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2020-04-02T23:21:36.120823+0000 time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=21, tm_sec=36, tm_wday=3, tm_yday=93, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=46, tm_sec=52, tm_wday=3, tm_yday=93, tm_isdst=0) 2020-04-02T23:46:57.487 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2020-04-02T23:21:39.137888+0000 time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=21, tm_sec=39, tm_wday=3, tm_yday=93, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=46, tm_sec=52, tm_wday=3, tm_yday=93, tm_isdst=0) 2020-04-02T23:46:57.487 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2020-04-02T23:21:40.142809+0000 time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=21, tm_sec=40, tm_wday=3, tm_yday=93, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=46, tm_sec=52, tm_wday=3, tm_yday=93, tm_isdst=0) 2020-04-02T23:46:57.487 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2020-04-02T23:21:36.120823+0000 time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=21, tm_sec=36, tm_wday=3, tm_yday=93, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=46, tm_sec=52, tm_wday=3, tm_yday=93, tm_isdst=0) 2020-04-02T23:46:57.487 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2020-04-02T23:21:23.179251+0000 time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=21, tm_sec=23, tm_wday=3, tm_yday=93, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=46, tm_sec=52, tm_wday=3, tm_yday=93, tm_isdst=0) 2020-04-02T23:46:57.487 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2020-04-02T23:21:40.142809+0000 time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=21, tm_sec=40, tm_wday=3, tm_yday=93, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=46, tm_sec=52, tm_wday=3, tm_yday=93, tm_isdst=0) 2020-04-02T23:46:57.487 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2020-04-02T23:21:36.120823+0000 time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=21, tm_sec=36, tm_wday=3, tm_yday=93, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=46, tm_sec=52, tm_wday=3, tm_yday=93, tm_isdst=0) 2020-04-02T23:46:57.488 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2020-04-02T23:21:39.137888+0000 time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=21, tm_sec=39, tm_wday=3, tm_yday=93, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=46, tm_sec=52, tm_wday=3, tm_yday=93, tm_isdst=0) 2020-04-02T23:46:57.488 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2020-04-02T23:21:40.142809+0000 time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=21, tm_sec=40, tm_wday=3, tm_yday=93, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=46, tm_sec=52, tm_wday=3, tm_yday=93, tm_isdst=0) 2020-04-02T23:46:57.488 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2020-04-02T23:21:36.120823+0000 time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=21, tm_sec=36, tm_wday=3, tm_yday=93, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=46, tm_sec=52, tm_wday=3, tm_yday=93, tm_isdst=0) 2020-04-02T23:46:57.488 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2020-04-02T23:21:39.137888+0000 time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=21, tm_sec=39, tm_wday=3, tm_yday=93, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=46, tm_sec=52, tm_wday=3, tm_yday=93, tm_isdst=0) 2020-04-02T23:46:57.488 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2020-04-02T23:21:40.142809+0000 time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=21, tm_sec=40, tm_wday=3, tm_yday=93, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=46, tm_sec=52, tm_wday=3, tm_yday=93, tm_isdst=0) 2020-04-02T23:46:57.488 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2020-04-02T23:21:39.137888+0000 time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=21, tm_sec=39, tm_wday=3, tm_yday=93, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=46, tm_sec=52, tm_wday=3, tm_yday=93, tm_isdst=0) 2020-04-02T23:46:57.489 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2020-04-02T23:21:40.142809+0000 time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=21, tm_sec=40, tm_wday=3, tm_yday=93, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=46, tm_sec=52, tm_wday=3, tm_yday=93, tm_isdst=0) 2020-04-02T23:46:57.489 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2020-04-02T23:21:36.120823+0000 time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=21, tm_sec=36, tm_wday=3, tm_yday=93, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=46, tm_sec=52, tm_wday=3, tm_yday=93, tm_isdst=0) 2020-04-02T23:46:57.489 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2020-04-02T23:21:39.137888+0000 time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=21, tm_sec=39, tm_wday=3, tm_yday=93, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=46, tm_sec=52, tm_wday=3, tm_yday=93, tm_isdst=0) 2020-04-02T23:46:57.489 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2020-04-02T23:47:16.677 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:47:16.693 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:47:16.736 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:47:16.752 INFO:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:47:17.491 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:47:17.508 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-04-02T23:47:17.663 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.661+0000 7f2c968c0700 1 Processor -- start 2020-04-02T23:47:17.663 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.661+0000 7f2c968c0700 1 -- start start 2020-04-02T23:47:17.666 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.661+0000 7f2c968c0700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2c9009e300 0x7f2c900a4b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:17.666 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.661+0000 7f2c968c0700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f2c900a4f90 0x7f2c90137bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:17.666 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.661+0000 7f2c968c0700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c900a10a0 con 0x7f2c9005bc10 2020-04-02T23:47:17.666 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.661+0000 7f2c968c0700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c900a2a90 con 0x7f2c9009e300 2020-04-02T23:47:17.666 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.661+0000 7f2c968c0700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c900a2d30 con 0x7f2c900a4f90 2020-04-02T23:47:17.666 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.661+0000 7f2c958be700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2c9009e300 0x7f2c900a4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:17.666 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.662+0000 7f2c958be700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2c9009e300 0x7f2c900a4b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:40700/0 (socket says 172.21.15.174:40700) 2020-04-02T23:47:17.667 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.662+0000 7f2c958be700 1 -- 172.21.15.174:0/2454836565 learned_addr learned my addr 172.21.15.174:0/2454836565 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:47:17.667 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.662+0000 7f2c950bd700 1 --2- 172.21.15.174:0/2454836565 >> v2:172.21.15.196:3300/0 conn(0x7f2c900a4f90 0x7f2c90137bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:17.667 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.662+0000 7f2c958be700 1 -- 172.21.15.174:0/2454836565 >> v2:172.21.15.196:3300/0 conn(0x7f2c900a4f90 msgr2=0x7f2c90137bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:17.667 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.662+0000 7f2c958be700 1 --2- 172.21.15.174:0/2454836565 >> v2:172.21.15.196:3300/0 conn(0x7f2c900a4f90 0x7f2c90137bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:17.667 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.662+0000 7f2c958be700 1 -- 172.21.15.174:0/2454836565 >> v1:172.21.15.196:6789/0 conn(0x7f2c9005bc10 legacy=0x7f2c90138030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:17.667 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.662+0000 7f2c958be700 1 -- 172.21.15.174:0/2454836565 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c9009e6e0 con 0x7f2c9009e300 2020-04-02T23:47:17.667 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.662+0000 7f2c958be700 1 --2- 172.21.15.174:0/2454836565 >> v2:172.21.15.174:3300/0 conn(0x7f2c9009e300 0x7f2c900a4b30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2c8c002f30 tx=0x7f2c8c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:17.667 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.662+0000 7f2c958be700 1 --2- 172.21.15.174:0/2454836565 >> v2:172.21.15.174:3300/0 conn(0x7f2c9009e300 0x7f2c900a4b30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2c8c002f30 tx=0x7f2c8c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:17.668 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.662+0000 7f2c958be700 1 --2- 172.21.15.174:0/2454836565 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2c9009e300 0x7f2c900a4b30 secure :-1 s=READY pgs=252 cs=0 l=1 rx=0x7f2c8c002f30 tx=0x7f2c8c007a40).ready entity=mon.0 client_cookie=5b8438ba9d417b87 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:17.668 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.662+0000 7f2c958be700 1 --2- 172.21.15.174:0/2454836565 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2c9009e300 0x7f2c900a4b30 secure :-1 s=THROTTLE_DONE pgs=252 cs=0 l=1 rx=0x7f2c8c002f30 tx=0x7f2c8c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:17.668 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.662+0000 7f2c958be700 1 --2- 172.21.15.174:0/2454836565 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2c9009e300 0x7f2c900a4b30 secure :-1 s=THROTTLE_DONE pgs=252 cs=0 l=1 rx=0x7f2c8c002f30 tx=0x7f2c8c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:17.668 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.662+0000 7f2c948bc700 1 -- 172.21.15.174:0/2454836565 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c8c011720 con 0x7f2c9009e300 2020-04-02T23:47:17.668 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.662+0000 7f2c958be700 1 --2- 172.21.15.174:0/2454836565 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2c9009e300 0x7f2c900a4b30 secure :-1 s=THROTTLE_DONE pgs=252 cs=0 l=1 rx=0x7f2c8c002f30 tx=0x7f2c8c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:17.668 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.662+0000 7f2c948bc700 1 -- 172.21.15.174:0/2454836565 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c8c011880 con 0x7f2c9009e300 2020-04-02T23:47:17.668 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.662+0000 7f2c948bc700 1 -- 172.21.15.174:0/2454836565 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c8c011c60 con 0x7f2c9009e300 2020-04-02T23:47:17.669 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.662+0000 7f2c968c0700 1 -- 172.21.15.174:0/2454836565 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2c9009e300 msgr2=0x7f2c900a4b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:17.669 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.662+0000 7f2c968c0700 1 --2- 172.21.15.174:0/2454836565 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2c9009e300 0x7f2c900a4b30 secure :-1 s=READY pgs=252 cs=0 l=1 rx=0x7f2c8c002f30 tx=0x7f2c8c007a40).stop 2020-04-02T23:47:17.669 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.663+0000 7f2c968c0700 1 -- 172.21.15.174:0/2454836565 shutdown_connections 2020-04-02T23:47:17.669 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.663+0000 7f2c968c0700 1 --2- 172.21.15.174:0/2454836565 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2c9009e300 0x7f2c900a4b30 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:17.669 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.663+0000 7f2c968c0700 1 --2- 172.21.15.174:0/2454836565 >> v2:172.21.15.196:3300/0 conn(0x7f2c900a4f90 0x7f2c90137bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:17.669 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.663+0000 7f2c968c0700 1 -- 172.21.15.174:0/2454836565 >> 172.21.15.174:0/2454836565 conn(0x7f2c900a6d00 msgr2=0x7f2c900a7110 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:17.669 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.663+0000 7f2c968c0700 1 -- 172.21.15.174:0/2454836565 shutdown_connections 2020-04-02T23:47:17.669 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.663+0000 7f2c968c0700 1 -- 172.21.15.174:0/2454836565 wait complete. 2020-04-02T23:47:17.670 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.664+0000 7f2c968c0700 1 Processor -- start 2020-04-02T23:47:17.670 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.664+0000 7f2c968c0700 1 -- start start 2020-04-02T23:47:17.673 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.664+0000 7f2c968c0700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2c9005bc10 0x7f2c9013c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:17.673 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.664+0000 7f2c968c0700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2c9009e300 0x7f2c90137740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:17.673 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.664+0000 7f2c968c0700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c9013ccd0 con 0x7f2c901345b0 2020-04-02T23:47:17.673 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.664+0000 7f2c968c0700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c90139e10 con 0x7f2c9009e300 2020-04-02T23:47:17.674 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.664+0000 7f2c968c0700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c90132670 con 0x7f2c9005bc10 2020-04-02T23:47:17.674 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.664+0000 7f2c950bd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2c9009e300 0x7f2c90137740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:17.674 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.664+0000 7f2c950bd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2c9009e300 0x7f2c90137740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:40704/0 (socket says 172.21.15.174:40704) 2020-04-02T23:47:17.674 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.664+0000 7f2c950bd700 1 -- 172.21.15.174:0/2789353198 learned_addr learned my addr 172.21.15.174:0/2789353198 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:47:17.674 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.664+0000 7f2c958be700 1 --2- 172.21.15.174:0/2789353198 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2c9005bc10 0x7f2c9013c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:17.674 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.664+0000 7f2c950bd700 1 -- 172.21.15.174:0/2789353198 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2c9005bc10 msgr2=0x7f2c9013c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:17.674 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.664+0000 7f2c950bd700 1 --2- 172.21.15.174:0/2789353198 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2c9005bc10 0x7f2c9013c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:17.675 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.664+0000 7f2c7effd700 1 -- 172.21.15.174:0/2789353198 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 235706037 0 0) 0x7f2c9013ccd0 con 0x7f2c901345b0 2020-04-02T23:47:17.675 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.664+0000 7f2c950bd700 1 -- 172.21.15.174:0/2789353198 >> v1:172.21.15.174:6789/0 conn(0x7f2c901345b0 legacy=0x7f2c90131f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:17.675 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.665+0000 7f2c950bd700 1 -- 172.21.15.174:0/2789353198 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c901327b0 con 0x7f2c9009e300 2020-04-02T23:47:17.675 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.665+0000 7f2c950bd700 1 --2- 172.21.15.174:0/2789353198 >> v2:172.21.15.174:3300/0 conn(0x7f2c9009e300 0x7f2c90137740 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2c80002f30 tx=0x7f2c80010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:17.675 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.665+0000 7f2c950bd700 1 --2- 172.21.15.174:0/2789353198 >> v2:172.21.15.174:3300/0 conn(0x7f2c9009e300 0x7f2c90137740 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2c80002f30 tx=0x7f2c80010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:17.675 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.665+0000 7f2c950bd700 1 --2- 172.21.15.174:0/2789353198 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2c9009e300 0x7f2c90137740 secure :-1 s=READY pgs=254 cs=0 l=1 rx=0x7f2c80002f30 tx=0x7f2c80010c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:17.675 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.665+0000 7f2c950bd700 1 --2- 172.21.15.174:0/2789353198 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2c9009e300 0x7f2c90137740 secure :-1 s=THROTTLE_DONE pgs=254 cs=0 l=1 rx=0x7f2c80002f30 tx=0x7f2c80010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:17.675 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.665+0000 7f2c7effd700 1 -- 172.21.15.174:0/2789353198 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c80008e60 con 0x7f2c9009e300 2020-04-02T23:47:17.676 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.665+0000 7f2c950bd700 1 --2- 172.21.15.174:0/2789353198 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2c9009e300 0x7f2c90137740 secure :-1 s=THROTTLE_DONE pgs=254 cs=0 l=1 rx=0x7f2c80002f30 tx=0x7f2c80010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:17.676 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.665+0000 7f2c950bd700 1 --2- 172.21.15.174:0/2789353198 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2c9009e300 0x7f2c90137740 secure :-1 s=THROTTLE_DONE pgs=254 cs=0 l=1 rx=0x7f2c80002f30 tx=0x7f2c80010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:17.676 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.665+0000 7f2c7effd700 1 -- 172.21.15.174:0/2789353198 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c80012510 con 0x7f2c9009e300 2020-04-02T23:47:17.676 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.665+0000 7f2c968c0700 1 -- 172.21.15.174:0/2789353198 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c9013a2b0 con 0x7f2c9009e300 2020-04-02T23:47:17.676 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.665+0000 7f2c7effd700 1 -- 172.21.15.174:0/2789353198 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c80012870 con 0x7f2c9009e300 2020-04-02T23:47:17.676 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.665+0000 7f2c968c0700 1 -- 172.21.15.174:0/2789353198 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c9013a800 con 0x7f2c9009e300 2020-04-02T23:47:17.676 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.666+0000 7f2c950bd700 1 --2- 172.21.15.174:0/2789353198 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2c9009e300 0x7f2c90137740 secure :-1 s=THROTTLE_DONE pgs=254 cs=0 l=1 rx=0x7f2c80002f30 tx=0x7f2c80010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:17.677 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.666+0000 7f2c968c0700 1 -- 172.21.15.174:0/2789353198 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c90139fe0 con 0x7f2c9009e300 2020-04-02T23:47:17.677 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.666+0000 7f2c7effd700 1 -- 172.21.15.174:0/2789353198 <== mon.0 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f2c80012ae0 con 0x7f2c9009e300 2020-04-02T23:47:17.677 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.666+0000 7f2c950bd700 1 --2- 172.21.15.174:0/2789353198 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2c9009e300 0x7f2c90137740 secure :-1 s=THROTTLE_DONE pgs=254 cs=0 l=1 rx=0x7f2c80002f30 tx=0x7f2c80010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:17.677 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.666+0000 7f2c7effd700 1 --2- 172.21.15.174:0/2789353198 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f2c7004d4a0 0x7f2c7004f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:17.677 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.666+0000 7f2c7effd700 1 -- 172.21.15.174:0/2789353198 <== mon.0 v2:172.21.15.174:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2c800613c0 con 0x7f2c9009e300 2020-04-02T23:47:17.677 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.667+0000 7f2c958be700 1 --2- 172.21.15.174:0/2789353198 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f2c7004d4a0 0x7f2c7004f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:17.677 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.667+0000 7f2c958be700 1 --2- 172.21.15.174:0/2789353198 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f2c7004d4a0 0x7f2c7004f960 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2c8c002f30 tx=0x7f2c8c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:17.678 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.667+0000 7f2c958be700 1 --2- 172.21.15.174:0/2789353198 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f2c7004d4a0 0x7f2c7004f960 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2c8c002f30 tx=0x7f2c8c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:17.678 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.667+0000 7f2c958be700 1 --2- 172.21.15.174:0/2789353198 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f2c7004d4a0 0x7f2c7004f960 secure :-1 s=READY pgs=134 cs=0 l=1 rx=0x7f2c8c002f30 tx=0x7f2c8c007a40).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:17.678 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.669+0000 7f2c950bd700 1 --2- 172.21.15.174:0/2789353198 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2c9009e300 0x7f2c90137740 secure :-1 s=THROTTLE_DONE pgs=254 cs=0 l=1 rx=0x7f2c80002f30 tx=0x7f2c80010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:17.678 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.670+0000 7f2c7effd700 1 -- 172.21.15.174:0/2789353198 <== mon.0 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f2c8003cb80 con 0x7f2c9009e300 2020-04-02T23:47:17.805 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.800+0000 7f2c968c0700 1 -- 172.21.15.174:0/2789353198 --> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2c9013a800 con 0x7f2c7004d4a0 2020-04-02T23:47:17.810 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.804+0000 7f2c958be700 1 --2- 172.21.15.174:0/2789353198 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f2c7004d4a0 0x7f2c7004f960 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7f2c8c002f30 tx=0x7f2c8c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:17.810 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.804+0000 7f2c7effd700 1 -- 172.21.15.174:0/2789353198 <== mgr.4102 v2:172.21.15.196:6800/23210 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+107094 (secure 0 0 0) 0x7f2c9013a800 con 0x7f2c7004d4a0 2020-04-02T23:47:17.810 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.806+0000 7f2c968c0700 1 -- 172.21.15.174:0/2789353198 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f2c7004d4a0 msgr2=0x7f2c7004f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:17.810 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.806+0000 7f2c968c0700 1 --2- 172.21.15.174:0/2789353198 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f2c7004d4a0 0x7f2c7004f960 secure :-1 s=READY pgs=134 cs=0 l=1 rx=0x7f2c8c002f30 tx=0x7f2c8c007a40).stop 2020-04-02T23:47:17.810 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.806+0000 7f2c968c0700 1 -- 172.21.15.174:0/2789353198 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2c9009e300 msgr2=0x7f2c90137740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:17.811 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.806+0000 7f2c968c0700 1 --2- 172.21.15.174:0/2789353198 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2c9009e300 0x7f2c90137740 secure :-1 s=READY pgs=254 cs=0 l=1 rx=0x7f2c80002f30 tx=0x7f2c80010c80).stop 2020-04-02T23:47:17.811 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.806+0000 7f2c968c0700 1 -- 172.21.15.174:0/2789353198 shutdown_connections 2020-04-02T23:47:17.811 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.806+0000 7f2c968c0700 1 --2- 172.21.15.174:0/2789353198 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f2c7004d4a0 0x7f2c7004f960 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:17.811 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.806+0000 7f2c968c0700 1 --2- 172.21.15.174:0/2789353198 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2c9005bc10 0x7f2c9013c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:17.811 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.806+0000 7f2c968c0700 1 --2- 172.21.15.174:0/2789353198 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2c9009e300 0x7f2c90137740 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:17.811 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.806+0000 7f2c968c0700 1 -- 172.21.15.174:0/2789353198 >> 172.21.15.174:0/2789353198 conn(0x7f2c900a6d00 msgr2=0x7f2c900a70e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:17.811 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.806+0000 7f2c968c0700 1 -- 172.21.15.174:0/2789353198 shutdown_connections 2020-04-02T23:47:17.812 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:17.806+0000 7f2c968c0700 1 -- 172.21.15.174:0/2789353198 wait complete. 2020-04-02T23:47:17.812 INFO:teuthology.orchestra.run.smithi174.stderr:dumped all 2020-04-02T23:47:17.812 INFO:teuthology.orchestra.run.smithi174.stdout: 2020-04-02T23:47:17.819 INFO:teuthology.orchestra.run.smithi174.stdout:{"pg_ready":true,"pg_map":{"version":797,"stamp":"2020-04-02T23:47:16.449989+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":181735019,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":3277,"num_read_kb":10591,"num_write":316341,"num_write_kb":6259909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":13784,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160631,"ondisk_log_size":160631,"up":50,"acting":50,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":749595040,"kb_used":6964056,"kb_used_data":742630996,"kb_used_omap":319468,"kb_used_meta":0,"kb_avail":742630984,"statfs":{"total":767585320960,"available":760454127616,"internally_reserved":12288,"allocated":760454139904,"data_stored":760454139904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":327135418,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":13784,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002387"},"pg_stats":[{"pgid":"4.2","version":"23'23015","reported_seq":"23027","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:47:08.540739+0000","last_change":"2020-04-02T23:47:08.540802+0000","last_active":"2020-04-02T23:47:08.540739+0000","last_peered":"2020-04-02T23:47:08.540739+0000","last_clean":"2020-04-02T23:47:08.540739+0000","last_became_active":"2020-04-02T23:21:40.541485+0000","last_became_peered":"2020-04-02T23:21:40.541485+0000","last_unstale":"2020-04-02T23:47:08.540739+0000","last_undegraded":"2020-04-02T23:47:08.540739+0000","last_fullsized":"2020-04-02T23:47:08.540739+0000","mapping_epoch":21,"log_start":"23'13000","ondisk_log_start":"23'13000","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'23015","last_scrub_stamp":"2020-04-02T23:47:08.540733+0000","last_deep_scrub":"23'23015","last_deep_scrub_stamp":"2020-04-02T23:47:08.540733+0000","last_clean_scrub_stamp":"2020-04-02T23:47:08.540733+0000","log_size":10015,"ondisk_log_size":10015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17420,"num_write_kb":364698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"15","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:47:04.762789+0000","last_change":"2020-04-02T23:47:04.762849+0000","last_active":"2020-04-02T23:47:04.762789+0000","last_peered":"2020-04-02T23:47:04.762789+0000","last_clean":"2020-04-02T23:47:04.762789+0000","last_became_active":"2020-04-02T23:21:37.552244+0000","last_became_peered":"2020-04-02T23:21:37.552244+0000","last_unstale":"2020-04-02T23:47:04.762789+0000","last_undegraded":"2020-04-02T23:47:04.762789+0000","last_fullsized":"2020-04-02T23:47:04.762789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:47:04.762784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:47:04.762784+0000","last_clean_scrub_stamp":"2020-04-02T23:47:04.762784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"23'27526","reported_seq":"27539","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:47:00.283446+0000","last_change":"2020-04-02T23:47:00.283495+0000","last_active":"2020-04-02T23:47:00.283446+0000","last_peered":"2020-04-02T23:47:00.283446+0000","last_clean":"2020-04-02T23:47:00.283446+0000","last_became_active":"2020-04-02T23:21:40.161797+0000","last_became_peered":"2020-04-02T23:21:40.161797+0000","last_unstale":"2020-04-02T23:47:00.283446+0000","last_undegraded":"2020-04-02T23:47:00.283446+0000","last_fullsized":"2020-04-02T23:47:00.283446+0000","mapping_epoch":20,"log_start":"23'17500","ondisk_log_start":"23'17500","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'27526","last_scrub_stamp":"2020-04-02T23:47:00.283440+0000","last_deep_scrub":"23'27526","last_deep_scrub_stamp":"2020-04-02T23:47:00.283440+0000","last_clean_scrub_stamp":"2020-04-02T23:47:00.283440+0000","log_size":10026,"ondisk_log_size":10026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20971680,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27528,"num_write_kb":139085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"23'24404","reported_seq":"24413","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:46:44.010353+0000","last_change":"2020-04-02T23:21:40.542743+0000","last_active":"2020-04-02T23:46:44.010353+0000","last_peered":"2020-04-02T23:46:44.010353+0000","last_clean":"2020-04-02T23:46:44.010353+0000","last_became_active":"2020-04-02T23:21:40.542398+0000","last_became_peered":"2020-04-02T23:21:40.542398+0000","last_unstale":"2020-04-02T23:46:44.010353+0000","last_undegraded":"2020-04-02T23:46:44.010353+0000","last_fullsized":"2020-04-02T23:46:44.010353+0000","mapping_epoch":21,"log_start":"23'14400","ondisk_log_start":"23'14400","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:40.142809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:40.142809+0000","last_clean_scrub_stamp":"2020-04-02T23:21:40.142809+0000","log_size":10004,"ondisk_log_size":10004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18960,"num_write_kb":915362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"15","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:46:59.559999+0000","last_change":"2020-04-02T23:46:59.560059+0000","last_active":"2020-04-02T23:46:59.559999+0000","last_peered":"2020-04-02T23:46:59.559999+0000","last_clean":"2020-04-02T23:46:59.559999+0000","last_became_active":"2020-04-02T23:21:37.552288+0000","last_became_peered":"2020-04-02T23:21:37.552288+0000","last_unstale":"2020-04-02T23:46:59.559999+0000","last_undegraded":"2020-04-02T23:46:59.559999+0000","last_fullsized":"2020-04-02T23:46:59.559999+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:59.559993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:59.559993+0000","last_clean_scrub_stamp":"2020-04-02T23:46:59.559993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"23'22428","reported_seq":"22441","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:47:00.573588+0000","last_change":"2020-04-02T23:47:00.573633+0000","last_active":"2020-04-02T23:47:00.573588+0000","last_peered":"2020-04-02T23:47:00.573588+0000","last_clean":"2020-04-02T23:47:00.573588+0000","last_became_active":"2020-04-02T23:21:40.157809+0000","last_became_peered":"2020-04-02T23:21:40.157809+0000","last_unstale":"2020-04-02T23:47:00.573588+0000","last_undegraded":"2020-04-02T23:47:00.573588+0000","last_fullsized":"2020-04-02T23:47:00.573588+0000","mapping_epoch":20,"log_start":"23'12400","ondisk_log_start":"23'12400","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'22428","last_scrub_stamp":"2020-04-02T23:47:00.573582+0000","last_deep_scrub":"23'22428","last_deep_scrub_stamp":"2020-04-02T23:47:00.573582+0000","last_clean_scrub_stamp":"2020-04-02T23:47:00.573582+0000","log_size":10028,"ondisk_log_size":10028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":33554466,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22437,"num_write_kb":119909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5098,"num_omap_keys":11,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"23'22440","reported_seq":"22449","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:46:43.977248+0000","last_change":"2020-04-02T23:21:40.551966+0000","last_active":"2020-04-02T23:46:43.977248+0000","last_peered":"2020-04-02T23:46:43.977248+0000","last_clean":"2020-04-02T23:46:43.977248+0000","last_became_active":"2020-04-02T23:21:40.551607+0000","last_became_peered":"2020-04-02T23:21:40.551607+0000","last_unstale":"2020-04-02T23:46:43.977248+0000","last_undegraded":"2020-04-02T23:46:43.977248+0000","last_fullsized":"2020-04-02T23:46:43.977248+0000","mapping_epoch":21,"log_start":"23'12400","ondisk_log_start":"23'12400","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:40.142809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:40.142809+0000","last_clean_scrub_stamp":"2020-04-02T23:21:40.142809+0000","log_size":10040,"ondisk_log_size":10040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16873,"num_write_kb":829941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"15","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:46:57.453413+0000","last_change":"2020-04-02T23:46:57.453478+0000","last_active":"2020-04-02T23:46:57.453413+0000","last_peered":"2020-04-02T23:46:57.453413+0000","last_clean":"2020-04-02T23:46:57.453413+0000","last_became_active":"2020-04-02T23:21:37.134712+0000","last_became_peered":"2020-04-02T23:21:37.134712+0000","last_unstale":"2020-04-02T23:46:57.453413+0000","last_undegraded":"2020-04-02T23:46:57.453413+0000","last_fullsized":"2020-04-02T23:46:57.453413+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:57.453407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:57.453407+0000","last_clean_scrub_stamp":"2020-04-02T23:46:57.453407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"23'23921","reported_seq":"23934","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:47:06.825679+0000","last_change":"2020-04-02T23:47:06.825726+0000","last_active":"2020-04-02T23:47:06.825679+0000","last_peered":"2020-04-02T23:47:06.825679+0000","last_clean":"2020-04-02T23:47:06.825679+0000","last_became_active":"2020-04-02T23:21:40.161970+0000","last_became_peered":"2020-04-02T23:21:40.161970+0000","last_unstale":"2020-04-02T23:47:06.825679+0000","last_undegraded":"2020-04-02T23:47:06.825679+0000","last_fullsized":"2020-04-02T23:47:06.825679+0000","mapping_epoch":20,"log_start":"23'13900","ondisk_log_start":"23'13900","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'23921","last_scrub_stamp":"2020-04-02T23:47:06.825673+0000","last_deep_scrub":"23'23921","last_deep_scrub_stamp":"2020-04-02T23:47:06.825673+0000","last_clean_scrub_stamp":"2020-04-02T23:47:06.825673+0000","log_size":10021,"ondisk_log_size":10021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":29360128,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23937,"num_write_kb":128370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"23'23333","reported_seq":"23345","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:47:12.640558+0000","last_change":"2020-04-02T23:47:12.640620+0000","last_active":"2020-04-02T23:47:12.640558+0000","last_peered":"2020-04-02T23:47:12.640558+0000","last_clean":"2020-04-02T23:47:12.640558+0000","last_became_active":"2020-04-02T23:21:40.549758+0000","last_became_peered":"2020-04-02T23:21:40.549758+0000","last_unstale":"2020-04-02T23:47:12.640558+0000","last_undegraded":"2020-04-02T23:47:12.640558+0000","last_fullsized":"2020-04-02T23:47:12.640558+0000","mapping_epoch":21,"log_start":"23'13300","ondisk_log_start":"23'13300","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'23333","last_scrub_stamp":"2020-04-02T23:47:12.640552+0000","last_deep_scrub":"23'23333","last_deep_scrub_stamp":"2020-04-02T23:47:12.640552+0000","last_clean_scrub_stamp":"2020-04-02T23:47:12.640552+0000","log_size":10033,"ondisk_log_size":10033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17769,"num_write_kb":673677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"15","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:47:01.558583+0000","last_change":"2020-04-02T23:47:01.558643+0000","last_active":"2020-04-02T23:47:01.558583+0000","last_peered":"2020-04-02T23:47:01.558583+0000","last_clean":"2020-04-02T23:47:01.558583+0000","last_became_active":"2020-04-02T23:21:37.691080+0000","last_became_peered":"2020-04-02T23:21:37.691080+0000","last_unstale":"2020-04-02T23:47:01.558583+0000","last_undegraded":"2020-04-02T23:47:01.558583+0000","last_fullsized":"2020-04-02T23:47:01.558583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:47:01.558577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:47:01.558577+0000","last_clean_scrub_stamp":"2020-04-02T23:47:01.558577+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"23'4","reported_seq":"21","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:47:01.815129+0000","last_change":"2020-04-02T23:47:01.815176+0000","last_active":"2020-04-02T23:47:01.815129+0000","last_peered":"2020-04-02T23:47:01.815129+0000","last_clean":"2020-04-02T23:47:01.815129+0000","last_became_active":"2020-04-02T23:21:30.497574+0000","last_became_peered":"2020-04-02T23:21:30.497574+0000","last_unstale":"2020-04-02T23:47:01.815129+0000","last_undegraded":"2020-04-02T23:47:01.815129+0000","last_fullsized":"2020-04-02T23:47:01.815129+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":3,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'4","last_scrub_stamp":"2020-04-02T23:47:01.815122+0000","last_deep_scrub":"23'4","last_deep_scrub_stamp":"2020-04-02T23:47:01.815122+0000","last_clean_scrub_stamp":"2020-04-02T23:47:01.815122+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8224,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"23'24595","reported_seq":"24608","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:46:54.688373+0000","last_change":"2020-04-02T23:46:54.688426+0000","last_active":"2020-04-02T23:46:54.688373+0000","last_peered":"2020-04-02T23:46:54.688373+0000","last_clean":"2020-04-02T23:46:54.688373+0000","last_became_active":"2020-04-02T23:21:40.157383+0000","last_became_peered":"2020-04-02T23:21:40.157383+0000","last_unstale":"2020-04-02T23:46:54.688373+0000","last_undegraded":"2020-04-02T23:46:54.688373+0000","last_fullsized":"2020-04-02T23:46:54.688373+0000","mapping_epoch":20,"log_start":"23'14500","ondisk_log_start":"23'14500","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'24595","last_scrub_stamp":"2020-04-02T23:46:54.688367+0000","last_deep_scrub":"23'24595","last_deep_scrub_stamp":"2020-04-02T23:46:54.688367+0000","last_clean_scrub_stamp":"2020-04-02T23:46:54.688367+0000","log_size":10095,"ondisk_log_size":10095,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":24605,"num_write_kb":128888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.6","version":"23'22311","reported_seq":"22323","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:47:10.745357+0000","last_change":"2020-04-02T23:47:10.745419+0000","last_active":"2020-04-02T23:47:10.745357+0000","last_peered":"2020-04-02T23:47:10.745357+0000","last_clean":"2020-04-02T23:47:10.745357+0000","last_became_active":"2020-04-02T23:21:40.541400+0000","last_became_peered":"2020-04-02T23:21:40.541400+0000","last_unstale":"2020-04-02T23:47:10.745357+0000","last_undegraded":"2020-04-02T23:47:10.745357+0000","last_fullsized":"2020-04-02T23:47:10.745357+0000","mapping_epoch":21,"log_start":"23'12300","ondisk_log_start":"23'12300","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'22311","last_scrub_stamp":"2020-04-02T23:47:10.745351+0000","last_deep_scrub":"23'22311","last_deep_scrub_stamp":"2020-04-02T23:47:10.745351+0000","last_clean_scrub_stamp":"2020-04-02T23:47:10.745351+0000","log_size":10011,"ondisk_log_size":10011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16691,"num_write_kb":542620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"15","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:46:58.560507+0000","last_change":"2020-04-02T23:46:58.560559+0000","last_active":"2020-04-02T23:46:58.560507+0000","last_peered":"2020-04-02T23:46:58.560507+0000","last_clean":"2020-04-02T23:46:58.560507+0000","last_became_active":"2020-04-02T23:21:37.134489+0000","last_became_peered":"2020-04-02T23:21:37.134489+0000","last_unstale":"2020-04-02T23:46:58.560507+0000","last_undegraded":"2020-04-02T23:46:58.560507+0000","last_fullsized":"2020-04-02T23:46:58.560507+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:58.560502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:58.560502+0000","last_clean_scrub_stamp":"2020-04-02T23:46:58.560502+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"23'18088","reported_seq":"20223","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:46:58.544147+0000","last_change":"2020-04-02T23:46:58.544213+0000","last_active":"2020-04-02T23:46:58.544147+0000","last_peered":"2020-04-02T23:46:58.544147+0000","last_clean":"2020-04-02T23:46:58.544147+0000","last_became_active":"2020-04-02T23:21:40.160398+0000","last_became_peered":"2020-04-02T23:21:40.160398+0000","last_unstale":"2020-04-02T23:46:58.544147+0000","last_undegraded":"2020-04-02T23:46:58.544147+0000","last_fullsized":"2020-04-02T23:46:58.544147+0000","mapping_epoch":20,"log_start":"23'8000","ondisk_log_start":"23'8000","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'18088","last_scrub_stamp":"2020-04-02T23:46:58.544140+0000","last_deep_scrub":"23'18088","last_deep_scrub_stamp":"2020-04-02T23:46:58.544140+0000","last_clean_scrub_stamp":"2020-04-02T23:46:58.544140+0000","log_size":10088,"ondisk_log_size":10088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2122,"num_read_kb":5519,"num_write":18089,"num_write_kb":94359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"23'23331","reported_seq":"23340","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:46:48.931688+0000","last_change":"2020-04-02T23:21:40.550387+0000","last_active":"2020-04-02T23:46:48.931688+0000","last_peered":"2020-04-02T23:46:48.931688+0000","last_clean":"2020-04-02T23:46:48.931688+0000","last_became_active":"2020-04-02T23:21:40.550121+0000","last_became_peered":"2020-04-02T23:21:40.550121+0000","last_unstale":"2020-04-02T23:46:48.931688+0000","last_undegraded":"2020-04-02T23:46:48.931688+0000","last_fullsized":"2020-04-02T23:46:48.931688+0000","mapping_epoch":21,"log_start":"23'13300","ondisk_log_start":"23'13300","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:21:40.142809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:21:40.142809+0000","last_clean_scrub_stamp":"2020-04-02T23:21:40.142809+0000","log_size":10031,"ondisk_log_size":10031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17594,"num_write_kb":769580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"15","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:47:02.574526+0000","last_change":"2020-04-02T23:47:02.574580+0000","last_active":"2020-04-02T23:47:02.574526+0000","last_peered":"2020-04-02T23:47:02.574526+0000","last_clean":"2020-04-02T23:47:02.574526+0000","last_became_active":"2020-04-02T23:21:37.134185+0000","last_became_peered":"2020-04-02T23:21:37.134185+0000","last_unstale":"2020-04-02T23:47:02.574526+0000","last_undegraded":"2020-04-02T23:47:02.574526+0000","last_fullsized":"2020-04-02T23:47:02.574526+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:47:02.574520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:47:02.574520+0000","last_clean_scrub_stamp":"2020-04-02T23:47:02.574520+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"23'21901","reported_seq":"21956","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:46:59.538816+0000","last_change":"2020-04-02T23:46:59.538863+0000","last_active":"2020-04-02T23:46:59.538816+0000","last_peered":"2020-04-02T23:46:59.538816+0000","last_clean":"2020-04-02T23:46:59.538816+0000","last_became_active":"2020-04-02T23:21:40.160330+0000","last_became_peered":"2020-04-02T23:21:40.160330+0000","last_unstale":"2020-04-02T23:46:59.538816+0000","last_undegraded":"2020-04-02T23:46:59.538816+0000","last_fullsized":"2020-04-02T23:46:59.538816+0000","mapping_epoch":20,"log_start":"23'11900","ondisk_log_start":"23'11900","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'21901","last_scrub_stamp":"2020-04-02T23:46:59.538811+0000","last_deep_scrub":"23'21901","last_deep_scrub_stamp":"2020-04-02T23:46:59.538811+0000","last_clean_scrub_stamp":"2020-04-02T23:46:59.538811+0000","log_size":10001,"ondisk_log_size":10001,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25345478,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":42,"num_read_kb":204,"num_write":21903,"num_write_kb":115846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"23'23884","reported_seq":"23896","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:47:04.635647+0000","last_change":"2020-04-02T23:47:04.635715+0000","last_active":"2020-04-02T23:47:04.635647+0000","last_peered":"2020-04-02T23:47:04.635647+0000","last_clean":"2020-04-02T23:47:04.635647+0000","last_became_active":"2020-04-02T23:21:40.549674+0000","last_became_peered":"2020-04-02T23:21:40.549674+0000","last_unstale":"2020-04-02T23:47:04.635647+0000","last_undegraded":"2020-04-02T23:47:04.635647+0000","last_fullsized":"2020-04-02T23:47:04.635647+0000","mapping_epoch":21,"log_start":"23'13800","ondisk_log_start":"23'13800","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'23884","last_scrub_stamp":"2020-04-02T23:47:04.635641+0000","last_deep_scrub":"23'23884","last_deep_scrub_stamp":"2020-04-02T23:47:04.635641+0000","last_clean_scrub_stamp":"2020-04-02T23:47:04.635641+0000","log_size":10084,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18292,"num_write_kb":701037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"23'14170","reported_seq":"15295","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:47:03.698733+0000","last_change":"2020-04-02T23:47:03.698786+0000","last_active":"2020-04-02T23:47:03.698733+0000","last_peered":"2020-04-02T23:47:03.698733+0000","last_clean":"2020-04-02T23:47:03.698733+0000","last_became_active":"2020-04-02T23:21:40.162580+0000","last_became_peered":"2020-04-02T23:21:40.162580+0000","last_unstale":"2020-04-02T23:47:03.698733+0000","last_undegraded":"2020-04-02T23:47:03.698733+0000","last_fullsized":"2020-04-02T23:47:03.698733+0000","mapping_epoch":20,"log_start":"23'4100","ondisk_log_start":"23'4100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'14170","last_scrub_stamp":"2020-04-02T23:47:03.698710+0000","last_deep_scrub":"23'14170","last_deep_scrub_stamp":"2020-04-02T23:47:03.698710+0000","last_clean_scrub_stamp":"2020-04-02T23:47:03.698710+0000","log_size":10070,"ondisk_log_size":10070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12583478,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1112,"num_read_kb":4868,"num_write":14188,"num_write_kb":75851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":462,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"16","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:46:53.707157+0000","last_change":"2020-04-02T23:46:53.707211+0000","last_active":"2020-04-02T23:46:53.707157+0000","last_peered":"2020-04-02T23:46:53.707157+0000","last_clean":"2020-04-02T23:46:53.707157+0000","last_became_active":"2020-04-02T23:21:37.743135+0000","last_became_peered":"2020-04-02T23:21:37.743135+0000","last_unstale":"2020-04-02T23:46:53.707157+0000","last_undegraded":"2020-04-02T23:46:53.707157+0000","last_fullsized":"2020-04-02T23:46:53.707157+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:53.707151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:53.707151+0000","last_clean_scrub_stamp":"2020-04-02T23:46:53.707151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"23'23262","reported_seq":"23274","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:47:01.267185+0000","last_change":"2020-04-02T23:47:01.267242+0000","last_active":"2020-04-02T23:47:01.267185+0000","last_peered":"2020-04-02T23:47:01.267185+0000","last_clean":"2020-04-02T23:47:01.267185+0000","last_became_active":"2020-04-02T23:21:40.539853+0000","last_became_peered":"2020-04-02T23:21:40.539853+0000","last_unstale":"2020-04-02T23:47:01.267185+0000","last_undegraded":"2020-04-02T23:47:01.267185+0000","last_fullsized":"2020-04-02T23:47:01.267185+0000","mapping_epoch":21,"log_start":"23'13200","ondisk_log_start":"23'13200","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'23262","last_scrub_stamp":"2020-04-02T23:47:01.267181+0000","last_deep_scrub":"23'23262","last_deep_scrub_stamp":"2020-04-02T23:47:01.267181+0000","last_clean_scrub_stamp":"2020-04-02T23:47:01.267181+0000","log_size":10062,"ondisk_log_size":10062,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17651,"num_write_kb":545191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"15","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:47:05.624718+0000","last_change":"2020-04-02T23:47:05.624775+0000","last_active":"2020-04-02T23:47:05.624718+0000","last_peered":"2020-04-02T23:47:05.624718+0000","last_clean":"2020-04-02T23:47:05.624718+0000","last_became_active":"2020-04-02T23:21:37.742857+0000","last_became_peered":"2020-04-02T23:21:37.742857+0000","last_unstale":"2020-04-02T23:47:05.624718+0000","last_undegraded":"2020-04-02T23:47:05.624718+0000","last_fullsized":"2020-04-02T23:47:05.624718+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:47:05.624712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:47:05.624712+0000","last_clean_scrub_stamp":"2020-04-02T23:47:05.624712+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'21818","reported_seq":"21831","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:46:56.714596+0000","last_change":"2020-04-02T23:46:56.714647+0000","last_active":"2020-04-02T23:46:56.714596+0000","last_peered":"2020-04-02T23:46:56.714596+0000","last_clean":"2020-04-02T23:46:56.714596+0000","last_became_active":"2020-04-02T23:21:40.161928+0000","last_became_peered":"2020-04-02T23:21:40.161928+0000","last_unstale":"2020-04-02T23:46:56.714596+0000","last_undegraded":"2020-04-02T23:46:56.714596+0000","last_fullsized":"2020-04-02T23:46:56.714596+0000","mapping_epoch":20,"log_start":"23'11800","ondisk_log_start":"23'11800","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'21818","last_scrub_stamp":"2020-04-02T23:46:56.714589+0000","last_deep_scrub":"23'21818","last_deep_scrub_stamp":"2020-04-02T23:46:56.714589+0000","last_clean_scrub_stamp":"2020-04-02T23:46:56.714589+0000","log_size":10018,"ondisk_log_size":10018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":17976749,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22402,"num_write_kb":115485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141250,"num_write_kb":5342106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80280,"ondisk_log_size":80280,"up":16,"acting":16,"num_store_stats":0},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":181735019,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":3277,"num_read_kb":10591,"num_write":175089,"num_write_kb":917793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5560,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80347,"ondisk_log_size":80347,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8224,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542457,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":869732,"kb_used_data":92829648,"kb_used_omap":56739,"kb_used_meta":0,"kb_avail":92829648,"statfs":{"total":95948165120,"available":95057559552,"internally_reserved":0,"allocated":95057559552,"data_stored":95057559552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58101378,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 2 23:46:17 2020","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.39400000000000002,"15min":0.36599999999999999},"min":{"1min":0.20100000000000001,"5min":0.185,"15min":0.17599999999999999},"max":{"1min":0.61899999999999999,"5min":3.6829999999999998,"15min":3.6829999999999998},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39300000000000002,"15min":0.41899999999999998},"min":{"1min":0.215,"5min":0.19400000000000001,"15min":0.193},"max":{"1min":1.3129999999999999,"5min":2.669,"15min":9.5700000000000003},"last":0.48499999999999999}]},{"osd":1,"last update":"Thu Apr 2 23:46:17 2020","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.47399999999999998,"15min":0.45000000000000001},"min":{"1min":0.23599999999999999,"5min":0.20699999999999999,"15min":0.192},"max":{"1min":0.57399999999999995,"5min":3.7250000000000001,"15min":3.7250000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.53200000000000003,"15min":0.47999999999999998},"min":{"1min":0.221,"5min":0.20399999999999999,"15min":0.189},"max":{"1min":1.341,"5min":5.306,"15min":9.5280000000000005},"last":0.39100000000000001}]},{"osd":2,"last update":"Thu Apr 2 23:46:17 2020","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.51700000000000002,"15min":0.433},"min":{"1min":0.22600000000000001,"5min":0.215,"15min":0.20999999999999999},"max":{"1min":3.8900000000000001,"5min":4.1100000000000003,"15min":4.1100000000000003},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.52300000000000002,"15min":0.46700000000000003},"min":{"1min":0.219,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.67600000000000005,"5min":3.7970000000000002,"15min":3.7970000000000002},"last":0.53000000000000003}]},{"osd":3,"last update":"Thu Apr 2 23:46:17 2020","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.55900000000000005,"15min":0.47699999999999998},"min":{"1min":0.26400000000000001,"5min":0.224,"15min":0.221},"max":{"1min":1.5820000000000001,"5min":4.2009999999999996,"15min":4.2009999999999996},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.57299999999999995,"15min":0.54800000000000004},"min":{"1min":0.311,"5min":0.29199999999999998,"15min":0.253},"max":{"1min":0.71199999999999997,"5min":3.7629999999999999,"15min":4.9199999999999999},"last":0.72899999999999998}]},{"osd":4,"last update":"Thu Apr 2 23:46:17 2020","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.63500000000000001,"15min":0.505},"min":{"1min":0.214,"5min":0.214,"15min":0.20000000000000001},"max":{"1min":2.5739999999999998,"5min":5.7910000000000004,"15min":5.7910000000000004},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.434,"5min":0.52400000000000002,"15min":0.45100000000000001},"min":{"1min":0.247,"5min":0.23699999999999999,"15min":0.22600000000000001},"max":{"1min":0.63400000000000001,"5min":4.1639999999999997,"15min":4.1639999999999997},"last":0.627}]},{"osd":5,"last update":"Thu Apr 2 23:46:17 2020","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.56799999999999995,"15min":0.52200000000000002},"min":{"1min":0.252,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.76700000000000002,"5min":4.0750000000000002,"15min":4.0750000000000002},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.64300000000000002,"15min":0.54900000000000004},"min":{"1min":0.33000000000000002,"5min":0.26100000000000001,"15min":0.24299999999999999},"max":{"1min":2.617,"5min":5.8310000000000004,"15min":5.8310000000000004},"last":0.64800000000000002}]},{"osd":6,"last update":"Thu Apr 2 23:46:17 2020","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.72199999999999998,"15min":0.58899999999999997},"min":{"1min":0.318,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":3.1960000000000002,"5min":5.8700000000000001,"15min":5.8700000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.56799999999999995,"15min":0.52300000000000002},"min":{"1min":0.34899999999999998,"5min":0.28699999999999998,"15min":0.215},"max":{"1min":0.78000000000000003,"5min":4.2370000000000001,"15min":4.2370000000000001},"last":0.69199999999999995}]}]},{"osd":6,"up_from":14,"seq":60129542457,"num_pgs":10,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":953988,"kb_used_data":92745392,"kb_used_omap":54848,"kb_used_meta":0,"kb_avail":92745392,"statfs":{"total":95948165120,"available":94971281408,"internally_reserved":0,"allocated":94971281408,"data_stored":94971281408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":56164495,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 2 23:47:07 2020","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.48999999999999999,"15min":0.38400000000000001},"min":{"1min":0.20100000000000001,"5min":0.17699999999999999,"15min":0.159},"max":{"1min":0.70799999999999996,"5min":5.6079999999999997,"15min":5.6079999999999997},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.498,"15min":0.44600000000000001},"min":{"1min":0.26700000000000002,"5min":0.218,"15min":0.17199999999999999},"max":{"1min":0.72399999999999998,"5min":3.411,"15min":4.4950000000000001},"last":0.67600000000000005}]},{"osd":1,"last update":"Thu Apr 2 23:47:07 2020","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.45400000000000001,"15min":0.45000000000000001},"min":{"1min":0.27600000000000002,"5min":0.219,"15min":0.19500000000000001},"max":{"1min":0.68000000000000005,"5min":3.976,"15min":3.976},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.54200000000000004,"15min":0.47899999999999998},"min":{"1min":0.23599999999999999,"5min":0.218,"15min":0.188},"max":{"1min":0.66400000000000003,"5min":5.532,"15min":5.532},"last":0.68899999999999995}]},{"osd":2,"last update":"Thu Apr 2 23:47:07 2020","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.48499999999999999,"15min":0.46100000000000002},"min":{"1min":0.28899999999999998,"5min":0.218,"15min":0.20499999999999999},"max":{"1min":0.68500000000000005,"5min":4.0300000000000002,"15min":4.0300000000000002},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.57699999999999996,"15min":0.47499999999999998},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.216},"max":{"1min":0.625,"5min":5.5599999999999996,"15min":5.5599999999999996},"last":0.50700000000000001}]},{"osd":3,"last update":"Thu Apr 2 23:47:07 2020","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.61199999999999999,"15min":0.54100000000000004},"min":{"1min":0.219,"5min":0.219,"15min":0.20799999999999999},"max":{"1min":6.0780000000000003,"5min":6.0780000000000003,"15min":6.0780000000000003},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.64100000000000001,"15min":0.58699999999999997},"min":{"1min":0.38900000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":6.0599999999999996,"5min":6.0599999999999996,"15min":6.0599999999999996},"last":0.72099999999999997}]},{"osd":4,"last update":"Thu Apr 2 23:47:07 2020","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.52200000000000002,"15min":0.46000000000000002},"min":{"1min":0.26500000000000001,"5min":0.249,"15min":0.189},"max":{"1min":0.63900000000000001,"5min":5.4509999999999996,"15min":5.4509999999999996},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.55800000000000005,"15min":0.51900000000000002},"min":{"1min":0.307,"5min":0.307,"15min":0.23100000000000001},"max":{"1min":0.65600000000000003,"5min":4.0910000000000002,"15min":4.0910000000000002},"last":0.82999999999999996}]},{"osd":5,"last update":"Thu Apr 2 23:47:07 2020","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.54900000000000004,"15min":0.55400000000000005},"min":{"1min":0.34000000000000002,"5min":0.25700000000000001,"15min":0.253},"max":{"1min":0.70999999999999996,"5min":4.1719999999999997,"15min":5.1970000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.71999999999999997,"15min":0.61199999999999999},"min":{"1min":0.34100000000000003,"5min":0.27100000000000002,"15min":0.224},"max":{"1min":9.6899999999999995,"5min":9.6899999999999995,"15min":9.6899999999999995},"last":0.80700000000000005}]},{"osd":7,"last update":"Thu Apr 2 23:47:07 2020","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.59999999999999998,"15min":0.56200000000000006},"min":{"1min":0.316,"5min":0.28799999999999998,"15min":0.22800000000000001},"max":{"1min":0.58899999999999997,"5min":3.464,"15min":4.6539999999999999},"last":0.749},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.63600000000000001,"15min":0.625},"min":{"1min":0.41599999999999998,"5min":0.33100000000000002,"15min":0.32600000000000001},"max":{"1min":0.72799999999999998,"5min":4.202,"15min":4.5300000000000002},"last":0.78600000000000003}]}]},{"osd":1,"up_from":14,"seq":60129542456,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796136,"kb_used_data":92903248,"kb_used_omap":25689,"kb_used_meta":0,"kb_avail":92903244,"statfs":{"total":95948165120,"available":95132921856,"internally_reserved":4096,"allocated":95132925952,"data_stored":95132925952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26305784,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 2 23:46:24 2020","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.33600000000000002,"15min":0.30499999999999999},"min":{"1min":0.17199999999999999,"5min":0.16400000000000001,"15min":0.155},"max":{"1min":4.5439999999999996,"5min":4.5439999999999996,"15min":4.5439999999999996},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.32600000000000001,"15min":0.317},"min":{"1min":0.153,"5min":0.153,"15min":0.153},"max":{"1min":0.54900000000000004,"5min":0.64500000000000002,"15min":0.748},"last":0.374}]},{"osd":2,"last update":"Thu Apr 2 23:46:24 2020","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.505,"15min":0.39900000000000002},"min":{"1min":0.188,"5min":0.183,"15min":0.17199999999999999},"max":{"1min":3.5710000000000002,"5min":5.2240000000000002,"15min":5.2240000000000002},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.45700000000000002,"15min":0.38700000000000001},"min":{"1min":0.224,"5min":0.20000000000000001,"15min":0.16900000000000001},"max":{"1min":4.6310000000000002,"5min":5.1609999999999996,"15min":5.1609999999999996},"last":0.437}]},{"osd":3,"last update":"Thu Apr 2 23:46:24 2020","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.39400000000000002,"15min":0.376},"min":{"1min":0.19900000000000001,"5min":0.19700000000000001,"15min":0.189},"max":{"1min":0.623,"5min":3.27,"15min":6.9539999999999997},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.46100000000000002,"15min":0.46300000000000002},"min":{"1min":0.22800000000000001,"5min":0.20399999999999999,"15min":0.17899999999999999},"max":{"1min":1.22,"5min":5.181,"15min":5.181},"last":0.52500000000000002}]},{"osd":4,"last update":"Thu Apr 2 23:46:24 2020","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.63,"15min":0.51400000000000001},"min":{"1min":0.27100000000000002,"5min":0.245,"15min":0.245},"max":{"1min":4.601,"5min":4.992,"15min":4.992},"last":0.623},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.46000000000000002,"15min":0.439},"min":{"1min":0.25600000000000001,"5min":0.253,"15min":0.23000000000000001},"max":{"1min":0.59299999999999997,"5min":3.1619999999999999,"15min":3.1619999999999999},"last":0.60499999999999998}]},{"osd":5,"last update":"Thu Apr 2 23:46:24 2020","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.48799999999999999,"15min":0.48099999999999998},"min":{"1min":0.26400000000000001,"5min":0.25700000000000001,"15min":0.24099999999999999},"max":{"1min":0.64100000000000001,"5min":3.2069999999999999,"15min":3.7490000000000001},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.56799999999999995,"15min":0.51500000000000001},"min":{"1min":0.36599999999999999,"5min":0.254,"15min":0.246},"max":{"1min":4.0190000000000001,"5min":5.2770000000000001,"15min":5.2770000000000001},"last":0.69599999999999995}]},{"osd":6,"last update":"Thu Apr 2 23:46:24 2020","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.65600000000000003,"15min":0.58199999999999996},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":4.5030000000000001,"5min":5.0609999999999999,"15min":5.0609999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.59899999999999998,"15min":0.54200000000000004},"min":{"1min":0.308,"5min":0.28299999999999997,"15min":0.26700000000000002},"max":{"1min":1.5209999999999999,"5min":3.6269999999999998,"15min":3.6269999999999998},"last":0.64600000000000002}]},{"osd":7,"last update":"Thu Apr 2 23:46:24 2020","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.66900000000000004,"15min":0.56200000000000006},"min":{"1min":0.35499999999999998,"5min":0.311,"15min":0.28100000000000003},"max":{"1min":4.3520000000000003,"5min":5.3099999999999996,"15min":5.3099999999999996},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.80800000000000005,"15min":0.66400000000000003},"min":{"1min":0.36099999999999999,"5min":0.35499999999999998,"15min":0.33300000000000002},"max":{"1min":4.569,"5min":5.1299999999999999,"15min":7.8810000000000002},"last":0.58299999999999996}]}]},{"osd":0,"up_from":14,"seq":60129542456,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":829160,"kb_used_data":92870220,"kb_used_omap":37280,"kb_used_meta":0,"kb_avail":92870220,"statfs":{"total":95948165120,"available":95099105280,"internally_reserved":0,"allocated":95099105280,"data_stored":95099105280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":38175046,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 2 23:46:24 2020","interfaces":[{"interface":"back","average":{"1min":0.29699999999999999,"5min":0.35499999999999998,"15min":0.30499999999999999},"min":{"1min":0.17199999999999999,"5min":0.156,"15min":0.155},"max":{"1min":0.61899999999999999,"5min":7.1180000000000003,"15min":7.1180000000000003},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.193,"5min":0.16900000000000001,"15min":0.16200000000000001},"max":{"1min":0.57899999999999996,"5min":0.97699999999999998,"15min":3.46},"last":0.39400000000000002}]},{"osd":2,"last update":"Thu Apr 2 23:46:24 2020","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.44600000000000001,"15min":0.39900000000000002},"min":{"1min":0.17999999999999999,"5min":0.17999999999999999,"15min":0.159},"max":{"1min":0.59599999999999997,"5min":4.3200000000000003,"15min":4.3200000000000003},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.32700000000000001,"15min":0.35599999999999998},"min":{"1min":0.192,"5min":0.16300000000000001,"15min":0.16300000000000001},"max":{"1min":4.2889999999999997,"5min":4.2889999999999997,"15min":4.2999999999999998},"last":0.36899999999999999}]},{"osd":3,"last update":"Thu Apr 2 23:46:24 2020","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.434,"15min":0.40899999999999997},"min":{"1min":0.222,"5min":0.19800000000000001,"15min":0.182},"max":{"1min":0.76100000000000001,"5min":3.113,"15min":3.113},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.44400000000000001,"15min":0.433},"min":{"1min":0.22800000000000001,"5min":0.20799999999999999,"15min":0.20599999999999999},"max":{"1min":0.751,"5min":3.1000000000000001,"15min":3.6850000000000001},"last":0.441}]},{"osd":4,"last update":"Thu Apr 2 23:46:24 2020","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.442,"15min":0.44700000000000001},"min":{"1min":0.27000000000000002,"5min":0.247,"15min":0.22600000000000001},"max":{"1min":0.745,"5min":1.048,"15min":3.9420000000000002},"last":0.496},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.503,"15min":0.47999999999999998},"min":{"1min":0.26300000000000001,"5min":0.24299999999999999,"15min":0.22700000000000001},"max":{"1min":0.74099999999999999,"5min":6.1479999999999997,"15min":6.1479999999999997},"last":0.57899999999999996}]},{"osd":5,"last update":"Thu Apr 2 23:46:24 2020","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.45800000000000002,"15min":0.47699999999999998},"min":{"1min":0.27600000000000002,"5min":0.24299999999999999,"15min":0.23100000000000001},"max":{"1min":4.3849999999999998,"5min":4.3849999999999998,"15min":4.423},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.50600000000000001,"15min":0.49099999999999999},"min":{"1min":0.31900000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.73599999999999999,"5min":1.254,"15min":2.6899999999999999},"last":0.54400000000000004}]},{"osd":6,"last update":"Thu Apr 2 23:46:24 2020","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.57699999999999996,"15min":0.55800000000000005},"min":{"1min":0.28999999999999998,"5min":0.27500000000000002,"15min":0.26900000000000002},"max":{"1min":0.82599999999999996,"5min":5.2720000000000002,"15min":5.2720000000000002},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.61099999999999999,"15min":0.56000000000000005},"min":{"1min":0.315,"5min":0.26600000000000001,"15min":0.26500000000000001},"max":{"1min":4.3470000000000004,"5min":7.0979999999999999,"15min":7.0979999999999999},"last":0.60099999999999998}]},{"osd":7,"last update":"Thu Apr 2 23:46:24 2020","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.625,"15min":0.56999999999999995},"min":{"1min":0.35499999999999998,"5min":0.30299999999999999,"15min":0.25},"max":{"1min":4.4119999999999999,"5min":7.1539999999999999,"15min":7.1539999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.54400000000000004,"15min":0.52000000000000002},"min":{"1min":0.36299999999999999,"5min":0.34699999999999998,"15min":0.33700000000000002},"max":{"1min":0.78900000000000003,"5min":1.0840000000000001,"15min":2.7930000000000001},"last":0.61499999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542456,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":957980,"kb_used_data":92741400,"kb_used_omap":17213,"kb_used_meta":0,"kb_avail":92741400,"statfs":{"total":95948165120,"available":94967193600,"internally_reserved":0,"allocated":94967193600,"data_stored":94967193600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17626192,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 2 23:46:15 2020","interfaces":[{"interface":"back","average":{"1min":0.30299999999999999,"5min":0.31,"15min":0.32900000000000001},"min":{"1min":0.159,"5min":0.14000000000000001,"15min":0.14000000000000001},"max":{"1min":0.63600000000000001,"5min":3.2090000000000001,"15min":4.3929999999999998},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.28599999999999998,"5min":0.308,"15min":0.28999999999999998},"min":{"1min":0.161,"5min":0.161,"15min":0.161},"max":{"1min":0.64100000000000001,"5min":0.84999999999999998,"15min":0.97499999999999998},"last":0.40000000000000002}]},{"osd":1,"last update":"Thu Apr 2 23:46:15 2020","interfaces":[{"interface":"back","average":{"1min":0.28699999999999998,"5min":0.45000000000000001,"15min":0.40400000000000003},"min":{"1min":0.184,"5min":0.17899999999999999,"15min":0.16700000000000001},"max":{"1min":0.49299999999999999,"5min":4.4000000000000004,"15min":4.4000000000000004},"last":0.312},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.443,"15min":0.41699999999999998},"min":{"1min":0.186,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.52700000000000002,"5min":4.7839999999999998,"15min":4.7839999999999998},"last":0.629}]},{"osd":3,"last update":"Thu Apr 2 23:46:15 2020","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.47499999999999998,"15min":0.40100000000000002},"min":{"1min":0.221,"5min":0.188,"15min":0.182},"max":{"1min":0.91100000000000003,"5min":4.3499999999999996,"15min":4.3499999999999996},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.441,"5min":0.47899999999999998,"15min":0.45300000000000001},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":1.0169999999999999,"5min":3.387,"15min":4.6269999999999998},"last":0.42399999999999999}]},{"osd":4,"last update":"Thu Apr 2 23:46:15 2020","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.52400000000000002,"15min":0.497},"min":{"1min":0.28299999999999997,"5min":0.23200000000000001,"15min":0.22700000000000001},"max":{"1min":0.63400000000000001,"5min":3.5699999999999998,"15min":4.5570000000000004},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.47999999999999998,"15min":0.44900000000000001},"min":{"1min":0.251,"5min":0.251,"15min":0.23499999999999999},"max":{"1min":0.54600000000000004,"5min":3.1669999999999998,"15min":5.3230000000000004},"last":0.67300000000000004}]},{"osd":5,"last update":"Thu Apr 2 23:46:15 2020","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.502,"15min":0.47199999999999998},"min":{"1min":0.27900000000000003,"5min":0.26400000000000001,"15min":0.246},"max":{"1min":0.72099999999999997,"5min":4.5359999999999996,"15min":4.5359999999999996},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.57399999999999995,"15min":0.55100000000000005},"min":{"1min":0.26000000000000001,"5min":0.255,"15min":0.254},"max":{"1min":3.8919999999999999,"5min":3.8919999999999999,"15min":4.5960000000000001},"last":0.75900000000000001}]},{"osd":6,"last update":"Thu Apr 2 23:46:15 2020","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.54800000000000004,"15min":0.48999999999999999},"min":{"1min":0.28599999999999998,"5min":0.28399999999999997,"15min":0.27100000000000002},"max":{"1min":0.60599999999999998,"5min":4.8360000000000003,"15min":4.8360000000000003},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.64400000000000002,"15min":0.56399999999999995},"min":{"1min":0.30299999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.69299999999999995,"5min":4.984,"15min":5.2690000000000001},"last":0.54600000000000004}]},{"osd":7,"last update":"Thu Apr 2 23:46:15 2020","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.56100000000000005,"15min":0.51400000000000001},"min":{"1min":0.35399999999999998,"5min":0.32600000000000001,"15min":0.26900000000000002},"max":{"1min":0.65500000000000003,"5min":3.4119999999999999,"15min":3.4119999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.68799999999999994,"15min":0.59699999999999998},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.30399999999999999},"max":{"1min":3.8100000000000001,"5min":4.5750000000000002,"15min":5.2439999999999998},"last":0.68700000000000006}]}]},{"osd":3,"up_from":14,"seq":60129542455,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796140,"kb_used_data":92903248,"kb_used_omap":37820,"kb_used_meta":0,"kb_avail":92903240,"statfs":{"total":95948165120,"available":95132917760,"internally_reserved":8192,"allocated":95132925952,"data_stored":95132925952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":38728599,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 2 23:47:10 2020","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.33500000000000002,"15min":0.318},"min":{"1min":0.19600000000000001,"5min":0.161,"15min":0.154},"max":{"1min":0.52700000000000002,"5min":3.129,"15min":4.3159999999999998},"last":0.373},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.46300000000000002,"15min":0.39200000000000002},"min":{"1min":0.20699999999999999,"5min":0.186,"15min":0.186},"max":{"1min":0.58899999999999997,"5min":6.7939999999999996,"15min":6.7939999999999996},"last":0.38600000000000001}]},{"osd":1,"last update":"Thu Apr 2 23:47:10 2020","interfaces":[{"interface":"back","average":{"1min":0.28299999999999997,"5min":0.432,"15min":0.34300000000000003},"min":{"1min":0.17999999999999999,"5min":0.16900000000000001,"15min":0.16800000000000001},"max":{"1min":0.46400000000000002,"5min":4.4850000000000003,"15min":4.4850000000000003},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.40300000000000002,"15min":0.39000000000000001},"min":{"1min":0.27200000000000002,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.51200000000000001,"5min":2.927,"15min":2.927},"last":0.249}]},{"osd":2,"last update":"Thu Apr 2 23:47:10 2020","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.39800000000000002,"15min":0.39900000000000002},"min":{"1min":0.23799999999999999,"5min":0.188,"15min":0.17199999999999999},"max":{"1min":0.56999999999999995,"5min":3.0299999999999998,"15min":3.0299999999999998},"last":0.497},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.58899999999999997,"15min":0.45100000000000001},"min":{"1min":0.249,"5min":0.19600000000000001,"15min":0.17699999999999999},"max":{"1min":0.47399999999999998,"5min":6.8179999999999996,"15min":6.8179999999999996},"last":0.27400000000000002}]},{"osd":4,"last update":"Thu Apr 2 23:47:10 2020","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.53200000000000003,"15min":0.44500000000000001},"min":{"1min":0.23300000000000001,"5min":0.23000000000000001,"15min":0.21199999999999999},"max":{"1min":0.61699999999999999,"5min":4.5309999999999997,"15min":4.5309999999999997},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.54300000000000004,"15min":0.503},"min":{"1min":0.35599999999999998,"5min":0.28799999999999998,"15min":0.247},"max":{"1min":0.66100000000000003,"5min":2.9620000000000002,"15min":2.9620000000000002},"last":0.437}]},{"osd":5,"last update":"Thu Apr 2 23:47:10 2020","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.61899999999999999,"15min":0.57899999999999996},"min":{"1min":0.30399999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.63600000000000001,"5min":6.7229999999999999,"15min":6.7229999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.59899999999999998,"15min":0.5},"min":{"1min":0.29699999999999999,"5min":0.26000000000000001,"15min":0.251},"max":{"1min":0.68100000000000005,"5min":4.5679999999999996,"15min":4.5679999999999996},"last":0.46899999999999997}]},{"osd":6,"last update":"Thu Apr 2 23:47:10 2020","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.59099999999999997,"15min":0.54900000000000004},"min":{"1min":0.35099999999999998,"5min":0.28000000000000003,"15min":0.27000000000000002},"max":{"1min":0.64300000000000002,"5min":3.0739999999999998,"15min":3.8639999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.65400000000000003,"15min":0.57799999999999996},"min":{"1min":0.33100000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.67000000000000004,"5min":6.6680000000000001,"15min":6.6680000000000001},"last":0.48299999999999998}]},{"osd":7,"last update":"Thu Apr 2 23:47:10 2020","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56699999999999995,"15min":0.56399999999999995},"min":{"1min":0.377,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.67600000000000005,"5min":2.992,"15min":4.7839999999999998},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.64300000000000002,"15min":0.59299999999999997},"min":{"1min":0.38500000000000001,"5min":0.31900000000000001,"15min":0.28199999999999997},"max":{"1min":0.66000000000000003,"5min":6.7599999999999998,"15min":6.7599999999999998},"last":0.56299999999999994}]}]},{"osd":4,"up_from":14,"seq":60129542456,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":876780,"kb_used_data":92822600,"kb_used_omap":52328,"kb_used_meta":0,"kb_avail":92822600,"statfs":{"total":95948165120,"available":95050342400,"internally_reserved":0,"allocated":95050342400,"data_stored":95050342400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":53584206,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 2 23:46:20 2020","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.371,"15min":0.35499999999999998},"min":{"1min":0.191,"5min":0.184,"15min":0.17199999999999999},"max":{"1min":3.5129999999999999,"5min":3.5129999999999999,"15min":3.758},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41699999999999998,"15min":0.41499999999999998},"min":{"1min":0.251,"5min":0.216,"15min":0.185},"max":{"1min":0.63400000000000001,"5min":2.5800000000000001,"15min":4.1189999999999998},"last":0.69299999999999995}]},{"osd":1,"last update":"Thu Apr 2 23:46:20 2020","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.40799999999999997},"min":{"1min":0.24399999999999999,"5min":0.189,"15min":0.17299999999999999},"max":{"1min":0.66100000000000003,"5min":1.137,"15min":4.1559999999999997},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.24199999999999999,"5min":0.22700000000000001,"15min":0.19700000000000001},"max":{"1min":3.891,"5min":3.891,"15min":4.1970000000000001},"last":0.64300000000000002}]},{"osd":2,"last update":"Thu Apr 2 23:46:20 2020","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.221,"5min":0.20999999999999999,"15min":0.20399999999999999},"max":{"1min":3.8570000000000002,"5min":3.8570000000000002,"15min":4.2489999999999997},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.751,"5min":0.48699999999999999,"15min":0.437},"min":{"1min":0.222,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":4.7160000000000002,"5min":4.7160000000000002,"15min":4.7160000000000002},"last":0.56799999999999995}]},{"osd":3,"last update":"Thu Apr 2 23:46:20 2020","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.501,"15min":0.51400000000000001},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.72799999999999998,"5min":3.4769999999999999,"15min":5.3780000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.52100000000000002,"15min":0.55100000000000005},"min":{"1min":0.32700000000000001,"5min":0.27900000000000003,"15min":0.26200000000000001},"max":{"1min":3.956,"5min":3.956,"15min":5.359},"last":0.67700000000000005}]},{"osd":5,"last update":"Thu Apr 2 23:46:20 2020","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.45200000000000001,"15min":0.439},"min":{"1min":0.27200000000000002,"5min":0.22,"15min":0.217},"max":{"1min":3.5449999999999999,"5min":3.5449999999999999,"15min":3.8029999999999999},"last":0.443},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.54900000000000004,"15min":0.498},"min":{"1min":0.23699999999999999,"5min":0.23000000000000001,"15min":0.21299999999999999},"max":{"1min":5.1900000000000004,"5min":5.1900000000000004,"15min":5.1900000000000004},"last":0.65900000000000003}]},{"osd":6,"last update":"Thu Apr 2 23:46:20 2020","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.52600000000000002,"15min":0.51800000000000002},"min":{"1min":0.25700000000000001,"5min":0.23699999999999999,"15min":0.20000000000000001},"max":{"1min":3.7999999999999998,"5min":3.7999999999999998,"15min":4.29},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.56399999999999995,"15min":0.54800000000000004},"min":{"1min":0.29099999999999998,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":3.4700000000000002,"5min":3.4700000000000002,"15min":5.9420000000000002},"last":0.624}]},{"osd":7,"last update":"Thu Apr 2 23:46:20 2020","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.53000000000000003,"15min":0.56499999999999995},"min":{"1min":0.255,"5min":0.255,"15min":0.22600000000000001},"max":{"1min":0.76400000000000001,"5min":1.0429999999999999,"15min":4.1870000000000003},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.53800000000000003,"15min":0.58799999999999997},"min":{"1min":0.315,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":3.927,"5min":3.927,"15min":4.4429999999999996},"last":0.70799999999999996}]}]},{"osd":5,"up_from":14,"seq":60129542456,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":884140,"kb_used_data":92815240,"kb_used_omap":37548,"kb_used_meta":0,"kb_avail":92815240,"statfs":{"total":95948165120,"available":95042805760,"internally_reserved":0,"allocated":95042805760,"data_stored":95042805760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":38449718,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 2 23:46:25 2020","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.34899999999999998,"15min":0.34200000000000003},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.16700000000000001},"max":{"1min":1.2929999999999999,"5min":1.607,"15min":3.2669999999999999},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.47599999999999998,"15min":0.46100000000000002},"min":{"1min":0.221,"5min":0.19800000000000001,"15min":0.191},"max":{"1min":1.321,"5min":5.0970000000000004,"15min":5.0970000000000004},"last":0.56599999999999995}]},{"osd":1,"last update":"Thu Apr 2 23:46:25 2020","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.54900000000000004,"15min":0.502},"min":{"1min":0.23400000000000001,"5min":0.214,"15min":0.159},"max":{"1min":4.2530000000000001,"5min":5.1360000000000001,"15min":5.1360000000000001},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.48099999999999998,"15min":0.44600000000000001},"min":{"1min":0.217,"5min":0.20799999999999999,"15min":0.20599999999999999},"max":{"1min":1.593,"5min":4.1879999999999997,"15min":4.9790000000000001},"last":0.501}]},{"osd":2,"last update":"Thu Apr 2 23:46:25 2020","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.53600000000000003,"15min":0.50600000000000001},"min":{"1min":0.23799999999999999,"5min":0.23100000000000001,"15min":0.223},"max":{"1min":0.70999999999999996,"5min":4.4409999999999998,"15min":4.9509999999999996},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.47199999999999998,"15min":0.433},"min":{"1min":0.255,"5min":0.224,"15min":0.20999999999999999},"max":{"1min":1.262,"5min":4.1609999999999996,"15min":4.1609999999999996},"last":0.48299999999999998}]},{"osd":3,"last update":"Thu Apr 2 23:46:25 2020","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.69599999999999995,"15min":0.59499999999999997},"min":{"1min":0.27700000000000002,"5min":0.27000000000000002,"15min":0.22700000000000001},"max":{"1min":4.1840000000000002,"5min":5.1630000000000003,"15min":5.1630000000000003},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.51300000000000001,"15min":0.50700000000000001},"min":{"1min":0.27600000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.61599999999999999,"5min":4.4960000000000004,"15min":4.9240000000000004},"last":0.59099999999999997}]},{"osd":4,"last update":"Thu Apr 2 23:46:25 2020","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.46700000000000003,"15min":0.433},"min":{"1min":0.252,"5min":0.23200000000000001,"15min":0.20999999999999999},"max":{"1min":1.222,"5min":2.1419999999999999,"15min":4.8540000000000001},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.626,"15min":0.58799999999999997},"min":{"1min":0.32200000000000001,"5min":0.26900000000000002,"15min":0.23100000000000001},"max":{"1min":4.2779999999999996,"5min":5.1909999999999998,"15min":5.1909999999999998},"last":0.313}]},{"osd":6,"last update":"Thu Apr 2 23:46:25 2020","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.70999999999999996,"15min":0.60099999999999998},"min":{"1min":0.27800000000000002,"5min":0.25900000000000001,"15min":0.22700000000000001},"max":{"1min":3.2320000000000002,"5min":5.6740000000000004,"15min":5.6740000000000004},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.54300000000000004,"15min":0.53900000000000003},"min":{"1min":0.28699999999999998,"5min":0.25,"15min":0.25},"max":{"1min":2.6760000000000002,"5min":2.6760000000000002,"15min":4.6769999999999996},"last":0.54400000000000004}]},{"osd":7,"last update":"Thu Apr 2 23:46:25 2020","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.73799999999999999,"15min":0.65500000000000003},"min":{"1min":0.34399999999999997,"5min":0.33700000000000002,"15min":0.28299999999999997},"max":{"1min":4.2220000000000004,"5min":5.2190000000000003,"15min":5.2190000000000003},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.59399999999999997,"15min":0.59699999999999998},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.26500000000000001},"max":{"1min":0.754,"5min":4.5330000000000004,"15min":4.8879999999999999},"last":0.66300000000000003}]}]}]}} 2020-04-02T23:47:17.823 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2020-04-02T23:21:40.142809+0000 time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=21, tm_sec=40, tm_wday=3, tm_yday=93, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=46, tm_sec=52, tm_wday=3, tm_yday=93, tm_isdst=0) 2020-04-02T23:47:17.823 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2020-04-02T23:21:40.142809+0000 time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=21, tm_sec=40, tm_wday=3, tm_yday=93, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=46, tm_sec=52, tm_wday=3, tm_yday=93, tm_isdst=0) 2020-04-02T23:47:17.824 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2020-04-02T23:21:40.142809+0000 time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=21, tm_sec=40, tm_wday=3, tm_yday=93, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=46, tm_sec=52, tm_wday=3, tm_yday=93, tm_isdst=0) 2020-04-02T23:47:17.824 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2020-04-02T23:47:37.825 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:47:37.843 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-04-02T23:47:38.001 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:37.999+0000 7f444628e700 1 Processor -- start 2020-04-02T23:47:38.001 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:37.999+0000 7f444628e700 1 -- start start 2020-04-02T23:47:38.004 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.000+0000 7f444628e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f44400a7a60 0x7f44400a38f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:38.004 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.000+0000 7f444628e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44400a40d0 con 0x7f44400a1fe0 2020-04-02T23:47:38.004 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.000+0000 7f444628e700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44400a4370 con 0x7f4440138b90 2020-04-02T23:47:38.005 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.000+0000 7f444628e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44400a3ec0 con 0x7f44400a7a60 2020-04-02T23:47:38.005 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.000+0000 7f443ffff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f44400a7a60 0x7f44400a38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:38.005 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.000+0000 7f443ffff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f44400a7a60 0x7f44400a38f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:40712/0 (socket says 172.21.15.174:40712) 2020-04-02T23:47:38.005 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.000+0000 7f443ffff700 1 -- 172.21.15.174:0/3014574866 learned_addr learned my addr 172.21.15.174:0/3014574866 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:47:38.005 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.000+0000 7f443f7fe700 1 --1- 172.21.15.174:0/3014574866 >> v1:172.21.15.174:6789/0 conn(0x7f44400a1fe0 0x7f4440138480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:45752/0 (socket says 172.21.15.174:45752) 2020-04-02T23:47:38.005 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.000+0000 7f443ffff700 1 -- 172.21.15.174:0/3014574866 >> v1:172.21.15.196:6789/0 conn(0x7f4440138b90 legacy=0x7f4440134d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:38.005 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.000+0000 7f443ffff700 1 -- 172.21.15.174:0/3014574866 >> v1:172.21.15.174:6789/0 conn(0x7f44400a1fe0 legacy=0x7f4440138480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:38.006 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.000+0000 7f443ffff700 1 -- 172.21.15.174:0/3014574866 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44400a2470 con 0x7f44400a7a60 2020-04-02T23:47:38.006 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.000+0000 7f443effd700 1 -- 172.21.15.174:0/3014574866 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3143143997 0 0) 0x7f44400a40d0 con 0x7f44400a1fe0 2020-04-02T23:47:38.006 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.000+0000 7f443ffff700 1 --2- 172.21.15.174:0/3014574866 >> v2:172.21.15.174:3300/0 conn(0x7f44400a7a60 0x7f44400a38f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f444005ed20 tx=0x7f4430007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:38.006 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.000+0000 7f443ffff700 1 --2- 172.21.15.174:0/3014574866 >> v2:172.21.15.174:3300/0 conn(0x7f44400a7a60 0x7f44400a38f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f444005ed20 tx=0x7f4430007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:38.006 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.000+0000 7f443ffff700 1 --2- 172.21.15.174:0/3014574866 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f44400a7a60 0x7f44400a38f0 secure :-1 s=READY pgs=256 cs=0 l=1 rx=0x7f444005ed20 tx=0x7f4430007a40).ready entity=mon.0 client_cookie=9a377248f384cdd5 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:38.006 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.000+0000 7f443ffff700 1 --2- 172.21.15.174:0/3014574866 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f44400a7a60 0x7f44400a38f0 secure :-1 s=THROTTLE_DONE pgs=256 cs=0 l=1 rx=0x7f444005ed20 tx=0x7f4430007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:38.006 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.000+0000 7f443effd700 1 -- 172.21.15.174:0/3014574866 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f44300116e0 con 0x7f44400a7a60 2020-04-02T23:47:38.006 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.000+0000 7f443ffff700 1 --2- 172.21.15.174:0/3014574866 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f44400a7a60 0x7f44400a38f0 secure :-1 s=THROTTLE_DONE pgs=256 cs=0 l=1 rx=0x7f444005ed20 tx=0x7f4430007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:38.007 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.000+0000 7f443effd700 1 -- 172.21.15.174:0/3014574866 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4430011840 con 0x7f44400a7a60 2020-04-02T23:47:38.007 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.000+0000 7f443ffff700 1 --2- 172.21.15.174:0/3014574866 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f44400a7a60 0x7f44400a38f0 secure :-1 s=THROTTLE_DONE pgs=256 cs=0 l=1 rx=0x7f444005ed20 tx=0x7f4430007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:38.007 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.000+0000 7f444628e700 1 -- 172.21.15.174:0/3014574866 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f44400a7a60 msgr2=0x7f44400a38f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:38.007 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.000+0000 7f443effd700 1 -- 172.21.15.174:0/3014574866 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4430011c20 con 0x7f44400a7a60 2020-04-02T23:47:38.007 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.000+0000 7f444628e700 1 --2- 172.21.15.174:0/3014574866 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f44400a7a60 0x7f44400a38f0 secure :-1 s=READY pgs=256 cs=0 l=1 rx=0x7f444005ed20 tx=0x7f4430007a40).stop 2020-04-02T23:47:38.007 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.001+0000 7f444628e700 1 -- 172.21.15.174:0/3014574866 shutdown_connections 2020-04-02T23:47:38.007 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.001+0000 7f444628e700 1 --2- 172.21.15.174:0/3014574866 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f44400a7a60 0x7f44400a38f0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:38.008 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.001+0000 7f444628e700 1 -- 172.21.15.174:0/3014574866 >> 172.21.15.174:0/3014574866 conn(0x7f44400aaf80 msgr2=0x7f44400a6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:38.008 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.001+0000 7f444628e700 1 -- 172.21.15.174:0/3014574866 shutdown_connections 2020-04-02T23:47:38.008 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.001+0000 7f444628e700 1 -- 172.21.15.174:0/3014574866 wait complete. 2020-04-02T23:47:38.008 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.002+0000 7f444628e700 1 Processor -- start 2020-04-02T23:47:38.008 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.002+0000 7f444628e700 1 -- start start 2020-04-02T23:47:38.011 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.002+0000 7f444628e700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f44400a1fe0 0x7f44400a1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:38.012 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.002+0000 7f444628e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f44400a7a60 0x7f44400a02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:38.012 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.002+0000 7f444628e700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4440138b90 0x7f44401315d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:38.012 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.003+0000 7f444628e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44400a0740 con 0x7f44400a7a60 2020-04-02T23:47:38.012 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.003+0000 7f444628e700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f444009e440 con 0x7f44400a1fe0 2020-04-02T23:47:38.012 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.003+0000 7f444628e700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4440132820 con 0x7f4440138b90 2020-04-02T23:47:38.012 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.003+0000 7f443f7fe700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f44400a7a60 0x7f44400a02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:38.013 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.003+0000 7f443f7fe700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f44400a7a60 0x7f44400a02e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:40720/0 (socket says 172.21.15.174:40720) 2020-04-02T23:47:38.013 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.003+0000 7f443f7fe700 1 -- 172.21.15.174:0/797462018 learned_addr learned my addr 172.21.15.174:0/797462018 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:47:38.013 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.003+0000 7f443ffff700 1 --2- 172.21.15.174:0/797462018 >> v2:172.21.15.196:3300/0 conn(0x7f44400a1fe0 0x7f44400a1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:38.013 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.003+0000 7f444482b700 1 --2- 172.21.15.174:0/797462018 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4440138b90 0x7f44401315d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:38.013 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.003+0000 7f443f7fe700 1 -- 172.21.15.174:0/797462018 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4440138b90 msgr2=0x7f44401315d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:38.013 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.003+0000 7f443f7fe700 1 --2- 172.21.15.174:0/797462018 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4440138b90 0x7f44401315d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:38.013 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.003+0000 7f443f7fe700 1 -- 172.21.15.174:0/797462018 >> v2:172.21.15.196:3300/0 conn(0x7f44400a1fe0 msgr2=0x7f44400a1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:38.014 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.003+0000 7f443f7fe700 1 --2- 172.21.15.174:0/797462018 >> v2:172.21.15.196:3300/0 conn(0x7f44400a1fe0 0x7f44400a1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:38.014 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.003+0000 7f443f7fe700 1 -- 172.21.15.174:0/797462018 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f444009e770 con 0x7f44400a7a60 2020-04-02T23:47:38.014 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.003+0000 7f444482b700 1 --2- 172.21.15.174:0/797462018 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4440138b90 0x7f44401315d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-02T23:47:38.014 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.003+0000 7f443f7fe700 1 --2- 172.21.15.174:0/797462018 >> v2:172.21.15.174:3300/0 conn(0x7f44400a7a60 0x7f44400a02e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4434000b80 tx=0x7f4434001e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:38.014 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.003+0000 7f443f7fe700 1 --2- 172.21.15.174:0/797462018 >> v2:172.21.15.174:3300/0 conn(0x7f44400a7a60 0x7f44400a02e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4434000b80 tx=0x7f4434001e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:38.014 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.003+0000 7f443f7fe700 1 --2- 172.21.15.174:0/797462018 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f44400a7a60 0x7f44400a02e0 secure :-1 s=READY pgs=257 cs=0 l=1 rx=0x7f4434000b80 tx=0x7f4434001e30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:38.015 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.003+0000 7f443f7fe700 1 --2- 172.21.15.174:0/797462018 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f44400a7a60 0x7f44400a02e0 secure :-1 s=THROTTLE_DONE pgs=257 cs=0 l=1 rx=0x7f4434000b80 tx=0x7f4434001e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:38.015 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.003+0000 7f443d7fa700 1 -- 172.21.15.174:0/797462018 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f443400c940 con 0x7f44400a7a60 2020-04-02T23:47:38.015 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.003+0000 7f443f7fe700 1 --2- 172.21.15.174:0/797462018 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f44400a7a60 0x7f44400a02e0 secure :-1 s=THROTTLE_DONE pgs=257 cs=0 l=1 rx=0x7f4434000b80 tx=0x7f4434001e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:38.015 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.003+0000 7f443f7fe700 1 --2- 172.21.15.174:0/797462018 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f44400a7a60 0x7f44400a02e0 secure :-1 s=THROTTLE_DONE pgs=257 cs=0 l=1 rx=0x7f4434000b80 tx=0x7f4434001e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:38.015 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.003+0000 7f443d7fa700 1 -- 172.21.15.174:0/797462018 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f443400caa0 con 0x7f44400a7a60 2020-04-02T23:47:38.015 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.003+0000 7f443d7fa700 1 -- 172.21.15.174:0/797462018 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f443400ce80 con 0x7f44400a7a60 2020-04-02T23:47:38.016 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.003+0000 7f444628e700 1 -- 172.21.15.174:0/797462018 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f444009ea10 con 0x7f44400a7a60 2020-04-02T23:47:38.016 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.003+0000 7f444628e700 1 -- 172.21.15.174:0/797462018 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4440131a30 con 0x7f44400a7a60 2020-04-02T23:47:38.016 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.004+0000 7f443f7fe700 1 --2- 172.21.15.174:0/797462018 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f44400a7a60 0x7f44400a02e0 secure :-1 s=THROTTLE_DONE pgs=257 cs=0 l=1 rx=0x7f4434000b80 tx=0x7f4434001e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:38.017 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.004+0000 7f444628e700 1 -- 172.21.15.174:0/797462018 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4440056c50 con 0x7f44400a7a60 2020-04-02T23:47:38.017 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.004+0000 7f443d7fa700 1 -- 172.21.15.174:0/797462018 <== mon.0 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f44340044f0 con 0x7f44400a7a60 2020-04-02T23:47:38.017 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.004+0000 7f443f7fe700 1 --2- 172.21.15.174:0/797462018 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f44400a7a60 0x7f44400a02e0 secure :-1 s=THROTTLE_DONE pgs=257 cs=0 l=1 rx=0x7f4434000b80 tx=0x7f4434001e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:38.017 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.005+0000 7f443d7fa700 1 --2- 172.21.15.174:0/797462018 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f442004d500 0x7f442004f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:38.017 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.005+0000 7f443d7fa700 1 -- 172.21.15.174:0/797462018 <== mon.0 v2:172.21.15.174:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4434060b00 con 0x7f44400a7a60 2020-04-02T23:47:38.017 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.005+0000 7f443ffff700 1 --2- 172.21.15.174:0/797462018 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f442004d500 0x7f442004f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:38.018 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.005+0000 7f443ffff700 1 --2- 172.21.15.174:0/797462018 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f442004d500 0x7f442004f9c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f444005ed20 tx=0x7f4430007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:38.018 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.005+0000 7f443ffff700 1 --2- 172.21.15.174:0/797462018 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f442004d500 0x7f442004f9c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f444005ed20 tx=0x7f4430007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:38.018 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.005+0000 7f443ffff700 1 --2- 172.21.15.174:0/797462018 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f442004d500 0x7f442004f9c0 secure :-1 s=READY pgs=135 cs=0 l=1 rx=0x7f444005ed20 tx=0x7f4430007a40).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:38.018 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.008+0000 7f443f7fe700 1 --2- 172.21.15.174:0/797462018 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f44400a7a60 0x7f44400a02e0 secure :-1 s=THROTTLE_DONE pgs=257 cs=0 l=1 rx=0x7f4434000b80 tx=0x7f4434001e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:38.018 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.008+0000 7f443d7fa700 1 -- 172.21.15.174:0/797462018 <== mon.0 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f443403c180 con 0x7f44400a7a60 2020-04-02T23:47:38.142 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.140+0000 7f444628e700 1 -- 172.21.15.174:0/797462018 --> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f444005a690 con 0x7f442004d500 2020-04-02T23:47:38.148 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.144+0000 7f443ffff700 1 --2- 172.21.15.174:0/797462018 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f442004d500 0x7f442004f9c0 secure :-1 s=THROTTLE_DONE pgs=135 cs=0 l=1 rx=0x7f444005ed20 tx=0x7f4430007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:38.148 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.144+0000 7f443d7fa700 1 -- 172.21.15.174:0/797462018 <== mgr.4102 v2:172.21.15.196:6800/23210 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+107536 (secure 0 0 0) 0x7f444005a690 con 0x7f442004d500 2020-04-02T23:47:38.148 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.145+0000 7f444628e700 1 -- 172.21.15.174:0/797462018 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f442004d500 msgr2=0x7f442004f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:38.148 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.145+0000 7f444628e700 1 --2- 172.21.15.174:0/797462018 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f442004d500 0x7f442004f9c0 secure :-1 s=READY pgs=135 cs=0 l=1 rx=0x7f444005ed20 tx=0x7f4430007a40).stop 2020-04-02T23:47:38.149 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.145+0000 7f444628e700 1 -- 172.21.15.174:0/797462018 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f44400a7a60 msgr2=0x7f44400a02e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:38.149 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.145+0000 7f444628e700 1 --2- 172.21.15.174:0/797462018 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f44400a7a60 0x7f44400a02e0 secure :-1 s=READY pgs=257 cs=0 l=1 rx=0x7f4434000b80 tx=0x7f4434001e30).stop 2020-04-02T23:47:38.149 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.145+0000 7f444628e700 1 -- 172.21.15.174:0/797462018 shutdown_connections 2020-04-02T23:47:38.149 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.145+0000 7f444628e700 1 --2- 172.21.15.174:0/797462018 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7f442004d500 0x7f442004f9c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:38.149 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.145+0000 7f444628e700 1 --2- 172.21.15.174:0/797462018 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4440138b90 0x7f44401315d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:38.149 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.145+0000 7f444628e700 1 --2- 172.21.15.174:0/797462018 >> v2:172.21.15.196:3300/0 conn(0x7f44400a1fe0 0x7f44400a1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:38.149 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.145+0000 7f444628e700 1 --2- 172.21.15.174:0/797462018 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f44400a7a60 0x7f44400a02e0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:38.150 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.145+0000 7f444628e700 1 -- 172.21.15.174:0/797462018 >> 172.21.15.174:0/797462018 conn(0x7f44400aaf80 msgr2=0x7f444009d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:38.150 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.145+0000 7f444628e700 1 -- 172.21.15.174:0/797462018 shutdown_connections 2020-04-02T23:47:38.150 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.145+0000 7f444628e700 1 -- 172.21.15.174:0/797462018 wait complete. 2020-04-02T23:47:38.150 INFO:teuthology.orchestra.run.smithi174.stderr:dumped all 2020-04-02T23:47:38.150 INFO:teuthology.orchestra.run.smithi174.stdout: 2020-04-02T23:47:38.158 INFO:teuthology.orchestra.run.smithi174.stdout:{"pg_ready":true,"pg_map":{"version":807,"stamp":"2020-04-02T23:47:36.454646+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":181735019,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":3277,"num_read_kb":10591,"num_write":316341,"num_write_kb":6259909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":13784,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160631,"ondisk_log_size":160631,"up":50,"acting":50,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":749595040,"kb_used":6964044,"kb_used_data":742630996,"kb_used_omap":319474,"kb_used_meta":0,"kb_avail":742630996,"statfs":{"total":767585320960,"available":760454139904,"internally_reserved":0,"allocated":760454139904,"data_stored":760454139904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":327142271,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002819"},"pg_stats":[{"pgid":"4.2","version":"23'23015","reported_seq":"23027","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:47:08.540739+0000","last_change":"2020-04-02T23:47:08.540802+0000","last_active":"2020-04-02T23:47:08.540739+0000","last_peered":"2020-04-02T23:47:08.540739+0000","last_clean":"2020-04-02T23:47:08.540739+0000","last_became_active":"2020-04-02T23:21:40.541485+0000","last_became_peered":"2020-04-02T23:21:40.541485+0000","last_unstale":"2020-04-02T23:47:08.540739+0000","last_undegraded":"2020-04-02T23:47:08.540739+0000","last_fullsized":"2020-04-02T23:47:08.540739+0000","mapping_epoch":21,"log_start":"23'13000","ondisk_log_start":"23'13000","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'23015","last_scrub_stamp":"2020-04-02T23:47:08.540733+0000","last_deep_scrub":"23'23015","last_deep_scrub_stamp":"2020-04-02T23:47:08.540733+0000","last_clean_scrub_stamp":"2020-04-02T23:47:08.540733+0000","log_size":10015,"ondisk_log_size":10015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17420,"num_write_kb":364698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"15","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:47:04.762789+0000","last_change":"2020-04-02T23:47:04.762849+0000","last_active":"2020-04-02T23:47:04.762789+0000","last_peered":"2020-04-02T23:47:04.762789+0000","last_clean":"2020-04-02T23:47:04.762789+0000","last_became_active":"2020-04-02T23:21:37.552244+0000","last_became_peered":"2020-04-02T23:21:37.552244+0000","last_unstale":"2020-04-02T23:47:04.762789+0000","last_undegraded":"2020-04-02T23:47:04.762789+0000","last_fullsized":"2020-04-02T23:47:04.762789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:47:04.762784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:47:04.762784+0000","last_clean_scrub_stamp":"2020-04-02T23:47:04.762784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"23'27526","reported_seq":"27539","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:47:00.283446+0000","last_change":"2020-04-02T23:47:00.283495+0000","last_active":"2020-04-02T23:47:00.283446+0000","last_peered":"2020-04-02T23:47:00.283446+0000","last_clean":"2020-04-02T23:47:00.283446+0000","last_became_active":"2020-04-02T23:21:40.161797+0000","last_became_peered":"2020-04-02T23:21:40.161797+0000","last_unstale":"2020-04-02T23:47:00.283446+0000","last_undegraded":"2020-04-02T23:47:00.283446+0000","last_fullsized":"2020-04-02T23:47:00.283446+0000","mapping_epoch":20,"log_start":"23'17500","ondisk_log_start":"23'17500","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'27526","last_scrub_stamp":"2020-04-02T23:47:00.283440+0000","last_deep_scrub":"23'27526","last_deep_scrub_stamp":"2020-04-02T23:47:00.283440+0000","last_clean_scrub_stamp":"2020-04-02T23:47:00.283440+0000","log_size":10026,"ondisk_log_size":10026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20971680,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27528,"num_write_kb":139085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"23'24404","reported_seq":"24416","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:47:18.414104+0000","last_change":"2020-04-02T23:47:18.414167+0000","last_active":"2020-04-02T23:47:18.414104+0000","last_peered":"2020-04-02T23:47:18.414104+0000","last_clean":"2020-04-02T23:47:18.414104+0000","last_became_active":"2020-04-02T23:21:40.542398+0000","last_became_peered":"2020-04-02T23:21:40.542398+0000","last_unstale":"2020-04-02T23:47:18.414104+0000","last_undegraded":"2020-04-02T23:47:18.414104+0000","last_fullsized":"2020-04-02T23:47:18.414104+0000","mapping_epoch":21,"log_start":"23'14400","ondisk_log_start":"23'14400","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'24404","last_scrub_stamp":"2020-04-02T23:47:18.414098+0000","last_deep_scrub":"23'24404","last_deep_scrub_stamp":"2020-04-02T23:47:18.414098+0000","last_clean_scrub_stamp":"2020-04-02T23:47:18.414098+0000","log_size":10004,"ondisk_log_size":10004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18960,"num_write_kb":915362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"15","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:46:59.559999+0000","last_change":"2020-04-02T23:46:59.560059+0000","last_active":"2020-04-02T23:46:59.559999+0000","last_peered":"2020-04-02T23:46:59.559999+0000","last_clean":"2020-04-02T23:46:59.559999+0000","last_became_active":"2020-04-02T23:21:37.552288+0000","last_became_peered":"2020-04-02T23:21:37.552288+0000","last_unstale":"2020-04-02T23:46:59.559999+0000","last_undegraded":"2020-04-02T23:46:59.559999+0000","last_fullsized":"2020-04-02T23:46:59.559999+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:59.559993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:59.559993+0000","last_clean_scrub_stamp":"2020-04-02T23:46:59.559993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"23'22428","reported_seq":"22441","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:47:00.573588+0000","last_change":"2020-04-02T23:47:00.573633+0000","last_active":"2020-04-02T23:47:00.573588+0000","last_peered":"2020-04-02T23:47:00.573588+0000","last_clean":"2020-04-02T23:47:00.573588+0000","last_became_active":"2020-04-02T23:21:40.157809+0000","last_became_peered":"2020-04-02T23:21:40.157809+0000","last_unstale":"2020-04-02T23:47:00.573588+0000","last_undegraded":"2020-04-02T23:47:00.573588+0000","last_fullsized":"2020-04-02T23:47:00.573588+0000","mapping_epoch":20,"log_start":"23'12400","ondisk_log_start":"23'12400","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'22428","last_scrub_stamp":"2020-04-02T23:47:00.573582+0000","last_deep_scrub":"23'22428","last_deep_scrub_stamp":"2020-04-02T23:47:00.573582+0000","last_clean_scrub_stamp":"2020-04-02T23:47:00.573582+0000","log_size":10028,"ondisk_log_size":10028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":33554466,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22437,"num_write_kb":119909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5098,"num_omap_keys":11,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"23'22440","reported_seq":"22452","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:47:19.423332+0000","last_change":"2020-04-02T23:47:19.423398+0000","last_active":"2020-04-02T23:47:19.423332+0000","last_peered":"2020-04-02T23:47:19.423332+0000","last_clean":"2020-04-02T23:47:19.423332+0000","last_became_active":"2020-04-02T23:21:40.551607+0000","last_became_peered":"2020-04-02T23:21:40.551607+0000","last_unstale":"2020-04-02T23:47:19.423332+0000","last_undegraded":"2020-04-02T23:47:19.423332+0000","last_fullsized":"2020-04-02T23:47:19.423332+0000","mapping_epoch":21,"log_start":"23'12400","ondisk_log_start":"23'12400","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'22440","last_scrub_stamp":"2020-04-02T23:47:19.423325+0000","last_deep_scrub":"23'22440","last_deep_scrub_stamp":"2020-04-02T23:47:19.423325+0000","last_clean_scrub_stamp":"2020-04-02T23:47:19.423325+0000","log_size":10040,"ondisk_log_size":10040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16873,"num_write_kb":829941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"15","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:46:57.453413+0000","last_change":"2020-04-02T23:46:57.453478+0000","last_active":"2020-04-02T23:46:57.453413+0000","last_peered":"2020-04-02T23:46:57.453413+0000","last_clean":"2020-04-02T23:46:57.453413+0000","last_became_active":"2020-04-02T23:21:37.134712+0000","last_became_peered":"2020-04-02T23:21:37.134712+0000","last_unstale":"2020-04-02T23:46:57.453413+0000","last_undegraded":"2020-04-02T23:46:57.453413+0000","last_fullsized":"2020-04-02T23:46:57.453413+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:57.453407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:57.453407+0000","last_clean_scrub_stamp":"2020-04-02T23:46:57.453407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"23'23921","reported_seq":"23934","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:47:06.825679+0000","last_change":"2020-04-02T23:47:06.825726+0000","last_active":"2020-04-02T23:47:06.825679+0000","last_peered":"2020-04-02T23:47:06.825679+0000","last_clean":"2020-04-02T23:47:06.825679+0000","last_became_active":"2020-04-02T23:21:40.161970+0000","last_became_peered":"2020-04-02T23:21:40.161970+0000","last_unstale":"2020-04-02T23:47:06.825679+0000","last_undegraded":"2020-04-02T23:47:06.825679+0000","last_fullsized":"2020-04-02T23:47:06.825679+0000","mapping_epoch":20,"log_start":"23'13900","ondisk_log_start":"23'13900","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'23921","last_scrub_stamp":"2020-04-02T23:47:06.825673+0000","last_deep_scrub":"23'23921","last_deep_scrub_stamp":"2020-04-02T23:47:06.825673+0000","last_clean_scrub_stamp":"2020-04-02T23:47:06.825673+0000","log_size":10021,"ondisk_log_size":10021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":29360128,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23937,"num_write_kb":128370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"23'23333","reported_seq":"23345","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:47:12.640558+0000","last_change":"2020-04-02T23:47:12.640620+0000","last_active":"2020-04-02T23:47:12.640558+0000","last_peered":"2020-04-02T23:47:12.640558+0000","last_clean":"2020-04-02T23:47:12.640558+0000","last_became_active":"2020-04-02T23:21:40.549758+0000","last_became_peered":"2020-04-02T23:21:40.549758+0000","last_unstale":"2020-04-02T23:47:12.640558+0000","last_undegraded":"2020-04-02T23:47:12.640558+0000","last_fullsized":"2020-04-02T23:47:12.640558+0000","mapping_epoch":21,"log_start":"23'13300","ondisk_log_start":"23'13300","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'23333","last_scrub_stamp":"2020-04-02T23:47:12.640552+0000","last_deep_scrub":"23'23333","last_deep_scrub_stamp":"2020-04-02T23:47:12.640552+0000","last_clean_scrub_stamp":"2020-04-02T23:47:12.640552+0000","log_size":10033,"ondisk_log_size":10033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17769,"num_write_kb":673677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"15","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:47:01.558583+0000","last_change":"2020-04-02T23:47:01.558643+0000","last_active":"2020-04-02T23:47:01.558583+0000","last_peered":"2020-04-02T23:47:01.558583+0000","last_clean":"2020-04-02T23:47:01.558583+0000","last_became_active":"2020-04-02T23:21:37.691080+0000","last_became_peered":"2020-04-02T23:21:37.691080+0000","last_unstale":"2020-04-02T23:47:01.558583+0000","last_undegraded":"2020-04-02T23:47:01.558583+0000","last_fullsized":"2020-04-02T23:47:01.558583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:47:01.558577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:47:01.558577+0000","last_clean_scrub_stamp":"2020-04-02T23:47:01.558577+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"23'4","reported_seq":"21","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:47:01.815129+0000","last_change":"2020-04-02T23:47:01.815176+0000","last_active":"2020-04-02T23:47:01.815129+0000","last_peered":"2020-04-02T23:47:01.815129+0000","last_clean":"2020-04-02T23:47:01.815129+0000","last_became_active":"2020-04-02T23:21:30.497574+0000","last_became_peered":"2020-04-02T23:21:30.497574+0000","last_unstale":"2020-04-02T23:47:01.815129+0000","last_undegraded":"2020-04-02T23:47:01.815129+0000","last_fullsized":"2020-04-02T23:47:01.815129+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":3,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'4","last_scrub_stamp":"2020-04-02T23:47:01.815122+0000","last_deep_scrub":"23'4","last_deep_scrub_stamp":"2020-04-02T23:47:01.815122+0000","last_clean_scrub_stamp":"2020-04-02T23:47:01.815122+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8224,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"23'24595","reported_seq":"24608","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:46:54.688373+0000","last_change":"2020-04-02T23:46:54.688426+0000","last_active":"2020-04-02T23:46:54.688373+0000","last_peered":"2020-04-02T23:46:54.688373+0000","last_clean":"2020-04-02T23:46:54.688373+0000","last_became_active":"2020-04-02T23:21:40.157383+0000","last_became_peered":"2020-04-02T23:21:40.157383+0000","last_unstale":"2020-04-02T23:46:54.688373+0000","last_undegraded":"2020-04-02T23:46:54.688373+0000","last_fullsized":"2020-04-02T23:46:54.688373+0000","mapping_epoch":20,"log_start":"23'14500","ondisk_log_start":"23'14500","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'24595","last_scrub_stamp":"2020-04-02T23:46:54.688367+0000","last_deep_scrub":"23'24595","last_deep_scrub_stamp":"2020-04-02T23:46:54.688367+0000","last_clean_scrub_stamp":"2020-04-02T23:46:54.688367+0000","log_size":10095,"ondisk_log_size":10095,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":24605,"num_write_kb":128888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.6","version":"23'22311","reported_seq":"22323","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:47:10.745357+0000","last_change":"2020-04-02T23:47:10.745419+0000","last_active":"2020-04-02T23:47:10.745357+0000","last_peered":"2020-04-02T23:47:10.745357+0000","last_clean":"2020-04-02T23:47:10.745357+0000","last_became_active":"2020-04-02T23:21:40.541400+0000","last_became_peered":"2020-04-02T23:21:40.541400+0000","last_unstale":"2020-04-02T23:47:10.745357+0000","last_undegraded":"2020-04-02T23:47:10.745357+0000","last_fullsized":"2020-04-02T23:47:10.745357+0000","mapping_epoch":21,"log_start":"23'12300","ondisk_log_start":"23'12300","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'22311","last_scrub_stamp":"2020-04-02T23:47:10.745351+0000","last_deep_scrub":"23'22311","last_deep_scrub_stamp":"2020-04-02T23:47:10.745351+0000","last_clean_scrub_stamp":"2020-04-02T23:47:10.745351+0000","log_size":10011,"ondisk_log_size":10011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16691,"num_write_kb":542620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"15","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:46:58.560507+0000","last_change":"2020-04-02T23:46:58.560559+0000","last_active":"2020-04-02T23:46:58.560507+0000","last_peered":"2020-04-02T23:46:58.560507+0000","last_clean":"2020-04-02T23:46:58.560507+0000","last_became_active":"2020-04-02T23:21:37.134489+0000","last_became_peered":"2020-04-02T23:21:37.134489+0000","last_unstale":"2020-04-02T23:46:58.560507+0000","last_undegraded":"2020-04-02T23:46:58.560507+0000","last_fullsized":"2020-04-02T23:46:58.560507+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:58.560502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:58.560502+0000","last_clean_scrub_stamp":"2020-04-02T23:46:58.560502+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"23'18088","reported_seq":"20223","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:46:58.544147+0000","last_change":"2020-04-02T23:46:58.544213+0000","last_active":"2020-04-02T23:46:58.544147+0000","last_peered":"2020-04-02T23:46:58.544147+0000","last_clean":"2020-04-02T23:46:58.544147+0000","last_became_active":"2020-04-02T23:21:40.160398+0000","last_became_peered":"2020-04-02T23:21:40.160398+0000","last_unstale":"2020-04-02T23:46:58.544147+0000","last_undegraded":"2020-04-02T23:46:58.544147+0000","last_fullsized":"2020-04-02T23:46:58.544147+0000","mapping_epoch":20,"log_start":"23'8000","ondisk_log_start":"23'8000","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'18088","last_scrub_stamp":"2020-04-02T23:46:58.544140+0000","last_deep_scrub":"23'18088","last_deep_scrub_stamp":"2020-04-02T23:46:58.544140+0000","last_clean_scrub_stamp":"2020-04-02T23:46:58.544140+0000","log_size":10088,"ondisk_log_size":10088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2122,"num_read_kb":5519,"num_write":18089,"num_write_kb":94359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"23'23331","reported_seq":"23343","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:47:17.420715+0000","last_change":"2020-04-02T23:47:17.420780+0000","last_active":"2020-04-02T23:47:17.420715+0000","last_peered":"2020-04-02T23:47:17.420715+0000","last_clean":"2020-04-02T23:47:17.420715+0000","last_became_active":"2020-04-02T23:21:40.550121+0000","last_became_peered":"2020-04-02T23:21:40.550121+0000","last_unstale":"2020-04-02T23:47:17.420715+0000","last_undegraded":"2020-04-02T23:47:17.420715+0000","last_fullsized":"2020-04-02T23:47:17.420715+0000","mapping_epoch":21,"log_start":"23'13300","ondisk_log_start":"23'13300","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'23331","last_scrub_stamp":"2020-04-02T23:47:17.420709+0000","last_deep_scrub":"23'23331","last_deep_scrub_stamp":"2020-04-02T23:47:17.420709+0000","last_clean_scrub_stamp":"2020-04-02T23:47:17.420709+0000","log_size":10031,"ondisk_log_size":10031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17594,"num_write_kb":769580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"15","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:47:02.574526+0000","last_change":"2020-04-02T23:47:02.574580+0000","last_active":"2020-04-02T23:47:02.574526+0000","last_peered":"2020-04-02T23:47:02.574526+0000","last_clean":"2020-04-02T23:47:02.574526+0000","last_became_active":"2020-04-02T23:21:37.134185+0000","last_became_peered":"2020-04-02T23:21:37.134185+0000","last_unstale":"2020-04-02T23:47:02.574526+0000","last_undegraded":"2020-04-02T23:47:02.574526+0000","last_fullsized":"2020-04-02T23:47:02.574526+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:47:02.574520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:47:02.574520+0000","last_clean_scrub_stamp":"2020-04-02T23:47:02.574520+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"23'21901","reported_seq":"21956","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:46:59.538816+0000","last_change":"2020-04-02T23:46:59.538863+0000","last_active":"2020-04-02T23:46:59.538816+0000","last_peered":"2020-04-02T23:46:59.538816+0000","last_clean":"2020-04-02T23:46:59.538816+0000","last_became_active":"2020-04-02T23:21:40.160330+0000","last_became_peered":"2020-04-02T23:21:40.160330+0000","last_unstale":"2020-04-02T23:46:59.538816+0000","last_undegraded":"2020-04-02T23:46:59.538816+0000","last_fullsized":"2020-04-02T23:46:59.538816+0000","mapping_epoch":20,"log_start":"23'11900","ondisk_log_start":"23'11900","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'21901","last_scrub_stamp":"2020-04-02T23:46:59.538811+0000","last_deep_scrub":"23'21901","last_deep_scrub_stamp":"2020-04-02T23:46:59.538811+0000","last_clean_scrub_stamp":"2020-04-02T23:46:59.538811+0000","log_size":10001,"ondisk_log_size":10001,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25345478,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":42,"num_read_kb":204,"num_write":21903,"num_write_kb":115846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"23'23884","reported_seq":"23896","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:47:04.635647+0000","last_change":"2020-04-02T23:47:04.635715+0000","last_active":"2020-04-02T23:47:04.635647+0000","last_peered":"2020-04-02T23:47:04.635647+0000","last_clean":"2020-04-02T23:47:04.635647+0000","last_became_active":"2020-04-02T23:21:40.549674+0000","last_became_peered":"2020-04-02T23:21:40.549674+0000","last_unstale":"2020-04-02T23:47:04.635647+0000","last_undegraded":"2020-04-02T23:47:04.635647+0000","last_fullsized":"2020-04-02T23:47:04.635647+0000","mapping_epoch":21,"log_start":"23'13800","ondisk_log_start":"23'13800","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'23884","last_scrub_stamp":"2020-04-02T23:47:04.635641+0000","last_deep_scrub":"23'23884","last_deep_scrub_stamp":"2020-04-02T23:47:04.635641+0000","last_clean_scrub_stamp":"2020-04-02T23:47:04.635641+0000","log_size":10084,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18292,"num_write_kb":701037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"23'14170","reported_seq":"15295","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:47:03.698733+0000","last_change":"2020-04-02T23:47:03.698786+0000","last_active":"2020-04-02T23:47:03.698733+0000","last_peered":"2020-04-02T23:47:03.698733+0000","last_clean":"2020-04-02T23:47:03.698733+0000","last_became_active":"2020-04-02T23:21:40.162580+0000","last_became_peered":"2020-04-02T23:21:40.162580+0000","last_unstale":"2020-04-02T23:47:03.698733+0000","last_undegraded":"2020-04-02T23:47:03.698733+0000","last_fullsized":"2020-04-02T23:47:03.698733+0000","mapping_epoch":20,"log_start":"23'4100","ondisk_log_start":"23'4100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'14170","last_scrub_stamp":"2020-04-02T23:47:03.698710+0000","last_deep_scrub":"23'14170","last_deep_scrub_stamp":"2020-04-02T23:47:03.698710+0000","last_clean_scrub_stamp":"2020-04-02T23:47:03.698710+0000","log_size":10070,"ondisk_log_size":10070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12583478,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1112,"num_read_kb":4868,"num_write":14188,"num_write_kb":75851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":462,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"16","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:46:53.707157+0000","last_change":"2020-04-02T23:46:53.707211+0000","last_active":"2020-04-02T23:46:53.707157+0000","last_peered":"2020-04-02T23:46:53.707157+0000","last_clean":"2020-04-02T23:46:53.707157+0000","last_became_active":"2020-04-02T23:21:37.743135+0000","last_became_peered":"2020-04-02T23:21:37.743135+0000","last_unstale":"2020-04-02T23:46:53.707157+0000","last_undegraded":"2020-04-02T23:46:53.707157+0000","last_fullsized":"2020-04-02T23:46:53.707157+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:46:53.707151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:46:53.707151+0000","last_clean_scrub_stamp":"2020-04-02T23:46:53.707151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"23'23262","reported_seq":"23274","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:47:01.267185+0000","last_change":"2020-04-02T23:47:01.267242+0000","last_active":"2020-04-02T23:47:01.267185+0000","last_peered":"2020-04-02T23:47:01.267185+0000","last_clean":"2020-04-02T23:47:01.267185+0000","last_became_active":"2020-04-02T23:21:40.539853+0000","last_became_peered":"2020-04-02T23:21:40.539853+0000","last_unstale":"2020-04-02T23:47:01.267185+0000","last_undegraded":"2020-04-02T23:47:01.267185+0000","last_fullsized":"2020-04-02T23:47:01.267185+0000","mapping_epoch":21,"log_start":"23'13200","ondisk_log_start":"23'13200","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'23262","last_scrub_stamp":"2020-04-02T23:47:01.267181+0000","last_deep_scrub":"23'23262","last_deep_scrub_stamp":"2020-04-02T23:47:01.267181+0000","last_clean_scrub_stamp":"2020-04-02T23:47:01.267181+0000","log_size":10062,"ondisk_log_size":10062,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17651,"num_write_kb":545191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"15","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:47:05.624718+0000","last_change":"2020-04-02T23:47:05.624775+0000","last_active":"2020-04-02T23:47:05.624718+0000","last_peered":"2020-04-02T23:47:05.624718+0000","last_clean":"2020-04-02T23:47:05.624718+0000","last_became_active":"2020-04-02T23:21:37.742857+0000","last_became_peered":"2020-04-02T23:21:37.742857+0000","last_unstale":"2020-04-02T23:47:05.624718+0000","last_undegraded":"2020-04-02T23:47:05.624718+0000","last_fullsized":"2020-04-02T23:47:05.624718+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:47:05.624712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:47:05.624712+0000","last_clean_scrub_stamp":"2020-04-02T23:47:05.624712+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'21818","reported_seq":"21831","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-02T23:46:56.714596+0000","last_change":"2020-04-02T23:46:56.714647+0000","last_active":"2020-04-02T23:46:56.714596+0000","last_peered":"2020-04-02T23:46:56.714596+0000","last_clean":"2020-04-02T23:46:56.714596+0000","last_became_active":"2020-04-02T23:21:40.161928+0000","last_became_peered":"2020-04-02T23:21:40.161928+0000","last_unstale":"2020-04-02T23:46:56.714596+0000","last_undegraded":"2020-04-02T23:46:56.714596+0000","last_fullsized":"2020-04-02T23:46:56.714596+0000","mapping_epoch":20,"log_start":"23'11800","ondisk_log_start":"23'11800","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'21818","last_scrub_stamp":"2020-04-02T23:46:56.714589+0000","last_deep_scrub":"23'21818","last_deep_scrub_stamp":"2020-04-02T23:46:56.714589+0000","last_clean_scrub_stamp":"2020-04-02T23:46:56.714589+0000","log_size":10018,"ondisk_log_size":10018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":17976749,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22402,"num_write_kb":115485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141250,"num_write_kb":5342106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80280,"ondisk_log_size":80280,"up":16,"acting":16,"num_store_stats":0},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":181735019,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":3277,"num_read_kb":10591,"num_write":175089,"num_write_kb":917793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5560,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80347,"ondisk_log_size":80347,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8224,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542461,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":869732,"kb_used_data":92829648,"kb_used_omap":56740,"kb_used_meta":0,"kb_avail":92829648,"statfs":{"total":95948165120,"available":95057559552,"internally_reserved":0,"allocated":95057559552,"data_stored":95057559552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58102565,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 2 23:47:18 2020","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.42599999999999999,"15min":0.38},"min":{"1min":0.22600000000000001,"5min":0.185,"15min":0.17599999999999999},"max":{"1min":0.65100000000000002,"5min":3.6829999999999998,"15min":3.6829999999999998},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.45500000000000002,"15min":0.442},"min":{"1min":0.19900000000000001,"5min":0.19400000000000001,"15min":0.193},"max":{"1min":3.9969999999999999,"5min":3.9969999999999999,"15min":9.5700000000000003},"last":0.53800000000000003}]},{"osd":1,"last update":"Thu Apr 2 23:47:18 2020","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.495,"15min":0.46300000000000002},"min":{"1min":0.27200000000000002,"5min":0.219,"15min":0.192},"max":{"1min":0.67800000000000005,"5min":3.7250000000000001,"15min":3.7250000000000001},"last":0.628},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.58499999999999996,"15min":0.499},"min":{"1min":0.248,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":3.8290000000000002,"5min":5.306,"15min":9.5280000000000005},"last":0.59599999999999997}]},{"osd":2,"last update":"Thu Apr 2 23:47:18 2020","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.58099999999999996,"15min":0.45500000000000002},"min":{"1min":0.317,"5min":0.215,"15min":0.20999999999999999},"max":{"1min":3.794,"5min":4.1100000000000003,"15min":4.1100000000000003},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.55100000000000005,"15min":0.47699999999999998},"min":{"1min":0.29299999999999998,"5min":0.219,"15min":0.20899999999999999},"max":{"1min":0.73599999999999999,"5min":3.7970000000000002,"15min":3.7970000000000002},"last":0.73599999999999999}]},{"osd":3,"last update":"Thu Apr 2 23:47:18 2020","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.58199999999999996,"15min":0.497},"min":{"1min":0.35599999999999998,"5min":0.23599999999999999,"15min":0.221},"max":{"1min":3.8610000000000002,"5min":4.2009999999999996,"15min":4.2009999999999996},"last":0.497},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.56899999999999995,"15min":0.55500000000000005},"min":{"1min":0.372,"5min":0.29199999999999998,"15min":0.253},"max":{"1min":0.72899999999999998,"5min":3.7629999999999999,"15min":4.9199999999999999},"last":0.47599999999999998}]},{"osd":4,"last update":"Thu Apr 2 23:47:18 2020","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.67500000000000004,"15min":0.52200000000000002},"min":{"1min":0.28699999999999998,"5min":0.214,"15min":0.20300000000000001},"max":{"1min":3.887,"5min":5.7910000000000004,"15min":5.7910000000000004},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.58399999999999996,"15min":0.47099999999999997},"min":{"1min":0.314,"5min":0.247,"15min":0.23300000000000001},"max":{"1min":3.9489999999999998,"5min":4.1639999999999997,"15min":4.1639999999999997},"last":0.57299999999999995}]},{"osd":5,"last update":"Thu Apr 2 23:47:18 2020","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.60799999999999998,"15min":0.53700000000000003},"min":{"1min":0.30199999999999999,"5min":0.252,"15min":0.23400000000000001},"max":{"1min":3.7679999999999998,"5min":4.0750000000000002,"15min":4.0750000000000002},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.68700000000000006,"15min":0.56499999999999995},"min":{"1min":0.35099999999999998,"5min":0.26100000000000001,"15min":0.24299999999999999},"max":{"1min":3.9649999999999999,"5min":5.8310000000000004,"15min":5.8310000000000004},"last":0.71099999999999997}]},{"osd":6,"last update":"Thu Apr 2 23:47:18 2020","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.76600000000000001,"15min":0.60699999999999998},"min":{"1min":0.376,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":3.9289999999999998,"5min":5.8700000000000001,"15min":5.8700000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.61499999999999999,"15min":0.54000000000000004},"min":{"1min":0.39500000000000002,"5min":0.28699999999999998,"15min":0.215},"max":{"1min":3.911,"5min":4.2370000000000001,"15min":4.2370000000000001},"last":0.61099999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542461,"num_pgs":10,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":953988,"kb_used_data":92745392,"kb_used_omap":54851,"kb_used_meta":0,"kb_avail":92745392,"statfs":{"total":95948165120,"available":94971281408,"internally_reserved":0,"allocated":94971281408,"data_stored":94971281408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":56167737,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 2 23:47:07 2020","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.48999999999999999,"15min":0.38400000000000001},"min":{"1min":0.20100000000000001,"5min":0.17699999999999999,"15min":0.159},"max":{"1min":0.70799999999999996,"5min":5.6079999999999997,"15min":5.6079999999999997},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.498,"15min":0.44600000000000001},"min":{"1min":0.26700000000000002,"5min":0.218,"15min":0.17199999999999999},"max":{"1min":0.72399999999999998,"5min":3.411,"15min":4.4950000000000001},"last":0.41299999999999998}]},{"osd":1,"last update":"Thu Apr 2 23:47:07 2020","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.45400000000000001,"15min":0.45000000000000001},"min":{"1min":0.27600000000000002,"5min":0.219,"15min":0.19500000000000001},"max":{"1min":0.68000000000000005,"5min":3.976,"15min":3.976},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.54200000000000004,"15min":0.47899999999999998},"min":{"1min":0.23599999999999999,"5min":0.218,"15min":0.188},"max":{"1min":0.66400000000000003,"5min":5.532,"15min":5.532},"last":0.48199999999999998}]},{"osd":2,"last update":"Thu Apr 2 23:47:07 2020","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.48499999999999999,"15min":0.46100000000000002},"min":{"1min":0.28899999999999998,"5min":0.218,"15min":0.20499999999999999},"max":{"1min":0.68500000000000005,"5min":4.0300000000000002,"15min":4.0300000000000002},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.57699999999999996,"15min":0.47499999999999998},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.216},"max":{"1min":0.625,"5min":5.5599999999999996,"15min":5.5599999999999996},"last":0.432}]},{"osd":3,"last update":"Thu Apr 2 23:47:07 2020","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.61199999999999999,"15min":0.54100000000000004},"min":{"1min":0.219,"5min":0.219,"15min":0.20799999999999999},"max":{"1min":6.0780000000000003,"5min":6.0780000000000003,"15min":6.0780000000000003},"last":0.501},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.64100000000000001,"15min":0.58699999999999997},"min":{"1min":0.38900000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":6.0599999999999996,"5min":6.0599999999999996,"15min":6.0599999999999996},"last":0.58599999999999997}]},{"osd":4,"last update":"Thu Apr 2 23:47:07 2020","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.52200000000000002,"15min":0.46000000000000002},"min":{"1min":0.26500000000000001,"5min":0.249,"15min":0.189},"max":{"1min":0.63900000000000001,"5min":5.4509999999999996,"15min":5.4509999999999996},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.55800000000000005,"15min":0.51900000000000002},"min":{"1min":0.307,"5min":0.307,"15min":0.23100000000000001},"max":{"1min":0.65600000000000003,"5min":4.0910000000000002,"15min":4.0910000000000002},"last":0.71299999999999997}]},{"osd":5,"last update":"Thu Apr 2 23:47:07 2020","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.54900000000000004,"15min":0.55400000000000005},"min":{"1min":0.34000000000000002,"5min":0.25700000000000001,"15min":0.253},"max":{"1min":0.70999999999999996,"5min":4.1719999999999997,"15min":5.1970000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.71999999999999997,"15min":0.61199999999999999},"min":{"1min":0.34100000000000003,"5min":0.27100000000000002,"15min":0.224},"max":{"1min":9.6899999999999995,"5min":9.6899999999999995,"15min":9.6899999999999995},"last":0.56299999999999994}]},{"osd":7,"last update":"Thu Apr 2 23:47:07 2020","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.59999999999999998,"15min":0.56200000000000006},"min":{"1min":0.316,"5min":0.28799999999999998,"15min":0.22800000000000001},"max":{"1min":0.58899999999999997,"5min":3.464,"15min":4.6539999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.63600000000000001,"15min":0.625},"min":{"1min":0.41599999999999998,"5min":0.33100000000000002,"15min":0.32600000000000001},"max":{"1min":0.72799999999999998,"5min":4.202,"15min":4.5300000000000002},"last":0.67200000000000004}]}]},{"osd":1,"up_from":14,"seq":60129542460,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796132,"kb_used_data":92903248,"kb_used_omap":25689,"kb_used_meta":0,"kb_avail":92903248,"statfs":{"total":95948165120,"available":95132925952,"internally_reserved":0,"allocated":95132925952,"data_stored":95132925952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26305834,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 2 23:47:27 2020","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.34699999999999998,"15min":0.311},"min":{"1min":0.17399999999999999,"5min":0.16400000000000001,"15min":0.155},"max":{"1min":0.55800000000000005,"5min":4.5439999999999996,"15min":4.5439999999999996},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.33200000000000002,"15min":0.32300000000000001},"min":{"1min":0.185,"5min":0.153,"15min":0.153},"max":{"1min":0.53300000000000003,"5min":0.60199999999999998,"15min":0.748},"last":0.26500000000000001}]},{"osd":2,"last update":"Thu Apr 2 23:47:27 2020","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.51400000000000001,"15min":0.40699999999999997},"min":{"1min":0.23200000000000001,"5min":0.183,"15min":0.17199999999999999},"max":{"1min":0.60599999999999998,"5min":5.2240000000000002,"15min":5.2240000000000002},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.374,"5min":0.46600000000000003,"15min":0.39300000000000002},"min":{"1min":0.20300000000000001,"5min":0.20000000000000001,"15min":0.16900000000000001},"max":{"1min":0.61599999999999999,"5min":5.1609999999999996,"15min":5.1609999999999996},"last":0.434}]},{"osd":3,"last update":"Thu Apr 2 23:47:27 2020","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.36499999999999999,"15min":0.377},"min":{"1min":0.20499999999999999,"5min":0.19700000000000001,"15min":0.189},"max":{"1min":0.56299999999999994,"5min":1.131,"15min":6.9539999999999997},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.46600000000000003,"15min":0.46400000000000002},"min":{"1min":0.25800000000000001,"5min":0.20399999999999999,"15min":0.20200000000000001},"max":{"1min":0.65200000000000002,"5min":5.181,"15min":5.181},"last":0.40400000000000003}]},{"osd":4,"last update":"Thu Apr 2 23:47:27 2020","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.61199999999999999,"15min":0.52000000000000002},"min":{"1min":0.27600000000000002,"5min":0.254,"15min":0.245},"max":{"1min":0.68400000000000005,"5min":4.992,"15min":4.992},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.45700000000000002,"15min":0.44700000000000001},"min":{"1min":0.32200000000000001,"5min":0.253,"15min":0.23000000000000001},"max":{"1min":0.74299999999999999,"5min":0.76500000000000001,"15min":3.1619999999999999},"last":0.72499999999999998}]},{"osd":5,"last update":"Thu Apr 2 23:47:27 2020","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.48699999999999999,"15min":0.48999999999999999},"min":{"1min":0.28000000000000003,"5min":0.25700000000000001,"15min":0.24099999999999999},"max":{"1min":1.8620000000000001,"5min":1.8620000000000001,"15min":3.7490000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58599999999999997,"15min":0.52400000000000002},"min":{"1min":0.33900000000000002,"5min":0.254,"15min":0.246},"max":{"1min":0.71899999999999997,"5min":5.2770000000000001,"15min":5.2770000000000001},"last":0.56200000000000006}]},{"osd":6,"last update":"Thu Apr 2 23:47:27 2020","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.65900000000000003,"15min":0.59399999999999997},"min":{"1min":0.32200000000000001,"5min":0.251,"15min":0.251},"max":{"1min":1.917,"5min":5.0609999999999999,"15min":5.0609999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56699999999999995,"15min":0.54500000000000004},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.26700000000000002},"max":{"1min":0.70599999999999996,"5min":3.6269999999999998,"15min":3.6269999999999998},"last":0.504}]},{"osd":7,"last update":"Thu Apr 2 23:47:27 2020","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.70399999999999996,"15min":0.57799999999999996},"min":{"1min":0.40100000000000002,"5min":0.311,"15min":0.28100000000000003},"max":{"1min":2.8700000000000001,"5min":5.3099999999999996,"15min":5.3099999999999996},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.79100000000000004,"15min":0.67100000000000004},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.80200000000000005,"5min":5.1299999999999999,"15min":7.8810000000000002},"last":0.63}]}]},{"osd":0,"up_from":14,"seq":60129542460,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":829160,"kb_used_data":92870220,"kb_used_omap":37282,"kb_used_meta":0,"kb_avail":92870220,"statfs":{"total":95948165120,"available":95099105280,"internally_reserved":0,"allocated":95099105280,"data_stored":95099105280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":38177370,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 2 23:47:24 2020","interfaces":[{"interface":"back","average":{"1min":0.30199999999999999,"5min":0.28599999999999998,"15min":0.311},"min":{"1min":0.16500000000000001,"5min":0.156,"15min":0.156},"max":{"1min":0.53100000000000003,"5min":0.80400000000000005,"15min":7.1180000000000003},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.33100000000000002,"15min":0.34000000000000002},"min":{"1min":0.19400000000000001,"5min":0.17499999999999999,"15min":0.16200000000000001},"max":{"1min":0.47699999999999998,"5min":0.64300000000000002,"15min":3.46},"last":0.48999999999999999}]},{"osd":2,"last update":"Thu Apr 2 23:47:24 2020","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.437,"15min":0.40799999999999997},"min":{"1min":0.222,"5min":0.17999999999999999,"15min":0.159},"max":{"1min":0.53400000000000003,"5min":4.3200000000000003,"15min":4.3200000000000003},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.34799999999999998,"15min":0.36099999999999999},"min":{"1min":0.21199999999999999,"5min":0.17599999999999999,"15min":0.16300000000000001},"max":{"1min":0.48599999999999999,"5min":4.2889999999999997,"15min":4.2999999999999998},"last":0.42599999999999999}]},{"osd":3,"last update":"Thu Apr 2 23:47:24 2020","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.41699999999999998,"15min":0.41199999999999998},"min":{"1min":0.187,"5min":0.187,"15min":0.182},"max":{"1min":0.46899999999999997,"5min":3.113,"15min":3.113},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.42999999999999999,"15min":0.435},"min":{"1min":0.23799999999999999,"5min":0.20799999999999999,"15min":0.20599999999999999},"max":{"1min":0.67100000000000004,"5min":3.1000000000000001,"15min":3.6850000000000001},"last":0.55400000000000005}]},{"osd":4,"last update":"Thu Apr 2 23:47:24 2020","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.45300000000000001,"15min":0.45700000000000002},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.22700000000000001},"max":{"1min":0.63500000000000001,"5min":0.745,"15min":3.9420000000000002},"last":0.746},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52100000000000002,"15min":0.48999999999999999},"min":{"1min":0.32300000000000001,"5min":0.252,"15min":0.22700000000000001},"max":{"1min":0.81799999999999995,"5min":6.1479999999999997,"15min":6.1479999999999997},"last":0.69599999999999995}]},{"osd":5,"last update":"Thu Apr 2 23:47:24 2020","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.498,"15min":0.48899999999999999},"min":{"1min":0.314,"5min":0.27600000000000002,"15min":0.23100000000000001},"max":{"1min":1.071,"5min":4.3849999999999998,"15min":4.423},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.51500000000000001,"15min":0.5},"min":{"1min":0.37,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.76500000000000001,"5min":1.254,"15min":2.6899999999999999},"last":0.65700000000000003}]},{"osd":6,"last update":"Thu Apr 2 23:47:24 2020","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.57299999999999995,"15min":0.56899999999999995},"min":{"1min":0.36399999999999999,"5min":0.27500000000000002,"15min":0.26900000000000002},"max":{"1min":1.129,"5min":5.2720000000000002,"15min":5.2720000000000002},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.56100000000000005,"15min":0.57299999999999995},"min":{"1min":0.36699999999999999,"5min":0.28799999999999998,"15min":0.26500000000000001},"max":{"1min":1.1559999999999999,"5min":5.3029999999999999,"15min":7.0979999999999999},"last":0.82199999999999995}]},{"osd":7,"last update":"Thu Apr 2 23:47:24 2020","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.58199999999999996,"15min":0.57899999999999996},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.25},"max":{"1min":0.84499999999999997,"5min":4.6859999999999999,"15min":7.1539999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55600000000000005,"15min":0.52900000000000003},"min":{"1min":0.39700000000000002,"5min":0.34699999999999998,"15min":0.33700000000000002},"max":{"1min":0.77100000000000002,"5min":0.91000000000000003,"15min":2.7930000000000001},"last":0.78100000000000003}]}]},{"osd":2,"up_from":14,"seq":60129542460,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":957980,"kb_used_data":92741400,"kb_used_omap":17213,"kb_used_meta":0,"kb_avail":92741400,"statfs":{"total":95948165120,"available":94967193600,"internally_reserved":0,"allocated":94967193600,"data_stored":94967193600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17626192,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 2 23:47:16 2020","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.33600000000000002,"15min":0.34000000000000002},"min":{"1min":0.17499999999999999,"5min":0.14000000000000001,"15min":0.14000000000000001},"max":{"1min":1.8859999999999999,"5min":3.2090000000000001,"15min":4.3929999999999998},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.30199999999999999,"15min":0.29499999999999998},"min":{"1min":0.14599999999999999,"5min":0.14599999999999999,"15min":0.14599999999999999},"max":{"1min":0.58399999999999996,"5min":0.84999999999999998,"15min":0.97499999999999998},"last":0.51300000000000001}]},{"osd":1,"last update":"Thu Apr 2 23:47:16 2020","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.38400000000000001,"15min":0.40999999999999998},"min":{"1min":0.20699999999999999,"5min":0.17899999999999999,"15min":0.16700000000000001},"max":{"1min":0.70799999999999996,"5min":2.8140000000000001,"15min":4.4000000000000004},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.45100000000000001,"15min":0.42199999999999999},"min":{"1min":0.21099999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.69199999999999995,"5min":4.7839999999999998,"15min":4.7839999999999998},"last":0.29899999999999999}]},{"osd":3,"last update":"Thu Apr 2 23:47:16 2020","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.39800000000000002,"15min":0.40500000000000003},"min":{"1min":0.23200000000000001,"5min":0.191,"15min":0.182},"max":{"1min":0.55400000000000005,"5min":3.0840000000000001,"15min":4.3499999999999996},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.44900000000000001,"15min":0.45800000000000002},"min":{"1min":0.248,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.62,"5min":3.387,"15min":4.6269999999999998},"last":0.33500000000000002}]},{"osd":4,"last update":"Thu Apr 2 23:47:16 2020","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.53600000000000003,"15min":0.505},"min":{"1min":0.28899999999999998,"5min":0.23200000000000001,"15min":0.22700000000000001},"max":{"1min":0.72399999999999998,"5min":3.5699999999999998,"15min":4.5570000000000004},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.48499999999999999,"15min":0.45800000000000002},"min":{"1min":0.307,"5min":0.251,"15min":0.23499999999999999},"max":{"1min":0.77400000000000002,"5min":3.1669999999999998,"15min":5.3230000000000004},"last":0.46500000000000002}]},{"osd":5,"last update":"Thu Apr 2 23:47:16 2020","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.46000000000000002,"15min":0.47999999999999998},"min":{"1min":0.32400000000000001,"5min":0.26400000000000001,"15min":0.246},"max":{"1min":0.70299999999999996,"5min":0.81299999999999994,"15min":4.5359999999999996},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.58199999999999996,"15min":0.55800000000000005},"min":{"1min":0.27300000000000002,"5min":0.26000000000000001,"15min":0.254},"max":{"1min":0.75900000000000001,"5min":3.8919999999999999,"15min":4.5960000000000001},"last":0.54300000000000004}]},{"osd":6,"last update":"Thu Apr 2 23:47:16 2020","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.55500000000000005,"15min":0.498},"min":{"1min":0.30499999999999999,"5min":0.28399999999999997,"15min":0.27100000000000002},"max":{"1min":0.81999999999999995,"5min":4.8360000000000003,"15min":4.8360000000000003},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.623,"15min":0.57899999999999996},"min":{"1min":0.35899999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":2.7170000000000001,"5min":4.984,"15min":5.2690000000000001},"last":0.49199999999999999}]},{"osd":7,"last update":"Thu Apr 2 23:47:16 2020","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.59499999999999997,"15min":0.53100000000000003},"min":{"1min":0.315,"5min":0.315,"15min":0.29499999999999998},"max":{"1min":3.133,"5min":3.4119999999999999,"15min":3.4119999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.63900000000000001,"15min":0.60199999999999998},"min":{"1min":0.376,"5min":0.34300000000000003,"15min":0.30399999999999999},"max":{"1min":0.754,"5min":3.8100000000000001,"15min":5.2439999999999998},"last":0.53000000000000003}]}]},{"osd":3,"up_from":14,"seq":60129542459,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796132,"kb_used_data":92903248,"kb_used_omap":37820,"kb_used_meta":0,"kb_avail":92903248,"statfs":{"total":95948165120,"available":95132925952,"internally_reserved":0,"allocated":95132925952,"data_stored":95132925952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":38728649,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 2 23:47:10 2020","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.33500000000000002,"15min":0.318},"min":{"1min":0.19600000000000001,"5min":0.161,"15min":0.154},"max":{"1min":0.52700000000000002,"5min":3.129,"15min":4.3159999999999998},"last":0.224},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.46300000000000002,"15min":0.39200000000000002},"min":{"1min":0.20699999999999999,"5min":0.186,"15min":0.186},"max":{"1min":0.58899999999999997,"5min":6.7939999999999996,"15min":6.7939999999999996},"last":0.26500000000000001}]},{"osd":1,"last update":"Thu Apr 2 23:47:10 2020","interfaces":[{"interface":"back","average":{"1min":0.28299999999999997,"5min":0.432,"15min":0.34300000000000003},"min":{"1min":0.17999999999999999,"5min":0.16900000000000001,"15min":0.16800000000000001},"max":{"1min":0.46400000000000002,"5min":4.4850000000000003,"15min":4.4850000000000003},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.40300000000000002,"15min":0.39000000000000001},"min":{"1min":0.27200000000000002,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.51200000000000001,"5min":2.927,"15min":2.927},"last":0.36599999999999999}]},{"osd":2,"last update":"Thu Apr 2 23:47:10 2020","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.39800000000000002,"15min":0.39900000000000002},"min":{"1min":0.23799999999999999,"5min":0.188,"15min":0.17199999999999999},"max":{"1min":0.56999999999999995,"5min":3.0299999999999998,"15min":3.0299999999999998},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.58899999999999997,"15min":0.45100000000000001},"min":{"1min":0.249,"5min":0.19600000000000001,"15min":0.17699999999999999},"max":{"1min":0.47399999999999998,"5min":6.8179999999999996,"15min":6.8179999999999996},"last":0.34999999999999998}]},{"osd":4,"last update":"Thu Apr 2 23:47:10 2020","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.53200000000000003,"15min":0.44500000000000001},"min":{"1min":0.23300000000000001,"5min":0.23000000000000001,"15min":0.21199999999999999},"max":{"1min":0.61699999999999999,"5min":4.5309999999999997,"15min":4.5309999999999997},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.54300000000000004,"15min":0.503},"min":{"1min":0.35599999999999998,"5min":0.28799999999999998,"15min":0.247},"max":{"1min":0.66100000000000003,"5min":2.9620000000000002,"15min":2.9620000000000002},"last":0.626}]},{"osd":5,"last update":"Thu Apr 2 23:47:10 2020","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.61899999999999999,"15min":0.57899999999999996},"min":{"1min":0.30399999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.63600000000000001,"5min":6.7229999999999999,"15min":6.7229999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.59899999999999998,"15min":0.5},"min":{"1min":0.29699999999999999,"5min":0.26000000000000001,"15min":0.251},"max":{"1min":0.68100000000000005,"5min":4.5679999999999996,"15min":4.5679999999999996},"last":0.48199999999999998}]},{"osd":6,"last update":"Thu Apr 2 23:47:10 2020","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.59099999999999997,"15min":0.54900000000000004},"min":{"1min":0.35099999999999998,"5min":0.28000000000000003,"15min":0.27000000000000002},"max":{"1min":0.64300000000000002,"5min":3.0739999999999998,"15min":3.8639999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.65400000000000003,"15min":0.57799999999999996},"min":{"1min":0.33100000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.67000000000000004,"5min":6.6680000000000001,"15min":6.6680000000000001},"last":0.42899999999999999}]},{"osd":7,"last update":"Thu Apr 2 23:47:10 2020","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56699999999999995,"15min":0.56399999999999995},"min":{"1min":0.377,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.67600000000000005,"5min":2.992,"15min":4.7839999999999998},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.64300000000000002,"15min":0.59299999999999997},"min":{"1min":0.38500000000000001,"5min":0.31900000000000001,"15min":0.28199999999999997},"max":{"1min":0.66000000000000003,"5min":6.7599999999999998,"15min":6.7599999999999998},"last":0.54900000000000004}]}]},{"osd":4,"up_from":14,"seq":60129542460,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":876780,"kb_used_data":92822600,"kb_used_omap":52328,"kb_used_meta":0,"kb_avail":92822600,"statfs":{"total":95948165120,"available":95050342400,"internally_reserved":0,"allocated":95050342400,"data_stored":95050342400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":53584206,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 2 23:47:21 2020","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.39400000000000002,"15min":0.36399999999999999},"min":{"1min":0.19600000000000001,"5min":0.191,"15min":0.17899999999999999},"max":{"1min":0.63900000000000001,"5min":3.5129999999999999,"15min":3.758},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.45300000000000001,"15min":0.42699999999999999},"min":{"1min":0.29399999999999998,"5min":0.216,"15min":0.185},"max":{"1min":0.69299999999999995,"5min":2.5800000000000001,"15min":4.1189999999999998},"last":0.69199999999999995}]},{"osd":1,"last update":"Thu Apr 2 23:47:21 2020","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.41299999999999998,"15min":0.41599999999999998},"min":{"1min":0.25800000000000001,"5min":0.189,"15min":0.17299999999999999},"max":{"1min":0.60999999999999999,"5min":1.137,"15min":4.1559999999999997},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.433,"15min":0.45800000000000002},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.19900000000000001},"max":{"1min":0.65800000000000003,"5min":3.891,"15min":4.1970000000000001},"last":0.63500000000000001}]},{"osd":2,"last update":"Thu Apr 2 23:47:21 2020","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47599999999999998,"15min":0.49299999999999999},"min":{"1min":0.27100000000000002,"5min":0.20999999999999999,"15min":0.20399999999999999},"max":{"1min":0.751,"5min":3.8570000000000002,"15min":4.2489999999999997},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.497,"15min":0.44800000000000001},"min":{"1min":0.248,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.66000000000000003,"5min":4.7160000000000002,"15min":4.7160000000000002},"last":0.54600000000000004}]},{"osd":3,"last update":"Thu Apr 2 23:47:21 2020","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.48299999999999998,"15min":0.52100000000000002},"min":{"1min":0.35899999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.68400000000000005,"5min":1.0780000000000001,"15min":5.3780000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.50900000000000001,"15min":0.55800000000000005},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.26200000000000001},"max":{"1min":0.78400000000000003,"5min":3.956,"15min":5.359},"last":0.71899999999999997}]},{"osd":5,"last update":"Thu Apr 2 23:47:21 2020","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.44900000000000001,"15min":0.442},"min":{"1min":0.247,"5min":0.22,"15min":0.217},"max":{"1min":0.67500000000000004,"5min":3.5449999999999999,"15min":3.8029999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.435,"5min":0.55300000000000005,"15min":0.502},"min":{"1min":0.29599999999999999,"5min":0.23000000000000001,"15min":0.221},"max":{"1min":0.65900000000000003,"5min":5.1900000000000004,"15min":5.1900000000000004},"last":0.437}]},{"osd":6,"last update":"Thu Apr 2 23:47:21 2020","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.53800000000000003,"15min":0.52600000000000002},"min":{"1min":0.30299999999999999,"5min":0.23699999999999999,"15min":0.20000000000000001},"max":{"1min":0.755,"5min":3.7999999999999998,"15min":4.29},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.495,"5min":0.56599999999999995,"15min":0.55500000000000005},"min":{"1min":0.27500000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.80800000000000005,"5min":3.4700000000000002,"15min":5.9420000000000002},"last":0.46999999999999997}]},{"osd":7,"last update":"Thu Apr 2 23:47:21 2020","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.53300000000000003,"15min":0.57199999999999995},"min":{"1min":0.28199999999999997,"5min":0.255,"15min":0.23200000000000001},"max":{"1min":0.71899999999999997,"5min":1.0429999999999999,"15min":4.1870000000000003},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.54300000000000004,"15min":0.59199999999999997},"min":{"1min":0.34200000000000003,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.70799999999999996,"5min":3.927,"15min":4.4429999999999996},"last":0.56299999999999994}]}]},{"osd":5,"up_from":14,"seq":60129542460,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":884140,"kb_used_data":92815240,"kb_used_omap":37548,"kb_used_meta":0,"kb_avail":92815240,"statfs":{"total":95948165120,"available":95042805760,"internally_reserved":0,"allocated":95042805760,"data_stored":95042805760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":38449718,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 2 23:47:30 2020","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.38800000000000001,"15min":0.35699999999999998},"min":{"1min":0.21099999999999999,"5min":0.18099999999999999,"15min":0.17199999999999999},"max":{"1min":0.746,"5min":1.607,"15min":3.2669999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.51200000000000001,"15min":0.47499999999999998},"min":{"1min":0.32800000000000001,"5min":0.20799999999999999,"15min":0.191},"max":{"1min":0.77900000000000003,"5min":5.0970000000000004,"15min":5.0970000000000004},"last":0.745}]},{"osd":1,"last update":"Thu Apr 2 23:47:30 2020","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.56599999999999995,"15min":0.51300000000000001},"min":{"1min":0.223,"5min":0.223,"15min":0.19800000000000001},"max":{"1min":0.76400000000000001,"5min":5.1360000000000001,"15min":5.1360000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.51500000000000001,"15min":0.45900000000000002},"min":{"1min":0.29599999999999999,"5min":0.217,"15min":0.20599999999999999},"max":{"1min":0.86499999999999999,"5min":4.1879999999999997,"15min":4.9790000000000001},"last":0.81100000000000005}]},{"osd":2,"last update":"Thu Apr 2 23:47:30 2020","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.53700000000000003,"15min":0.51900000000000002},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.77100000000000002,"5min":4.4409999999999998,"15min":4.9509999999999996},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.501,"15min":0.44400000000000001},"min":{"1min":0.29199999999999998,"5min":0.224,"15min":0.218},"max":{"1min":0.73199999999999998,"5min":4.1609999999999996,"15min":4.1609999999999996},"last":0.73199999999999998}]},{"osd":3,"last update":"Thu Apr 2 23:47:30 2020","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.68100000000000005,"15min":0.60799999999999998},"min":{"1min":0.34399999999999997,"5min":0.27000000000000002,"15min":0.22700000000000001},"max":{"1min":0.72799999999999998,"5min":5.1630000000000003,"15min":5.1630000000000003},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.53100000000000003,"15min":0.51600000000000001},"min":{"1min":0.27600000000000002,"5min":0.25900000000000001,"15min":0.255},"max":{"1min":0.89700000000000002,"5min":4.4960000000000004,"15min":4.9240000000000004},"last":0.68999999999999995}]},{"osd":4,"last update":"Thu Apr 2 23:47:30 2020","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.48599999999999999,"15min":0.443},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.223},"max":{"1min":0.65200000000000002,"5min":2.1419999999999999,"15min":4.8540000000000001},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.63300000000000001,"15min":0.59399999999999997},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.251},"max":{"1min":0.81299999999999994,"5min":5.1909999999999998,"15min":5.1909999999999998},"last":0.45100000000000001}]},{"osd":6,"last update":"Thu Apr 2 23:47:30 2020","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.72799999999999998,"15min":0.61099999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.22700000000000001},"max":{"1min":0.79500000000000004,"5min":5.6740000000000004,"15min":5.6740000000000004},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.56100000000000005,"15min":0.54800000000000004},"min":{"1min":0.38500000000000001,"5min":0.28699999999999998,"15min":0.25},"max":{"1min":0.73199999999999998,"5min":2.6760000000000002,"15min":4.6769999999999996},"last":0.58399999999999996}]},{"osd":7,"last update":"Thu Apr 2 23:47:30 2020","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.74099999999999999,"15min":0.66600000000000004},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.82699999999999996,"5min":5.2190000000000003,"15min":5.2190000000000003},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61399999999999999,"15min":0.60799999999999998},"min":{"1min":0.40600000000000003,"5min":0.34799999999999998,"15min":0.28999999999999998},"max":{"1min":0.83799999999999997,"5min":4.5330000000000004,"15min":4.8879999999999999},"last":0.63200000000000001}]}]}]}} 2020-04-02T23:47:38.163 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:47:38.177 INFO:teuthology.orchestra.run.smithi174:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2020-04-02T23:47:38.328 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.320+0000 7fe3d7c90700 1 Processor -- start 2020-04-02T23:47:38.328 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.320+0000 7fe3d7c90700 1 -- start start 2020-04-02T23:47:38.328 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.320+0000 7fe3d7c90700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fe3d014a9a0 0x7fe3d014cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:38.329 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.320+0000 7fe3d7c90700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe3d014d1f0 0x7fe3d014f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:47:38.329 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.320+0000 7fe3d7c90700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3d00a39a0 con 0x7fe3d005bdd0 2020-04-02T23:47:38.329 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.320+0000 7fe3d7c90700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3d00a6440 con 0x7fe3d014d1f0 2020-04-02T23:47:38.329 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.320+0000 7fe3d7c90700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3d00a66e0 con 0x7fe3d014a9a0 2020-04-02T23:47:38.329 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.320+0000 7fe3d6a2e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe3d014d1f0 0x7fe3d014f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:38.329 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.321+0000 7fe3d6a2e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe3d014d1f0 0x7fe3d014f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:40730/0 (socket says 172.21.15.174:40730) 2020-04-02T23:47:38.329 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.320+0000 7fe3d622d700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fe3d005bdd0 0x7fe3d00a3f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:45764/0 (socket says 172.21.15.174:45764) 2020-04-02T23:47:38.329 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.321+0000 7fe3d6a2e700 1 -- 172.21.15.174:0/3961321348 learned_addr learned my addr 172.21.15.174:0/3961321348 (peer_addr_for_me v2:172.21.15.174:0/0) 2020-04-02T23:47:38.330 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.321+0000 7fe3d5a2c700 1 --2- 172.21.15.174:0/3961321348 >> v2:172.21.15.196:3300/0 conn(0x7fe3d014a9a0 0x7fe3d014cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:38.330 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.321+0000 7fe3d6a2e700 1 -- 172.21.15.174:0/3961321348 >> v2:172.21.15.196:3300/0 conn(0x7fe3d014a9a0 msgr2=0x7fe3d014cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:47:38.330 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.321+0000 7fe3d6a2e700 1 --2- 172.21.15.174:0/3961321348 >> v2:172.21.15.196:3300/0 conn(0x7fe3d014a9a0 0x7fe3d014cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:38.330 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.321+0000 7fe3d6a2e700 1 -- 172.21.15.174:0/3961321348 >> v1:172.21.15.174:6789/0 conn(0x7fe3d005bdd0 legacy=0x7fe3d00a3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:38.330 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.321+0000 7fe3d6a2e700 1 -- 172.21.15.174:0/3961321348 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3d00a6980 con 0x7fe3d014d1f0 2020-04-02T23:47:38.330 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.321+0000 7fe3d522b700 1 -- 172.21.15.174:0/3961321348 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2611566403 0 0) 0x7fe3d00a39a0 con 0x7fe3d005bdd0 2020-04-02T23:47:38.330 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.321+0000 7fe3d5a2c700 1 --2- 172.21.15.174:0/3961321348 >> v2:172.21.15.196:3300/0 conn(0x7fe3d014a9a0 0x7fe3d014cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-02T23:47:38.331 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.321+0000 7fe3d6a2e700 1 --2- 172.21.15.174:0/3961321348 >> v2:172.21.15.174:3300/0 conn(0x7fe3d014d1f0 0x7fe3d014f5e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe3d00a3ce0 tx=0x7fe3c8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:38.331 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.321+0000 7fe3d6a2e700 1 --2- 172.21.15.174:0/3961321348 >> v2:172.21.15.174:3300/0 conn(0x7fe3d014d1f0 0x7fe3d014f5e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe3d00a3ce0 tx=0x7fe3c8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:38.331 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.321+0000 7fe3d6a2e700 1 --2- 172.21.15.174:0/3961321348 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe3d014d1f0 0x7fe3d014f5e0 secure :-1 s=READY pgs=259 cs=0 l=1 rx=0x7fe3d00a3ce0 tx=0x7fe3c8007dc0).ready entity=mon.0 client_cookie=d9e80634384218af server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:38.331 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.321+0000 7fe3d6a2e700 1 --2- 172.21.15.174:0/3961321348 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe3d014d1f0 0x7fe3d014f5e0 secure :-1 s=THROTTLE_DONE pgs=259 cs=0 l=1 rx=0x7fe3d00a3ce0 tx=0x7fe3c8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:38.331 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.321+0000 7fe3d522b700 1 -- 172.21.15.174:0/3961321348 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3c800a160 con 0x7fe3d014d1f0 2020-04-02T23:47:38.331 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.321+0000 7fe3d6a2e700 1 --2- 172.21.15.174:0/3961321348 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe3d014d1f0 0x7fe3d014f5e0 secure :-1 s=THROTTLE_DONE pgs=259 cs=0 l=1 rx=0x7fe3d00a3ce0 tx=0x7fe3c8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:38.331 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.321+0000 7fe3d6a2e700 1 --2- 172.21.15.174:0/3961321348 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe3d014d1f0 0x7fe3d014f5e0 secure :-1 s=THROTTLE_DONE pgs=259 cs=0 l=1 rx=0x7fe3d00a3ce0 tx=0x7fe3c8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:38.331 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.321+0000 7fe3d522b700 1 -- 172.21.15.174:0/3961321348 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3c800a2c0 con 0x7fe3d014d1f0 2020-04-02T23:47:38.332 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.321+0000 7fe3d522b700 1 -- 172.21.15.174:0/3961321348 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3c800a6a0 con 0x7fe3d014d1f0 2020-04-02T23:47:38.332 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.321+0000 7fe3d7c90700 1 -- 172.21.15.174:0/3961321348 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe3d014d1f0 msgr2=0x7fe3d014f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:38.332 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.321+0000 7fe3d7c90700 1 --2- 172.21.15.174:0/3961321348 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe3d014d1f0 0x7fe3d014f5e0 secure :-1 s=READY pgs=259 cs=0 l=1 rx=0x7fe3d00a3ce0 tx=0x7fe3c8007dc0).stop 2020-04-02T23:47:38.332 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.322+0000 7fe3d7c90700 1 -- 172.21.15.174:0/3961321348 shutdown_connections 2020-04-02T23:47:38.333 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.322+0000 7fe3d7c90700 1 --2- 172.21.15.174:0/3961321348 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe3d014d1f0 0x7fe3d014f5e0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:38.333 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.322+0000 7fe3d7c90700 1 --2- 172.21.15.174:0/3961321348 >> v2:172.21.15.196:3300/0 conn(0x7fe3d014a9a0 0x7fe3d014cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:47:38.333 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.322+0000 7fe3d7c90700 1 -- 172.21.15.174:0/3961321348 >> 172.21.15.174:0/3961321348 conn(0x7fe3d00a6d00 msgr2=0x7fe3d00a7110 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:38.333 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.322+0000 7fe3d7c90700 1 -- 172.21.15.174:0/3961321348 shutdown_connections 2020-04-02T23:47:38.333 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.322+0000 7fe3d7c90700 1 -- 172.21.15.174:0/3961321348 wait complete. 2020-04-02T23:47:38.333 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.323+0000 7fe3d7c90700 1 Processor -- start 2020-04-02T23:47:38.333 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.323+0000 7fe3d7c90700 1 -- start start 2020-04-02T23:47:38.334 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.323+0000 7fe3d7c90700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe3d014a9a0 0x7fe3d009bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:38.334 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.323+0000 7fe3d7c90700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe3d014d1f0 0x7fe3d009bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:38.334 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.323+0000 7fe3d7c90700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3d00a4990 con 0x7fe3d005bdd0 2020-04-02T23:47:38.334 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.323+0000 7fe3d7c90700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3d014cc90 con 0x7fe3d014a9a0 2020-04-02T23:47:38.334 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.323+0000 7fe3d7c90700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d009e0e0 con 0x7fe3d014d1f0 2020-04-02T23:47:38.334 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.323+0000 7fe3d622d700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fe3d005bdd0 0x7fe3d012ed70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:45770/0 (socket says 172.21.15.174:45770) 2020-04-02T23:47:38.334 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.323+0000 7fe3d622d700 1 -- 172.21.15.174:0/2447108112 learned_addr learned my addr 172.21.15.174:0/2447108112 (peer_addr_for_me v1:172.21.15.174:0/0) 2020-04-02T23:47:38.334 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.323+0000 7fe3d5a2c700 1 --2- 172.21.15.174:0/2447108112 >> v2:172.21.15.174:3300/0 conn(0x7fe3d014a9a0 0x7fe3d009bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:38.335 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.323+0000 7fe3d6a2e700 1 --2- 172.21.15.174:0/2447108112 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe3d014d1f0 0x7fe3d009bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:38.335 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.323+0000 7fe3c6ffd700 1 -- 172.21.15.174:0/2447108112 <== mon.0 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3702072208 0 0) 0x7fe3d00a4990 con 0x7fe3d005bdd0 2020-04-02T23:47:38.335 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.324+0000 7fe3c6ffd700 1 -- 172.21.15.174:0/2447108112 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3b8003230 con 0x7fe3d005bdd0 2020-04-02T23:47:38.335 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.324+0000 7fe3d5a2c700 1 -- 172.21.15.174:0/2447108112 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe3d014d1f0 msgr2=0x7fe3d009bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:38.335 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.324+0000 7fe3d5a2c700 1 --2- 172.21.15.174:0/2447108112 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe3d014d1f0 0x7fe3d009bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:38.335 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.324+0000 7fe3d5a2c700 1 -- 172.21.15.174:0/2447108112 >> v1:172.21.15.174:6789/0 conn(0x7fe3d005bdd0 legacy=0x7fe3d012ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:38.335 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.324+0000 7fe3d5a2c700 1 -- 172.21.15.174:0/2447108112 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3d009e380 con 0x7fe3d014a9a0 2020-04-02T23:47:38.336 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.324+0000 7fe3d6a2e700 1 --2- 172.21.15.174:0/2447108112 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe3d014d1f0 0x7fe3d009bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-02T23:47:38.336 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.324+0000 7fe3d5a2c700 1 --2- 172.21.15.174:0/2447108112 >> v2:172.21.15.174:3300/0 conn(0x7fe3d014a9a0 0x7fe3d009bae0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe3c0002f30 tx=0x7fe3c0010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:38.336 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.324+0000 7fe3d5a2c700 1 --2- 172.21.15.174:0/2447108112 >> v2:172.21.15.174:3300/0 conn(0x7fe3d014a9a0 0x7fe3d009bae0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe3c0002f30 tx=0x7fe3c0010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:38.336 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.324+0000 7fe3d5a2c700 1 --2- 172.21.15.174:0/2447108112 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe3d014a9a0 0x7fe3d009bae0 secure :-1 s=READY pgs=261 cs=0 l=1 rx=0x7fe3c0002f30 tx=0x7fe3c0010a20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:38.336 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.324+0000 7fe3d5a2c700 1 --2- 172.21.15.174:0/2447108112 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe3d014a9a0 0x7fe3d009bae0 secure :-1 s=THROTTLE_DONE pgs=261 cs=0 l=1 rx=0x7fe3c0002f30 tx=0x7fe3c0010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:38.336 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.324+0000 7fe3c6ffd700 1 -- 172.21.15.174:0/2447108112 <== mon.0 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3c0008e50 con 0x7fe3d014a9a0 2020-04-02T23:47:38.336 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.324+0000 7fe3d5a2c700 1 --2- 172.21.15.174:0/2447108112 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe3d014a9a0 0x7fe3d009bae0 secure :-1 s=THROTTLE_DONE pgs=261 cs=0 l=1 rx=0x7fe3c0002f30 tx=0x7fe3c0010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:38.337 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.324+0000 7fe3d5a2c700 1 --2- 172.21.15.174:0/2447108112 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe3d014a9a0 0x7fe3d009bae0 secure :-1 s=THROTTLE_DONE pgs=261 cs=0 l=1 rx=0x7fe3c0002f30 tx=0x7fe3c0010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:38.337 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.324+0000 7fe3c6ffd700 1 -- 172.21.15.174:0/2447108112 <== mon.0 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3c0007160 con 0x7fe3d014a9a0 2020-04-02T23:47:38.337 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.324+0000 7fe3d7c90700 1 -- 172.21.15.174:0/2447108112 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3d012f480 con 0x7fe3d014a9a0 2020-04-02T23:47:38.337 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.324+0000 7fe3c6ffd700 1 -- 172.21.15.174:0/2447108112 <== mon.0 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3c0007580 con 0x7fe3d014a9a0 2020-04-02T23:47:38.337 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.324+0000 7fe3d7c90700 1 -- 172.21.15.174:0/2447108112 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3d00a0e20 con 0x7fe3d014a9a0 2020-04-02T23:47:38.337 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.325+0000 7fe3d5a2c700 1 --2- 172.21.15.174:0/2447108112 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe3d014a9a0 0x7fe3d009bae0 secure :-1 s=THROTTLE_DONE pgs=261 cs=0 l=1 rx=0x7fe3c0002f30 tx=0x7fe3c0010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:38.337 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.325+0000 7fe3d5a2c700 1 --2- 172.21.15.174:0/2447108112 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe3d014a9a0 0x7fe3d009bae0 secure :-1 s=THROTTLE_DONE pgs=261 cs=0 l=1 rx=0x7fe3c0002f30 tx=0x7fe3c0010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:38.337 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.325+0000 7fe3d7c90700 1 -- 172.21.15.174:0/2447108112 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3d009e510 con 0x7fe3d014a9a0 2020-04-02T23:47:38.338 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.325+0000 7fe3c6ffd700 1 -- 172.21.15.174:0/2447108112 <== mon.0 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fe3c00058d0 con 0x7fe3d014a9a0 2020-04-02T23:47:38.338 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.325+0000 7fe3c6ffd700 1 --2- 172.21.15.174:0/2447108112 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fe3b804d8f0 0x7fe3b804fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:47:38.338 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.325+0000 7fe3c6ffd700 1 -- 172.21.15.174:0/2447108112 <== mon.0 v2:172.21.15.174:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe3c0060bf0 con 0x7fe3d014a9a0 2020-04-02T23:47:38.338 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.326+0000 7fe3d622d700 1 --2- 172.21.15.174:0/2447108112 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fe3b804d8f0 0x7fe3b804fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:47:38.338 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.326+0000 7fe3d622d700 1 --2- 172.21.15.174:0/2447108112 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fe3b804d8f0 0x7fe3b804fdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe3cc000ff0 tx=0x7fe3cc001780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:38.338 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.326+0000 7fe3d622d700 1 --2- 172.21.15.174:0/2447108112 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fe3b804d8f0 0x7fe3b804fdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe3cc000ff0 tx=0x7fe3cc001780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:38.338 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.326+0000 7fe3d622d700 1 --2- 172.21.15.174:0/2447108112 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fe3b804d8f0 0x7fe3b804fdb0 secure :-1 s=READY pgs=136 cs=0 l=1 rx=0x7fe3cc000ff0 tx=0x7fe3cc001780).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:47:38.339 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.329+0000 7fe3d5a2c700 1 --2- 172.21.15.174:0/2447108112 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe3d014a9a0 0x7fe3d009bae0 secure :-1 s=THROTTLE_DONE pgs=261 cs=0 l=1 rx=0x7fe3c0002f30 tx=0x7fe3c0010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:38.339 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.329+0000 7fe3c6ffd700 1 -- 172.21.15.174:0/2447108112 <== mon.0 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fe3c003c2b0 con 0x7fe3d014a9a0 2020-04-02T23:47:38.467 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.465+0000 7fe3d7c90700 1 -- 172.21.15.174:0/2447108112 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"} v 0) v1 -- 0x7fe3d0056c50 con 0x7fe3d014a9a0 2020-04-02T23:47:38.472 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.468+0000 7fe3d5a2c700 1 --2- 172.21.15.174:0/2447108112 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe3d014a9a0 0x7fe3d009bae0 secure :-1 s=THROTTLE_DONE pgs=261 cs=0 l=1 rx=0x7fe3c0002f30 tx=0x7fe3c0010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:38.473 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.468+0000 7fe3c6ffd700 1 -- 172.21.15.174:0/2447108112 <== mon.0 v2:172.21.15.174:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fe3c003c2b0 con 0x7fe3d014a9a0 2020-04-02T23:47:38.473 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.468+0000 7fe3d5a2c700 1 --2- 172.21.15.174:0/2447108112 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe3d014a9a0 0x7fe3d009bae0 secure :-1 s=THROTTLE_DONE pgs=261 cs=0 l=1 rx=0x7fe3c0002f30 tx=0x7fe3c0010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:47:38.473 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.468+0000 7fe3c6ffd700 1 -- 172.21.15.174:0/2447108112 <== mon.0 v2:172.21.15.174:3300/0 8 ==== mon_command_ack([{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}]=0 v2) v1 ==== 123+0+0 (secure 0 0 0) 0x7fe3c003f8d0 con 0x7fe3d014a9a0 2020-04-02T23:47:38.474 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.471+0000 7fe3d7c90700 1 -- 172.21.15.174:0/2447108112 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fe3b804d8f0 msgr2=0x7fe3b804fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:38.474 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.471+0000 7fe3d7c90700 1 --2- 172.21.15.174:0/2447108112 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fe3b804d8f0 0x7fe3b804fdb0 secure :-1 s=READY pgs=136 cs=0 l=1 rx=0x7fe3cc000ff0 tx=0x7fe3cc001780).stop 2020-04-02T23:47:38.474 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.471+0000 7fe3d7c90700 1 -- 172.21.15.174:0/2447108112 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe3d014a9a0 msgr2=0x7fe3d009bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:47:38.474 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.471+0000 7fe3d7c90700 1 --2- 172.21.15.174:0/2447108112 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe3d014a9a0 0x7fe3d009bae0 secure :-1 s=READY pgs=261 cs=0 l=1 rx=0x7fe3c0002f30 tx=0x7fe3c0010a20).stop 2020-04-02T23:47:38.475 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.471+0000 7fe3d7c90700 1 -- 172.21.15.174:0/2447108112 shutdown_connections 2020-04-02T23:47:38.475 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.471+0000 7fe3d7c90700 1 --2- 172.21.15.174:0/2447108112 >> [v2:172.21.15.196:6800/23210,v1:172.21.15.196:6801/23210] conn(0x7fe3b804d8f0 0x7fe3b804fdb0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:38.475 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.471+0000 7fe3d7c90700 1 --2- 172.21.15.174:0/2447108112 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe3d014d1f0 0x7fe3d009bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:38.475 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.471+0000 7fe3d7c90700 1 --2- 172.21.15.174:0/2447108112 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe3d014a9a0 0x7fe3d009bae0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:47:38.475 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.471+0000 7fe3d7c90700 1 -- 172.21.15.174:0/2447108112 >> 172.21.15.174:0/2447108112 conn(0x7fe3d00a6d00 msgr2=0x7fe3d007f440 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:47:38.475 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.471+0000 7fe3d7c90700 1 -- 172.21.15.174:0/2447108112 shutdown_connections 2020-04-02T23:47:38.475 INFO:teuthology.orchestra.run.smithi174.stderr:2020-04-02T23:47:38.471+0000 7fe3d7c90700 1 -- 172.21.15.174:0/2447108112 wait complete. 2020-04-02T23:47:38.488 INFO:teuthology.misc:Shutting down mds daemons... 2020-04-02T23:47:38.488 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2020-04-02T23:47:38.488 INFO:teuthology.orchestra.run:waiting for 300 2020-04-02T23:47:38.496 INFO:tasks.ceph.mds.a:Stopped 2020-04-02T23:47:38.497 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2020-04-02T23:47:38.497 INFO:teuthology.orchestra.run:waiting for 300 2020-04-02T23:47:38.508 INFO:tasks.ceph.mds.b:Stopped 2020-04-02T23:47:38.508 INFO:teuthology.misc:Shutting down osd daemons... 2020-04-02T23:47:38.508 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2020-04-02T23:47:38.508 INFO:teuthology.orchestra.run:waiting for 300 2020-04-02T23:47:38.548 INFO:tasks.ceph.osd.1:Stopped 2020-04-02T23:47:38.549 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2020-04-02T23:47:38.549 INFO:teuthology.orchestra.run:waiting for 300 2020-04-02T23:47:38.601 INFO:tasks.ceph.osd.0:Stopped 2020-04-02T23:47:38.601 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2020-04-02T23:47:38.601 INFO:teuthology.orchestra.run:waiting for 300 2020-04-02T23:47:38.654 INFO:tasks.ceph.osd.3:Stopped 2020-04-02T23:47:38.655 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2020-04-02T23:47:38.659 INFO:teuthology.orchestra.run:waiting for 300 2020-04-02T23:47:38.710 INFO:tasks.ceph.osd.2:Stopped 2020-04-02T23:47:38.710 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2020-04-02T23:47:38.710 INFO:teuthology.orchestra.run:waiting for 300 2020-04-02T23:47:38.731 INFO:tasks.ceph.osd.5:Stopped 2020-04-02T23:47:38.732 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2020-04-02T23:47:38.732 INFO:teuthology.orchestra.run:waiting for 300 2020-04-02T23:47:38.788 INFO:tasks.ceph.osd.4:Stopped 2020-04-02T23:47:38.789 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2020-04-02T23:47:38.789 INFO:teuthology.orchestra.run:waiting for 300 2020-04-02T23:47:38.844 INFO:tasks.ceph.osd.7:Stopped 2020-04-02T23:47:38.844 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2020-04-02T23:47:38.845 INFO:teuthology.orchestra.run:waiting for 300 2020-04-02T23:47:38.901 INFO:tasks.ceph.osd.6:Stopped 2020-04-02T23:47:38.901 INFO:teuthology.misc:Shutting down mgr daemons... 2020-04-02T23:47:38.902 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2020-04-02T23:47:38.902 INFO:teuthology.orchestra.run:waiting for 300 2020-04-02T23:47:38.917 INFO:tasks.ceph.mgr.y:Stopped 2020-04-02T23:47:38.918 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2020-04-02T23:47:38.918 INFO:teuthology.orchestra.run:waiting for 300 2020-04-02T23:47:38.959 INFO:tasks.ceph.mgr.x:Stopped 2020-04-02T23:47:38.959 INFO:teuthology.misc:Shutting down mon daemons... 2020-04-02T23:47:38.960 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2020-04-02T23:47:38.960 INFO:teuthology.orchestra.run:waiting for 300 2020-04-02T23:47:38.970 INFO:tasks.ceph.mon.a:Stopped 2020-04-02T23:47:38.970 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2020-04-02T23:47:38.970 INFO:teuthology.orchestra.run:waiting for 300 2020-04-02T23:47:39.010 INFO:tasks.ceph.mon.c:Stopped 2020-04-02T23:47:39.011 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2020-04-02T23:47:39.011 INFO:teuthology.orchestra.run:waiting for 300 2020-04-02T23:47:39.061 INFO:tasks.ceph.mon.b:Stopped 2020-04-02T23:47:39.062 INFO:tasks.ceph:Checking cluster log for badness... 2020-04-02T23:47:39.062 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:47:39.076 INFO:teuthology.orchestra.run.smithi174:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2020-04-02T23:47:39.164 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi196.front.sepia.ceph.com 2020-04-02T23:47:39.164 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:47:39.179 INFO:teuthology.orchestra.run.smithi196:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2020-04-02T23:47:39.448 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi196.front.sepia.ceph.com 2020-04-02T23:47:39.448 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:47:39.465 INFO:teuthology.orchestra.run.smithi196:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2020-04-02T23:47:39.589 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi196.front.sepia.ceph.com 2020-04-02T23:47:39.590 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:47:39.607 INFO:teuthology.orchestra.run.smithi196:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2020-04-02T23:47:39.750 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi196.front.sepia.ceph.com 2020-04-02T23:47:39.751 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:47:39.773 INFO:teuthology.orchestra.run.smithi196:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2020-04-02T23:47:39.947 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi174.front.sepia.ceph.com 2020-04-02T23:47:39.948 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:47:39.962 INFO:teuthology.orchestra.run.smithi174:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2020-04-02T23:47:40.243 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi174.front.sepia.ceph.com 2020-04-02T23:47:40.243 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:47:40.259 INFO:teuthology.orchestra.run.smithi174:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2020-04-02T23:47:40.375 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi174.front.sepia.ceph.com 2020-04-02T23:47:40.375 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:47:40.389 INFO:teuthology.orchestra.run.smithi174:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2020-04-02T23:47:40.499 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi174.front.sepia.ceph.com 2020-04-02T23:47:40.499 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:47:40.513 INFO:teuthology.orchestra.run.smithi174:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2020-04-02T23:47:40.636 INFO:tasks.ceph:Archiving mon data... 2020-04-02T23:47:40.637 DEBUG:teuthology.misc:Transferring archived files from smithi196:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/gregf-2020-04-02_17:05:44-fs-wip-greg-testing-42-distro-basic-smithi/4919105/data/mon.b.tgz 2020-04-02T23:47:40.638 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:47:40.653 INFO:teuthology.orchestra.run.smithi196:> mktemp 2020-04-02T23:47:40.707 INFO:teuthology.orchestra.run.smithi196.stdout:/tmp/tmp.v69baG5AUG 2020-04-02T23:47:40.708 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:47:40.761 INFO:teuthology.orchestra.run.smithi196:> sudo tar cz -f /tmp/tmp.v69baG5AUG -C /var/lib/ceph/mon/ceph-b -- . 2020-04-02T23:47:41.052 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:47:41.065 INFO:teuthology.orchestra.run.smithi196:> sudo chmod 0666 /tmp/tmp.v69baG5AUG 2020-04-02T23:47:41.189 DEBUG:teuthology.orchestra.remote:smithi196:/tmp/tmp.v69baG5AUG is 565KB 2020-04-02T23:47:41.288 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:47:41.302 INFO:teuthology.orchestra.run.smithi196:> rm -fr /tmp/tmp.v69baG5AUG 2020-04-02T23:47:41.355 DEBUG:teuthology.misc:Transferring archived files from smithi196:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/gregf-2020-04-02_17:05:44-fs-wip-greg-testing-42-distro-basic-smithi/4919105/data/mon.c.tgz 2020-04-02T23:47:41.355 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:47:41.409 INFO:teuthology.orchestra.run.smithi196:> mktemp 2020-04-02T23:47:41.463 INFO:teuthology.orchestra.run.smithi196.stdout:/tmp/tmp.TfSTr7run2 2020-04-02T23:47:41.463 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:47:41.516 INFO:teuthology.orchestra.run.smithi196:> sudo tar cz -f /tmp/tmp.TfSTr7run2 -C /var/lib/ceph/mon/ceph-c -- . 2020-04-02T23:47:41.767 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:47:41.780 INFO:teuthology.orchestra.run.smithi196:> sudo chmod 0666 /tmp/tmp.TfSTr7run2 2020-04-02T23:47:41.903 DEBUG:teuthology.orchestra.remote:smithi196:/tmp/tmp.TfSTr7run2 is 565KB 2020-04-02T23:47:42.002 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:47:42.015 INFO:teuthology.orchestra.run.smithi196:> rm -fr /tmp/tmp.TfSTr7run2 2020-04-02T23:47:42.067 DEBUG:teuthology.misc:Transferring archived files from smithi174:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/gregf-2020-04-02_17:05:44-fs-wip-greg-testing-42-distro-basic-smithi/4919105/data/mon.a.tgz 2020-04-02T23:47:42.068 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:47:42.085 INFO:teuthology.orchestra.run.smithi174:> mktemp 2020-04-02T23:47:42.153 INFO:teuthology.orchestra.run.smithi174.stdout:/tmp/tmp.kNkN9aqOKu 2020-04-02T23:47:42.154 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:47:42.209 INFO:teuthology.orchestra.run.smithi174:> sudo tar cz -f /tmp/tmp.kNkN9aqOKu -C /var/lib/ceph/mon/ceph-a -- . 2020-04-02T23:47:42.473 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:47:42.486 INFO:teuthology.orchestra.run.smithi174:> sudo chmod 0666 /tmp/tmp.kNkN9aqOKu 2020-04-02T23:47:42.627 DEBUG:teuthology.orchestra.remote:smithi174:/tmp/tmp.kNkN9aqOKu is 545KB 2020-04-02T23:47:42.726 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:47:42.739 INFO:teuthology.orchestra.run.smithi174:> rm -fr /tmp/tmp.kNkN9aqOKu 2020-04-02T23:47:42.792 INFO:tasks.ceph:Cleaning ceph cluster... 2020-04-02T23:47:42.792 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:47:42.849 INFO:teuthology.orchestra.run.smithi174:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2020-04-02T23:47:42.892 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:47:42.907 INFO:teuthology.orchestra.run.smithi196:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2020-04-02T23:47:42.977 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2020-04-02T23:47:42.977 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:47:43.032 INFO:teuthology.orchestra.run.smithi196:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2020-04-02T23:47:43.073 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:47:43.087 INFO:teuthology.orchestra.run.smithi174:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2020-04-02T23:47:43.100 INFO:teuthology.orchestra.run.smithi196.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2020-04-02T23:47:43.155 INFO:teuthology.orchestra.run.smithi174.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2020-04-02T23:47:43.160 INFO:tasks.ceph:Archiving crash dumps... 2020-04-02T23:47:43.163 DEBUG:teuthology.misc:Transferring archived files from smithi196:/var/lib/ceph/crash to /home/teuthworker/archive/gregf-2020-04-02_17:05:44-fs-wip-greg-testing-42-distro-basic-smithi/4919105/remote/smithi196/crash 2020-04-02T23:47:43.164 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:47:43.178 INFO:teuthology.orchestra.run.smithi196:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2020-04-02T23:47:43.248 DEBUG:teuthology.misc:Transferring archived files from smithi174:/var/lib/ceph/crash to /home/teuthworker/archive/gregf-2020-04-02_17:05:44-fs-wip-greg-testing-42-distro-basic-smithi/4919105/remote/smithi174/crash 2020-04-02T23:47:43.249 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:47:43.265 INFO:teuthology.orchestra.run.smithi174:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2020-04-02T23:47:43.333 INFO:tasks.ceph:Shutting down logrotate 2020-04-02T23:47:43.333 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:47:43.386 INFO:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:47:43.428 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:47:43.442 INFO:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:47:43.554 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:47:43.571 INFO:teuthology.orchestra.run.smithi174:> sudo rm /etc/logrotate.d/ceph-test.conf 2020-04-02T23:47:43.657 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:47:43.671 INFO:teuthology.orchestra.run.smithi196:> sudo rm /etc/logrotate.d/ceph-test.conf 2020-04-02T23:47:43.739 INFO:tasks.ceph:Compressing logs... 2020-04-02T23:47:43.739 INFO:teuthology.orchestra.run.smithi174:> true 2020-04-02T23:47:43.753 INFO:teuthology.orchestra.run.smithi174:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2020-04-02T23:47:43.795 INFO:teuthology.orchestra.run.smithi196:> true 2020-04-02T23:47:43.809 INFO:teuthology.orchestra.run.smithi196:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2020-04-02T23:51:15.764 DEBUG:teuthology.exit:Got signal 15; running 2 handlers... 2020-04-02T23:51:15.765 DEBUG:teuthology.task.console_log:Killing console logger for smithi174 2020-04-02T23:51:15.765 DEBUG:teuthology.task.console_log:Killing console logger for smithi196 2020-04-02T23:51:15.765 DEBUG:teuthology.task.console_log:Killing console logger for smithi196 2020-04-02T23:51:15.766 DEBUG:teuthology.task.console_log:Killing console logger for smithi174 2020-04-02T23:51:15.766 DEBUG:teuthology.exit:Finished running handlers